00000001:02000400:0.0F:1783441226.273990:0:2959:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg113-server.virtnet: executing set_hostid 00000001:02000400:2.0F:1783441247.225126:0:3179:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg113-server.virtnet: executing load_modules_local 00000001:01000000:3.0F:1783441249.287798:0:3239:0:(lnet-crypto.c:359:cfs_crypto_performance_test()) Crypto hash algorithm adler32 speed = 529 MB/s 00000001:01000000:2.0:1783441249.542920:0:3239:0:(lnet-crypto.c:359:cfs_crypto_performance_test()) Crypto hash algorithm crc32 speed = 835 MB/s 00000001:01000000:2.0:1783441249.795626:0:3239:0:(lnet-crypto.c:359:cfs_crypto_performance_test()) Crypto hash algorithm crc32c speed = 4876 MB/s 00000020:02000000:0.0:1783441250.523254:0:3272:0:(class_obd.c:804:obdclass_init()) Lustre: Build Version: 2.17.54_105_g2b8c50a 00000400:02000000:3.0:1783441251.567440:0:3287:0:(api-ni.c:2752:lnet_startup_lndni()) Added LNI 192.168.201.113@tcp [8/256/0/180] 00008000:02000000:0.0:1783441255.359710:0:3436:0:(echo_client.c:2573:obdecho_init()) Echo OBD driver; http://www.lustre.org/ 00000001:02000400:3.0:1783441311.986993:0:5237:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg113-server.virtnet: executing load_modules_local 00000020:01000004:2.0:1783441320.873041:0:5765:0:(obd_mount.c:923:lmd_print()) mount data: 00000020:01000004:2.0:1783441320.873048:0:5765:0:(obd_mount.c:926:lmd_print()) device: lustre-mdt1/mdt1 00000080:01200004:2.0:1783441320.873196:0:5765:0:(super25.c:130:lustre_fill_super()) VFS Op: sb 000000009056e030 00000080:02000400:2.0:1783441320.873219:0:5765:0:(super25.c:154:lustre_fill_super()) lustre-MDT0000: mounting server target with '-t lustre' deprecated, use '-t lustre_tgt' 00000020:01000004:2.0:1783441320.887703:0:5765:0:(tgt_mount.c:2501:osd_start()) Attempting to start lustre-MDT0000, type=osd-zfs, lsifl=200065, mountfl=0 00000020:01000004:2.0:1783441320.887716:0:5765:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-osd (typ=osd-zfs) 00000020:00000080:3.0:1783441320.889020:0:5765:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-osd (00000000febd646a) 00000020:00000080:3.0:1783441320.889044:0:5765:0:(obd_config.c:720:class_attach_name()) OBD: dev 0 attached type osd-zfs with refcount 2 00100000:10000000:0.0:1783441320.930259:0:5765:0:(scrub.c:229:scrub_file_store()) lustre-MDT0000: store scrub file: rc = 0 00100000:10000000:0.0:1783441320.930728:0:5765:0:(scrub.c:229:scrub_file_store()) lustre-MDT0000: store scrub file: rc = 0 00100000:10000000:2.0:1783441320.983115:0:5765:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-MDT0000: refresh OI map for scrub, op 1, force yes, [0x200000001:0x1017:0x0] => 0 (CONFIGS): rc = 1 00100000:10000000:2.0:1783441320.983173:0:5765:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-MDT0000: refresh OI map for scrub, op 1, force yes, [0x200000007:0x1:0x0] => 0 (ROOT): rc = 1 00100000:10000000:2.0:1783441320.983207:0:5765:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-MDT0000: refresh OI map for scrub, op 1, force yes, [0x200000001:0x3:0x0] => 0 (fld): rc = 1 00100000:10000000:2.0:1783441320.983261:0:5765:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-MDT0000: refresh OI map for scrub, op 1, force yes, [0x200000009:0x0:0x0] => 0 (update_log): rc = 1 00100000:10000000:2.0:1783441320.983286:0:5765:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-MDT0000: refresh OI map for scrub, op 1, force yes, [0x20000000a:0x0:0x0] => 0 (update_log_dir): rc = 1 00000020:00000080:2.0:1783441320.983649:0:5765:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-osd (uuid lustre-MDT0000-osd_UUID) 00080000:01000000:2.0:1783441320.983658:0:5765:0:(osd_handler.c:1569:osd_obd_connect()) connect #0 00000020:00000080:2.0:1783441320.983669:0:5765:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0xa2426164df2c743a 00000020:01000004:2.0:1783441320.983677:0:5765:0:(tgt_mount.c:2586:server_fill_super()) Found service lustre-MDT0000 on device lustre-mdt1/mdt1 00000020:01000000:2.0:1783441320.983682:0:5765:0:(tgt_mount.c:219:server_start_mgs()) Start MGS service MGS 00000020:01000004:2.0:1783441320.983686:0:5765:0:(tgt_mount.c:101:server_register_mount()) register mount 000000009056e030 from MGS 00000020:01000004:2.0:1783441320.983691:0:5765:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD MGS (typ=mgs) 00000020:00000080:2.0:1783441320.983712:0:5765:0:(genops.c:413:class_newdev()) Allocate new device MGS (000000005a98a3e0) 00000020:00000080:2.0:1783441320.983725:0:5765:0:(obd_config.c:720:class_attach_name()) OBD: dev 1 attached type mgs with refcount 2 00000020:01000004:2.0:1783441320.984987:0:5765:0:(tgt_mount.c:153:server_get_mount()) get mount 000000009056e030 from MGS, refs=2 00080000:01000000:2.0:1783441320.984998:0:5765:0:(osd_handler.c:1569:osd_obd_connect()) connect #1 00000020:00000080:2.0:1783441320.985006:0:5765:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0xa2426164df2c7448 00000100:00100000:2.0:1783441320.985124:0:5765:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/1 left), rc = 0 00000100:00100000:2.0:1783441320.985255:0:5765:0:(service.c:3462:ptlrpc_start_thread()) ldlm_cbd[0] started 0 min 2 max 56 00000100:00100000:2.0:1783441320.985261:0:5765:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cb00_000' 00000100:00100000:0.0:1783441320.991471:0:5765:0:(service.c:3462:ptlrpc_start_thread()) ldlm_cbd[0] started 1 min 2 max 56 00000100:00100000:0.0:1783441320.991490:0:5765:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cb00_001' 00000100:00100000:3.0:1783441320.992412:0:5765:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_canceld: allocate 64 new 8192-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1783441320.992626:0:5765:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 0 min 3 max 56 00000100:00100000:3.0:1783441320.992633:0:5765:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cn00_000' 00000100:00100000:3.0:1783441320.995088:0:5765:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 1 min 3 max 56 00000100:00100000:3.0:1783441320.995102:0:5765:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cn00_001' 00000100:00100000:0.0:1783441320.995513:0:5765:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 2 min 3 max 56 00000100:00100000:0.0:1783441320.995520:0:5765:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cn00_002' 00010000:00010000:3.0:1783441320.996223:0:5772:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783441320.996226:0:5772:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783441320.996228:0:5772:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783441320.996444:0:5773:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783441320.996446:0:5773:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783441320.996448:0:5773:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783441320.999917:0:5765:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-MGS-0 is initialized 00010000:00010000:3.0:1783441321.011926:0:5772:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:01000000:3.0:1783441321.249435:0:5765:0:(integrity.c:236:obd_t10_performance_test()) MGS: T10 checksum algorithm t10ip512 speed = 2755 MB/s 00000001:01000000:2.0:1783441321.498789:0:5765:0:(integrity.c:236:obd_t10_performance_test()) MGS: T10 checksum algorithm t10ip4K speed = 3411 MB/s 00000001:01000000:3.0:1783441321.749439:0:5765:0:(integrity.c:236:obd_t10_performance_test()) MGS: T10 checksum algorithm t10crc512 speed = 379 MB/s 00000001:01000000:2.0:1783441322.000382:0:5765:0:(integrity.c:236:obd_t10_performance_test()) MGS: T10 checksum algorithm t10crc4K speed = 537 MB/s 00080000:10000000:0.0:1783441322.022020:0:5765:0:(osd_index.c:2102:osd_index_try()) lustre-MDT0000: index object [0x200000003:0x3:0x0] (8/8/4) registered 00010000:00010000:3.0:1783441322.032996:0:5773:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:01000000:0.0:1783441322.052481:0:5765:0:(llog_obd.c:197:llog_setup()) obd MGS ctxt 0 is initialized 20000000:01000000:0.0:1783441322.052503:0:5765:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping . 20000000:01000000:0.0:1783441322.052506:0:5765:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping .. 10000000:01000000:1.0F:1783441322.055382:0:5776:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x2 (params) 20000000:01000000:0.0:1783441322.055484:0:5765:0:(mgs_nids.c:666:mgs_nidtbl_init_fs()) IR: current version is 2 20000000:01000000:0.0:1783441322.055544:0:5765:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 00000040:00080000:3.0:1783441322.066244:0:5765:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 20000000:01000000:3.0:1783441322.066290:0:5765:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 00000100:00100000:3.0:1783441322.066599:0:5765:0:(service.c:155:ptlrpc_grow_req_bufs()) mgs: allocate 64 new 8192-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1783441322.066804:0:5765:0:(service.c:3462:ptlrpc_start_thread()) mgs[-1] started 0 min 3 max 32 00000100:00100000:3.0:1783441322.066810:0:5765:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_mgs_0000' 00000100:00100000:2.0:1783441322.070407:0:5765:0:(service.c:3462:ptlrpc_start_thread()) mgs[-1] started 1 min 3 max 32 00000100:00100000:2.0:1783441322.070420:0:5765:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_mgs_0001' 00000100:00100000:3.0:1783441322.070790:0:5765:0:(service.c:3462:ptlrpc_start_thread()) mgs[-1] started 2 min 3 max 32 00000100:00100000:3.0:1783441322.070797:0:5765:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_mgs_0002' 00000020:00000080:2.0:1783441322.072216:0:5765:0:(obd_config.c:826:class_setup()) finished setup of obd MGS (uuid MGS) 00000020:01000004:2.0:1783441322.072238:0:5765:0:(obd_mount.c:411:lustre_start_mgc()) Start MGC 'MGC192.168.201.113@tcp' 00000020:01000004:2.0:1783441322.072240:0:5765:0:(obd_mount.c:420:lustre_start_mgc()) mgs NIDs (null). 00000020:01000004:2.0:1783441322.072290:0:5765:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD MGC192.168.201.113@tcp (typ=mgc) 00000020:00000080:2.0:1783441322.072301:0:5765:0:(genops.c:413:class_newdev()) Allocate new device MGC192.168.201.113@tcp (00000000cba4f1f0) 00000020:00000080:2.0:1783441322.072315:0:5765:0:(obd_config.c:720:class_attach_name()) OBD: dev 2 attached type mgc with refcount 2 00010000:00080000:2.0:1783441322.072402:0:5765:0:(ldlm_lib.c:102:import_set_conn()) imp 000000007647330e@MGC192.168.201.113@tcp: add connection 192.168.201.113@tcp at head 00010000:00010000:2.0:1783441322.072557:0:5765:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-MGC192.168.201.113@tcp-0 is initialized 00000040:01000000:2.0:1783441322.072564:0:5765:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.201.113@tcp ctxt 1 is initialized 00000100:00080000:3.0:1783441322.072685:0:5781:0:(pinger.c:468:ping_evictor_main()) Starting Ping Evictor 10000000:01000000:0.0:1783441322.082445:0:5783:0:(mgc_request.c:631:mgc_requeue_thread()) Starting requeue thread 00000020:00000080:2.0:1783441322.082536:0:5765:0:(obd_config.c:826:class_setup()) finished setup of obd MGC192.168.201.113@tcp (uuid 6c1ddb50-5795-40c6-a2b6-8f58add9da62) 00000020:00000080:2.0:1783441322.082561:0:5765:0:(genops.c:1406:class_connect()) connect: client 6c1ddb50-5795-40c6-a2b6-8f58add9da62, cookie 0xa2426164df2c7456 00000100:00080000:2.0:1783441322.082574:0:5765:0:(import.c:510:import_select_connection()) MGC192.168.201.113@tcp: connect to NID 0@lo last attempt 0 00000100:00080000:2.0:1783441322.082580:0:5765:0:(import.c:624:import_select_connection()) MGC192.168.201.113@tcp: import 000000007647330e using connection 192.168.201.113@tcp/0@lo 00000100:00100000:2.0:1783441322.082629:0:5765:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@000000000eff6eb5 x1870073693208704/t0(0) o250->MGC192.168.201.113@tcp@0@lo:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1783441322.082659:0:5765:0:(pinger.c:374:ptlrpc_pinger_add_import()) adding pingable import 6c1ddb50-5795-40c6-a2b6-8f58add9da62->MGS 00000020:01000004:2.0:1783441322.082680:0:5765:0:(tgt_mount.c:1810:server_start_targets()) starting target lustre-MDT0000 00000020:01000004:2.0:1783441322.082704:0:5765:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD MDS (typ=mds) 00000020:00000080:2.0:1783441322.082720:0:5765:0:(genops.c:413:class_newdev()) Allocate new device MDS (0000000080873392) 00000020:00000080:2.0:1783441322.082732:0:5765:0:(obd_config.c:720:class_attach_name()) OBD: dev 3 attached type mds with refcount 2 00000100:00100000:1.0:1783441322.089885:0:3302:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@000000000eff6eb5 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:6c1ddb50-5795-40c6-a2b6-8f58add9da62:3302:1870073693208704:0@lo:250: 00000100:00100000:1.0:1783441322.089990:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783441322.093825:0:5778:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073693208704 00000100:00100000:0.0:1783441322.093841:0:5778:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073693208704 00000100:00100000:0.0:1783441322.093903:0:5778:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1783441322.093910:0:5778:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000010ab70f4 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0+-99:3302:x1870073693208704:12345-0@lo:250: 00010000:00080000:0.0:1783441322.093940:0:5778:0:(ldlm_lib.c:1432:target_handle_connect()) MGS: connection from 6c1ddb50-5795-40c6-a2b6-8f58add9da62@0@lo t0 exp 0000000000000000 cur 159 last 0 00000020:00000080:0.0:1783441322.093967:0:5778:0:(genops.c:1406:class_connect()) connect: client 6c1ddb50-5795-40c6-a2b6-8f58add9da62, cookie 0xa2426164df2c7464 00000100:00080000:0.0:1783441322.094098:0:5778:0:(import.c:65:import_set_state_nolock()) 00000000fb117b06 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1783441322.094197:0:5778:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000010ab70f4 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6c1ddb50-5795-40c6-a2b6-8f58add9da62+5:3302:x1870073693208704:12345-0@lo:250: Request processed in 286us (4207us total) trans 0 rc 0/0 00000100:00100000:0.0:1783441322.094204:0:5778:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1783441322.094598:0:3302:0:(client.c:3112:ptlrpc_free_committed()) MGC192.168.201.113@tcp: committing for last_committed 0 gen 1 00000100:00080000:1.0:1783441322.094608:0:3302:0:(import.c:1132:ptlrpc_connect_interpret()) MGC192.168.201.113@tcp: connect to target with instance 0 00000100:00080000:1.0:1783441322.094615:0:3302:0:(import.c:956:ptlrpc_connect_set_flags()) MGC192.168.201.113@tcp: Resetting ns_connect_flags to server flags: 0xa000011001002060 10000000:01000000:1.0:1783441322.094621:0:3302:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808005 00000100:00080000:1.0:1783441322.094625:0:3302:0:(import.c:65:import_set_state_nolock()) 000000007647330e MGS: changing import state from CONNECTING to FULL 10000000:01000000:1.0:1783441322.094628:0:3302:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808004 00000100:00080000:1.0:1783441322.094644:0:3302:0:(pinger.c:186:ptlrpc_pinger_ir_up()) IR up 00000100:00100000:1.0:1783441322.094650:0:3302:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@000000000eff6eb5 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:6c1ddb50-5795-40c6-a2b6-8f58add9da62:3302:1870073693208704:0@lo:250: 00000100:00100000:2.0:1783441322.102639:0:5765:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt: allocate 64 new 262144-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1783441322.102858:0:5765:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 0 min 3 max 116 00000100:00100000:2.0:1783441322.102865:0:5765:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt00_000' 00000100:00100000:0.0:1783441322.109547:0:5765:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 1 min 3 max 116 00000100:00100000:1.0:1783441322.111339:0:5765:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt00_001' 00000100:00100000:3.0:1783441322.111894:0:5765:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 2 min 3 max 116 00000100:00100000:3.0:1783441322.111903:0:5765:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt00_002' 00000100:00100000:3.0:1783441322.112489:0:5765:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_readpage: allocate 64 new 8192-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1783441322.112646:0:5765:0:(service.c:3462:ptlrpc_start_thread()) mdt_readpage[0] started 0 min 2 max 80 00000100:00100000:3.0:1783441322.112651:0:5765:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_rdpg00_000' 00000100:00100000:3.0:1783441322.116431:0:5765:0:(service.c:3462:ptlrpc_start_thread()) mdt_readpage[0] started 1 min 2 max 80 00000100:00100000:3.0:1783441322.116493:0:5765:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_rdpg00_001' 00000100:00100000:1.0:1783441322.173522:0:5765:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_out: allocate 64 new 1048576-byte reqbufs (0/64 left), rc = 0 00000100:00100000:1.0:1783441322.173768:0:5765:0:(service.c:3462:ptlrpc_start_thread()) mdt_out[0] started 0 min 2 max 116 00000100:00100000:1.0:1783441322.173776:0:5765:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_out00_000' 00000100:00100000:1.0:1783441322.185727:0:5765:0:(service.c:3462:ptlrpc_start_thread()) mdt_out[0] started 1 min 2 max 116 00000100:00100000:1.0:1783441322.185788:0:5765:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_out00_001' 00000100:00100000:0.0:1783441322.200125:0:5765:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_seqs: allocate 64 new 4096-byte reqbufs (0/64 left), rc = 0 00000100:00100000:0.0:1783441322.200323:0:5765:0:(service.c:3462:ptlrpc_start_thread()) mdt_seqs[-1] started 0 min 2 max 256 00000100:00100000:0.0:1783441322.200338:0:5765:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_seqs_0000' 00000100:00100000:3.0:1783441322.201798:0:5765:0:(service.c:3462:ptlrpc_start_thread()) mdt_seqs[-1] started 1 min 2 max 256 00000100:00100000:3.0:1783441322.201809:0:5765:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_seqs_0001' 00000100:00100000:0.0:1783441322.202517:0:5765:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_seqm: allocate 64 new 4096-byte reqbufs (0/64 left), rc = 0 00000100:00100000:0.0:1783441322.202673:0:5765:0:(service.c:3462:ptlrpc_start_thread()) mdt_seqm[-1] started 0 min 2 max 256 00000100:00100000:0.0:1783441322.202684:0:5765:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_seqm_0000' 00000100:00100000:3.0:1783441322.206620:0:5765:0:(service.c:3462:ptlrpc_start_thread()) mdt_seqm[-1] started 1 min 2 max 256 00000100:00100000:3.0:1783441322.206638:0:5765:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_seqm_0001' 00000100:00100000:3.0:1783441322.207395:0:5765:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_fld: allocate 64 new 4096-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1783441322.207573:0:5765:0:(service.c:3462:ptlrpc_start_thread()) mdt_fld[-1] started 0 min 2 max 256 00000100:00100000:3.0:1783441322.207578:0:5765:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_fld_0000' 00000100:00100000:3.0:1783441322.208484:0:5765:0:(service.c:3462:ptlrpc_start_thread()) mdt_fld[-1] started 1 min 2 max 256 00000100:00100000:3.0:1783441322.208493:0:5765:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_fld_0001' 00000100:00100000:2.0:1783441322.278250:0:5765:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_io: allocate 64 new 524288-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1783441322.278453:0:5765:0:(service.c:3462:ptlrpc_start_thread()) mdt_io[0] started 0 min 3 max 116 00000100:00100000:2.0:1783441322.278466:0:5765:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_io00_000' 00000100:00100000:3.0:1783441322.293039:0:5765:0:(service.c:3462:ptlrpc_start_thread()) mdt_io[0] started 1 min 3 max 116 00000100:00100000:3.0:1783441322.293064:0:5765:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_io00_001' 00000100:00100000:3.0:1783441322.295098:0:5765:0:(service.c:3462:ptlrpc_start_thread()) mdt_io[0] started 2 min 3 max 116 00000100:00100000:3.0:1783441322.295134:0:5765:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_io00_002' 00000020:00000080:2.0:1783441322.301588:0:5765:0:(obd_config.c:826:class_setup()) finished setup of obd MDS (uuid MDS_uuid) 00000020:01000004:2.0:1783441322.301621:0:5765:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for lustre-mdt1/mdt1 10000000:01000000:2.0:1783441322.301627:0:5765:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.201.113@tcp: cl_mgc_mutex lustre-MDT0000-osd for locked: rc = 0 00000040:01000000:2.0:1783441322.301824:0:5765:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.201.113@tcp ctxt 0 is initialized 00000020:01000004:2.0:1783441322.301860:0:5765:0:(tgt_mount.c:1418:server_register_target()) Registration lustre-MDT0000, fs=lustre, 192.168.201.113@tcp, index=0000, flags=0x20065 00000020:01000004:2.0:1783441322.301864:0:5765:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:2.0:1783441322.301867:0:5765:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:2.0:1783441322.301868:0:5765:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1783441322.301869:0:5765:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1783441322.301871:0:5765:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1783441322.301872:0:5765:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1783441322.301873:0:5765:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:2.0:1783441322.301875:0:5765:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:2.0:1783441322.301876:0:5765:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:2.0:1783441322.301877:0:5765:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:2.0:1783441322.301879:0:5765:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1783441322.301880:0:5765:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:2.0:1783441322.301882:0:5765:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-MDT0000 0x10020065 00000020:01000004:2.0:1783441322.301885:0:5765:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:2.0:1783441322.301886:0:5765:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:2.0:1783441322.301887:0:5765:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1783441322.301888:0:5765:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1783441322.301889:0:5765:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1783441322.301890:0:5765:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1783441322.301890:0:5765:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:2.0:1783441322.301891:0:5765:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:2.0:1783441322.301892:0:5765:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:2.0:1783441322.301893:0:5765:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:2.0:1783441322.301894:0:5765:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1783441322.301895:0:5765:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:2.0:1783441322.301921:0:5765:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-MDT0000 00000100:00100000:2.0:1783441322.301939:0:5765:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@00000000313bf145 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6c1ddb50-5795-40c6-a2b6-8f58add9da62:5765:1870073693208832:0@lo:253: 00000100:00100000:2.0:1783441322.302029:0:5765:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783441322.302083:0:5765:0:(client.c:2702:ptlrpc_set_wait()) set 0000000073b2d964 going to sleep for 11 seconds 00000100:00100000:3.0:1783441322.302694:0:5780:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073693208832 00000100:00100000:3.0:1783441322.302703:0:5780:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073693208832 00000100:00100000:3.0:1783441322.302784:0:5780:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1783441322.302792:0:5780:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000ef251e3c pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6c1ddb50-5795-40c6-a2b6-8f58add9da62+5:5765:x1870073693208832:12345-0@lo:253: 20000000:01000000:3.0:1783441322.302844:0:5780:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 20000000:01000000:3.0:1783441322.302847:0:5780:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 0 is registered to MGS. 10000000:01000000:3.0:1783441322.303265:0:5801:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 20000000:01000000:2.0:1783441322.303344:0:5780:0:(mgs_nids.c:666:mgs_nidtbl_init_fs()) IR: current version is 2 00000040:00080000:2.0:1783441322.303706:0:5780:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1783441322.309296:0:5802:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 64768 count 1 20000000:01000000:2.0:1783441322.309669:0:5780:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 20000000:01000000:2.0:1783441322.309675:0:5780:0:(mgs_handler.c:599:mgs_target_reg()) updating lustre-MDT0000, index=0 20000000:01000000:2.0:1783441322.309681:0:5780:0:(mgs_llog.c:869:mgs_set_index()) Set index for lustre-MDT0000 to 0 20000000:01000000:2.0:1783441322.309684:0:5780:0:(mgs_llog.c:3608:mgs_write_log_mdt()) writing new mdt lustre-MDT0000 20000000:01000000:2.0:1783441322.309714:0:5780:0:(mgs_llog.c:3168:mgs_write_log_lov()) Writing lov(lustre-MDT0000-mdtlov) log for lustre-MDT0000 00000040:00080000:2.0:1783441322.309992:0:5780:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1783441322.310246:0:5780:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].1, 224 off8416 20000000:01000000:2.0:1783441322.310261:0:5780:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0000-mdtlov 0xcf001 lov lustre-MDT0000-mdtlov_UUID (null) (null) 00000040:00080000:2.0:1783441322.310315:0:5780:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].2, 136 off8552 00000040:00080000:2.0:1783441322.310365:0:5780:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].3, 176 off8728 00000040:00080000:2.0:1783441322.310405:0:5780:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].4, 224 off8952 00000040:00080000:2.0:1783441322.310498:0:5780:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].5, 224 off9176 20000000:01000000:2.0:1783441322.310506:0:5780:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0000 0xcf001 mdt lustre-MDT0000_UUID (null) (null) 00000040:00080000:2.0:1783441322.310565:0:5780:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].6, 120 off9296 20000000:01000000:2.0:1783441322.310574:0:5780:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf007 lustre-MDT0000 lustre-MDT0000-mdtlov (null) (null) 00000040:00080000:2.0:1783441322.310609:0:5780:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].7, 112 off9408 20000000:01000000:2.0:1783441322.310616:0:5780:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0000 0xcf003 lustre-MDT0000_UUID 0 lustre-MDT0000-mdtlov f 00000040:00080000:2.0:1783441322.310649:0:5780:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].8, 160 off9568 00000040:00080000:2.0:1783441322.310715:0:5780:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].9, 224 off9792 00000040:00080000:2.0:1783441322.310776:0:5780:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 20000000:01000000:2.0:1783441322.310782:0:5780:0:(mgs_llog.c:3168:mgs_write_log_lov()) Writing lov(lustre-clilov) log for lustre-client 00000040:00080000:2.0:1783441322.310798:0:5780:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1783441322.310997:0:5780:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].1, 224 off8416 20000000:01000000:2.0:1783441322.311007:0:5780:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-clilov 0xcf001 lov lustre-clilov_UUID (null) (null) 00000040:00080000:2.0:1783441322.311041:0:5780:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].2, 120 off8536 00000040:00080000:2.0:1783441322.311075:0:5780:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].3, 168 off8704 00000040:00080000:2.0:1783441322.311119:0:5780:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].4, 224 off8928 20000000:01000000:2.0:1783441322.311131:0:5780:0:(mgs_llog.c:3125:mgs_write_log_lmv()) Writing lmv(lustre-clilmv) log for lustre-client 00000040:00080000:2.0:1783441322.311223:0:5780:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].5, 224 off9152 20000000:01000000:2.0:1783441322.311232:0:5780:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-clilmv 0xcf001 lmv lustre-clilmv_UUID (null) (null) 00000040:00080000:2.0:1783441322.311278:0:5780:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].6, 120 off9272 00000040:00080000:2.0:1783441322.311314:0:5780:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].7, 168 off9440 00000040:00080000:2.0:1783441322.311345:0:5780:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].8, 224 off9664 20000000:01000000:2.0:1783441322.311355:0:5780:0:(mgs_llog.c:3090:mgs_write_log_mount_opt()) Writing mount options log for lustre-client 00000040:00080000:2.0:1783441322.311452:0:5780:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].9, 224 off9888 20000000:01000000:2.0:1783441322.311462:0:5780:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf007 lustre-client lustre-clilov lustre-clilmv (null) 00000040:00080000:2.0:1783441322.311508:0:5780:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].10, 120 off10008 00000040:00080000:2.0:1783441322.311544:0:5780:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].11, 224 off10232 00000040:00080000:2.0:1783441322.311708:0:5780:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 12 count 12 20000000:01000000:2.0:1783441322.311793:0:5780:0:(mgs_llog.c:3305:mgs_write_log_mdc_to_lmv()) adding mdc for lustre-MDT0000 to log lustre-client:lmv(lustre-clilmv) 20000000:01000000:2.0:1783441322.311801:0:5780:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-client/lustre-MDT0000/add mdc fl=4 00000040:00080000:2.0:1783441322.316292:0:5803:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 12 count 12 00000040:00080000:1.0:1783441322.320900:0:5780:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].12, 224 off10456 20000000:01000000:1.0:1783441322.320945:0:5780:0:(mgs_llog.c:3351:mgs_write_log_mdc_to_lmv()) add nid 192.168.201.113@tcp for mdt 20000000:01000000:1.0:1783441322.320948:0:5780:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf005 192.168.201.113@tcp (null) (null) (null) 00000040:00080000:1.0:1783441322.321011:0:5780:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].13, 88 off10544 20000000:01000000:1.0:1783441322.321020:0:5780:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0000-mdc 0xcf001 mdc lustre-clilmv_UUID (null) (null) 00000040:00080000:1.0:1783441322.321052:0:5780:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].14, 128 off10672 20000000:01000000:1.0:1783441322.321060:0:5780:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0000-mdc 0xcf003 lustre-MDT0000_UUID 192.168.201.113@tcp (null) (null) 00000040:00080000:1.0:1783441322.321118:0:5780:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].15, 144 off10816 20000000:01000000:1.0:1783441322.321130:0:5780:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-clilmv 0xcf014 lustre-MDT0000_UUID 0 1 lustre-MDT0000-mdc_UUID 00000040:00080000:1.0:1783441322.321165:0:5780:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].16, 160 off10976 00000040:00080000:1.0:1783441322.321221:0:5780:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].17, 224 off11200 20000000:01000000:1.0:1783441322.321335:0:5780:0:(mgs_llog.c:5248:mgs_write_log_target()) remaining string: ' sys.timeout=20 ', param: 'mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity' 20000000:01000000:1.0:1783441322.321339:0:5780:0:(mgs_llog.c:4744:mgs_write_log_param()) next param 'mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity' 20000000:01000000:1.0:1783441322.321345:0:5780:0:(mgs_llog.c:5068:mgs_write_log_param()) mdt param identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity 20000000:01000000:1.0:1783441322.321364:0:5780:0:(mgs_llog.c:1379:mgs_modify_param()) modify lustre-MDT0000/lustre-MDT0000/mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity del=0 00000040:00080000:2.0:1783441322.325599:0:5804:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 10 count 10 20000000:02000000:1.0:1783441322.327198:0:5780:0:(mgs_llog.c:4116:mgs_wlp_lcfg()) Setting parameter lustre-MDT0000.mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity in log lustre-MDT0000 00000040:00080000:1.0:1783441322.338573:0:5780:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].10, 224 off10016 00000040:00080000:1.0:1783441322.338625:0:5780:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].11, 160 off10176 00000040:00080000:1.0:1783441322.338699:0:5780:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].12, 224 off10400 20000000:01000000:1.0:1783441322.338718:0:5780:0:(mgs_llog.c:5248:mgs_write_log_target()) remaining string: ' ', param: 'sys.timeout=20' 20000000:01000000:1.0:1783441322.338721:0:5780:0:(mgs_llog.c:4744:mgs_write_log_param()) next param 'sys.timeout=20' 20000000:01000000:1.0:1783441322.338724:0:5780:0:(mgs_llog.c:4177:mgs_write_log_sys()) global 'sys.timeout=20' val=20 20000000:01000000:1.0:1783441322.338738:0:5780:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping . 20000000:01000000:1.0:1783441322.339981:0:5780:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping .. 20000000:01000000:1.0:1783441322.340033:0:5780:0:(mgs_llog.c:2546:mgs_write_log_direct_all()) Changing log lustre-client 20000000:01000000:1.0:1783441322.340036:0:5780:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-client/lustre/sys.timeout fl=4 00000040:00080000:1.0:1783441322.342033:0:5805:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 18 count 18 00000040:00080000:3.0:1783441322.343171:0:5780:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].18, 224 off11424 00000040:00080000:3.0:1783441322.343240:0:5780:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].19, 80 off11504 00000040:00080000:3.0:1783441322.343278:0:5780:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].20, 224 off11728 20000000:01000000:3.0:1783441322.343295:0:5780:0:(mgs_llog.c:2546:mgs_write_log_direct_all()) Changing log lustre-MDT0000 20000000:01000000:3.0:1783441322.343298:0:5780:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-MDT0000/lustre/sys.timeout fl=4 00000040:00080000:1.0:1783441322.344117:0:5806:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 13 count 13 00000040:00080000:0.0:1783441322.344434:0:5780:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].13, 224 off10624 00000040:00080000:0.0:1783441322.344485:0:5780:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].14, 80 off10704 00000040:00080000:0.0:1783441322.344555:0:5780:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].15, 224 off10928 00000020:00000080:0.0:1783441322.344573:0:5780:0:(obd_config.c:1470:class_process_config()) processing cmd: cf009 00000020:00000080:0.0:1783441322.344576:0:5780:0:(obd_config.c:1535:class_process_config()) changing lustre timeout from 100 to 20 10000000:01000000:0.0:1783441322.344583:0:5780:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x0 (lustre) 00010000:00010000:0.0:1783441322.344602:0:5780:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: 00000000e88f97f6/0xa2426164df2c746b lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 5780 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783441322.344619:0:5780:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000e88f97f6/0xa2426164df2c746b lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 5780 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783441322.344628:0:5780:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: 00000000e88f97f6/0xa2426164df2c746b lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 5780 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783441322.344634:0:5780:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: 00000000e88f97f6/0xa2426164df2c746b lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5780 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783441322.344640:0:5780:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: 00000000e88f97f6/0xa2426164df2c746b lrc: 3/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5780 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783441322.344645:0:5780:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: 00000000e88f97f6/0xa2426164df2c746b lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5780 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783441322.344650:0:5780:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 00000000e88f97f6 already unused, calling callback (000000003281bd88) 00010000:00010000:0.0:1783441322.344654:0:5780:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: 00000000e88f97f6/0xa2426164df2c746b lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5780 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783441322.344662:0:5780:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: 00000000e88f97f6/0xa2426164df2c746b lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 5780 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783441322.344674:0:5780:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: 00000000e88f97f6/0xa2426164df2c746b lrc: 3/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5780 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783441322.344688:0:5780:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: 00000000e88f97f6/0xa2426164df2c746b lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5780 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783441322.344694:0:5780:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 00000000e88f97f6/0xa2426164df2c746b lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5780 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:0.0:1783441322.344709:0:5780:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-MDT0000, index=0, rc=0 00000100:00100000:3.0:1783441322.765021:0:5780:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000ef251e3c pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6c1ddb50-5795-40c6-a2b6-8f58add9da62+5:5765:x1870073693208832:12345-0@lo:253: Request processed in 462223us (462985us total) trans 0 rc 0/0 00000100:00100000:3.0:1783441322.765048:0:5780:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1783441322.765349:0:5765:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@00000000313bf145 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6c1ddb50-5795-40c6-a2b6-8f58add9da62:5765:1870073693208832:0@lo:253: 10000000:01000000:2.0:1783441322.765366:0:5765:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-MDT0000 got index = 0 00000020:01000004:2.0:1783441322.765371:0:5765:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:2.0:1783441322.765373:0:5765:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:2.0:1783441322.765375:0:5765:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1783441322.765376:0:5765:0:(tgt_mount.c:1178:server_mti_print()) uuid: lustre-MDT0000_UUID 00000020:01000004:2.0:1783441322.765377:0:5765:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1783441322.765379:0:5765:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1783441322.765380:0:5765:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:2.0:1783441322.765382:0:5765:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:2.0:1783441322.765383:0:5765:0:(tgt_mount.c:1196:server_mti_print()) LDD_F_REWRITE_LDD 00000020:01000004:2.0:1783441322.765385:0:5765:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1783441322.765387:0:5765:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:3.0:1783441322.765475:0:5765:0:(tgt_mount.c:101:server_register_mount()) register mount 000000009056e030 from lustre-MDT0000 10000000:01000000:3.0:1783441322.765501:0:5765:0:(mgc_request.c:1943:mgc_process_config()) parse_log lustre-MDT0000 from 0 10000000:01000000:3.0:1783441322.765511:0:5765:0:(mgc_request.c:329:config_log_add()) add config log lustre-MDT0000-0000000000000000 10000000:01000000:3.0:1783441322.765515:0:5765:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-sptlrpc-ffff91a84767cd40 10000000:01000000:3.0:1783441322.765520:0:5765:0:(mgc_request.c:68:mgc_name2resid()) log lustre-sptlrpc to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:3.0:1783441322.765528:0:5765:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-sptlrpc-ffff91a84767cd40 from 1 10000000:01000000:3.0:1783441322.765531:0:5765:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:3.0:1783441322.765581:0:5765:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.113@tcp lock: 000000008550020f/0xa2426164df2c7472 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5765 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783441322.765592:0:5765:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.113@tcp lock: 000000008550020f/0xa2426164df2c7472 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5765 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783441322.765600:0:5765:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.113@tcp lock: 000000008550020f/0xa2426164df2c7472 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5765 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783441322.765618:0:5765:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@00000000c952da28 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6c1ddb50-5795-40c6-a2b6-8f58add9da62:5765:1870073693208960:0@lo:101: 00000100:00100000:3.0:1783441322.765665:0:5765:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783441322.765785:0:5765:0:(client.c:2702:ptlrpc_set_wait()) set 00000000fb7c80eb going to sleep for 11 seconds 00000100:00100000:2.0:1783441322.765925:0:5779:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073693208960 00000100:00100000:2.0:1783441322.765933:0:5779:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073693208960 00000100:00100000:2.0:1783441322.765981:0:5779:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1783441322.765989:0:5779:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000bdeb15c1 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6c1ddb50-5795-40c6-a2b6-8f58add9da62+5:5765:x1870073693208960:12345-0@lo:101: 00010000:00010000:2.0:1783441322.766003:0:5779:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1783441322.766017:0:5779:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 000000000f13d6dc/0xa2426164df2c7479 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xa2426164df2c7472 expref: -99 pid: 5779 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783441322.766052:0:5779:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 000000000f13d6dc/0xa2426164df2c7479 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xa2426164df2c7472 expref: 6 pid: 5779 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783441322.766062:0:5779:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 000000000f13d6dc/0xa2426164df2c7479 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xa2426164df2c7472 expref: 6 pid: 5779 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783441322.766082:0:5779:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 000000000f13d6dc, rc 0) 00000100:00100000:2.0:1783441322.766293:0:5779:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000bdeb15c1 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6c1ddb50-5795-40c6-a2b6-8f58add9da62+6:5765:x1870073693208960:12345-0@lo:101: Request processed in 305us (628us total) trans 0 rc 0/0 00000100:00100000:2.0:1783441322.766300:0:5779:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1783441322.766375:0:5765:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@00000000c952da28 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6c1ddb50-5795-40c6-a2b6-8f58add9da62:5765:1870073693208960:0@lo:101: 00010000:00010000:3.0:1783441322.766388:0:5765:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.113@tcp lock: 000000008550020f/0xa2426164df2c7472 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xa2426164df2c7479 expref: -99 pid: 5765 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783441322.766396:0:5765:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.113@tcp lock: 000000008550020f/0xa2426164df2c7472 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xa2426164df2c7479 expref: -99 pid: 5765 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783441322.766450:0:5765:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@00000000c952da28 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6c1ddb50-5795-40c6-a2b6-8f58add9da62:5765:1870073693209088:0@lo:501: 00000100:00100000:3.0:1783441322.766477:0:5765:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783441322.766502:0:5765:0:(client.c:2702:ptlrpc_set_wait()) set 00000000fb7c80eb going to sleep for 11 seconds 00000100:00100000:2.0:1783441322.766554:0:5780:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073693209088 00000100:00100000:2.0:1783441322.766558:0:5780:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073693209088 00000100:00100000:2.0:1783441322.766589:0:5780:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1783441322.766595:0:5780:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000f38c9673 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6c1ddb50-5795-40c6-a2b6-8f58add9da62+6:5765:x1870073693209088:12345-0@lo:501: 00000100:00100000:3.0:1783441322.767082:0:5780:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000f38c9673 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6c1ddb50-5795-40c6-a2b6-8f58add9da62+6:5765:x1870073693209088:12345-0@lo:501: Request processed in 486us (603us total) trans 0 rc -2/-2 00000100:00100000:3.0:1783441322.767112:0:5780:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1783441322.767326:0:5765:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@00000000c952da28 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6c1ddb50-5795-40c6-a2b6-8f58add9da62:5765:1870073693209088:0@lo:501: 10000000:01000000:0.0:1783441322.767368:0:5765:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.201.113@tcp: configuration from log 'lustre-sptlrpc' failed (-2). 00010000:00010000:0.0:1783441322.767388:0:5765:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.113@tcp lock: 000000008550020f/0xa2426164df2c7472 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xa2426164df2c7479 expref: -99 pid: 5765 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783441322.767397:0:5765:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.113@tcp lock: 000000008550020f/0xa2426164df2c7472 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xa2426164df2c7479 expref: -99 pid: 5765 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1783441322.767404:0:5765:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff91a84869e800 10000000:01000000:0.0:1783441322.767409:0:5765:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:0.0:1783441322.767413:0:5765:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-barrier-ffff91a84869e800 10000000:01000000:0.0:1783441322.767416:0:5765:0:(mgc_request.c:68:mgc_name2resid()) log lustre-barrier to resid 0x65727473756c/0x5 (lustre) 10000000:01000000:0.0:1783441322.767418:0:5765:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-barrier-ffff91a84869e800 from 1 10000000:01000000:0.0:1783441322.767421:0:5765:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-barrier (res 0x65727473756c) 00010000:00010000:0.0:1783441322.767463:0:5765:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.113@tcp lock: 00000000e88f97f6/0xa2426164df2c7480 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5765 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783441322.767471:0:5765:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.113@tcp lock: 00000000e88f97f6/0xa2426164df2c7480 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5765 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783441322.767479:0:5765:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.113@tcp lock: 00000000e88f97f6/0xa2426164df2c7480 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5765 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783441322.767501:0:5765:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@0000000058e6f65b pname:cluuid:pid:xid:nid:opc:job mount.lustre:6c1ddb50-5795-40c6-a2b6-8f58add9da62:5765:1870073693209216:0@lo:101: 00000100:00100000:0.0:1783441322.767533:0:5765:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783441322.767564:0:5765:0:(client.c:2702:ptlrpc_set_wait()) set 0000000066e2067a going to sleep for 11 seconds 00000100:00100000:3.0:1783441322.769693:0:5779:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073693209216 00000100:00100000:3.0:1783441322.769708:0:5779:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073693209216 00000100:00100000:3.0:1783441322.769815:0:5779:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:3.0:1783441322.769825:0:5779:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000c1064659 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6c1ddb50-5795-40c6-a2b6-8f58add9da62+6:5765:x1870073693209216:12345-0@lo:101: 00010000:00010000:3.0:1783441322.769841:0:5779:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1783441322.769862:0:5779:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 00000000c0afc6c2/0xa2426164df2c7487 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xa2426164df2c7480 expref: -99 pid: 5779 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783441322.769886:0:5779:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000c0afc6c2/0xa2426164df2c7487 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xa2426164df2c7480 expref: 7 pid: 5779 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783441322.769896:0:5779:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 00000000c0afc6c2/0xa2426164df2c7487 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xa2426164df2c7480 expref: 7 pid: 5779 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783441322.769905:0:5779:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 00000000c0afc6c2, rc 0) 00000100:00100000:3.0:1783441322.769966:0:5779:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000c1064659 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6c1ddb50-5795-40c6-a2b6-8f58add9da62+7:5765:x1870073693209216:12345-0@lo:101: Request processed in 143us (2433us total) trans 0 rc 0/0 00000100:00100000:3.0:1783441322.769972:0:5779:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:0.0:1783441322.770133:0:5765:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@0000000058e6f65b pname:cluuid:pid:xid:nid:opc:job mount.lustre:6c1ddb50-5795-40c6-a2b6-8f58add9da62:5765:1870073693209216:0@lo:101: 00010000:00010000:0.0:1783441322.770153:0:5765:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.113@tcp lock: 00000000e88f97f6/0xa2426164df2c7480 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xa2426164df2c7487 expref: -99 pid: 5765 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783441322.770161:0:5765:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.113@tcp lock: 00000000e88f97f6/0xa2426164df2c7480 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xa2426164df2c7487 expref: -99 pid: 5765 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1783441322.770195:0:5765:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.201.113@tcp: configuration from log 'lustre-barrier' succeeded (0). 00010000:00010000:0.0:1783441322.770210:0:5765:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.113@tcp lock: 00000000e88f97f6/0xa2426164df2c7480 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xa2426164df2c7487 expref: -99 pid: 5765 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783441322.770218:0:5765:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.113@tcp lock: 00000000e88f97f6/0xa2426164df2c7480 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xa2426164df2c7487 expref: -99 pid: 5765 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1783441322.770226:0:5765:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-MDT0000-0000000000000000 10000000:01000000:0.0:1783441322.770231:0:5765:0:(mgc_request.c:68:mgc_name2resid()) log lustre-MDT0000 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:0.0:1783441322.770236:0:5765:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-mdtir-ffff91a84869e800 10000000:01000000:0.0:1783441322.770238:0:5765:0:(mgc_request.c:68:mgc_name2resid()) log lustre-mdtir to resid 0x65727473756c/0x2 (lustre) 10000000:01000000:0.0:1783441322.770242:0:5765:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-MDT0000-0000000000000000 from 1 10000000:01000000:0.0:1783441322.770244:0:5765:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0000 (res 0x65727473756c) 00010000:00010000:0.0:1783441322.770265:0:5765:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.113@tcp lock: 00000000bc193132/0xa2426164df2c748e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5765 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783441322.770272:0:5765:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.113@tcp lock: 00000000bc193132/0xa2426164df2c748e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5765 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783441322.770297:0:5765:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.113@tcp lock: 00000000bc193132/0xa2426164df2c748e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5765 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783441322.770313:0:5765:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@0000000058e6f65b pname:cluuid:pid:xid:nid:opc:job mount.lustre:6c1ddb50-5795-40c6-a2b6-8f58add9da62:5765:1870073693209344:0@lo:101: 00000100:00100000:0.0:1783441322.770348:0:5765:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783441322.770382:0:5765:0:(client.c:2702:ptlrpc_set_wait()) set 0000000066e2067a going to sleep for 11 seconds 00000100:00100000:3.0:1783441322.770546:0:5780:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073693209344 00000100:00100000:3.0:1783441322.770552:0:5780:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073693209344 00000100:00100000:3.0:1783441322.770587:0:5780:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:3.0:1783441322.770594:0:5780:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000611bd5b1 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6c1ddb50-5795-40c6-a2b6-8f58add9da62+7:5765:x1870073693209344:12345-0@lo:101: 00010000:00010000:3.0:1783441322.770602:0:5780:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1783441322.770611:0:5780:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 00000000c5d6d16a/0xa2426164df2c7495 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xa2426164df2c748e expref: -99 pid: 5780 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783441322.770626:0:5780:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000c5d6d16a/0xa2426164df2c7495 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xa2426164df2c748e expref: 8 pid: 5780 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783441322.770643:0:5780:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 00000000c5d6d16a/0xa2426164df2c7495 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xa2426164df2c748e expref: 8 pid: 5780 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783441322.770649:0:5780:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 00000000c5d6d16a, rc 0) 00000100:00100000:3.0:1783441322.770686:0:5780:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000611bd5b1 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6c1ddb50-5795-40c6-a2b6-8f58add9da62+8:5765:x1870073693209344:12345-0@lo:101: Request processed in 93us (338us total) trans 0 rc 0/0 00000100:00100000:3.0:1783441322.770696:0:5780:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:0.0:1783441322.770862:0:5765:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@0000000058e6f65b pname:cluuid:pid:xid:nid:opc:job mount.lustre:6c1ddb50-5795-40c6-a2b6-8f58add9da62:5765:1870073693209344:0@lo:101: 00010000:00010000:0.0:1783441322.770873:0:5765:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.113@tcp lock: 00000000bc193132/0xa2426164df2c748e lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xa2426164df2c7495 expref: -99 pid: 5765 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783441322.770879:0:5765:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.113@tcp lock: 00000000bc193132/0xa2426164df2c748e lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xa2426164df2c7495 expref: -99 pid: 5765 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783441322.770930:0:5765:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@0000000058e6f65b pname:cluuid:pid:xid:nid:opc:job mount.lustre:6c1ddb50-5795-40c6-a2b6-8f58add9da62:5765:1870073693209472:0@lo:501: 00000100:00100000:0.0:1783441322.770955:0:5765:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783441322.770983:0:5765:0:(client.c:2702:ptlrpc_set_wait()) set 0000000066e2067a going to sleep for 11 seconds 00000100:00100000:1.0:1783441322.771041:0:5778:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073693209472 00000100:00100000:1.0:1783441322.771045:0:5778:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073693209472 00000100:00100000:1.0:1783441322.771098:0:5778:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:1.0:1783441322.771105:0:5778:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000001a62f5f8 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6c1ddb50-5795-40c6-a2b6-8f58add9da62+8:5765:x1870073693209472:12345-0@lo:501: 00000100:00100000:1.0:1783441322.771378:0:5778:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000001a62f5f8 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6c1ddb50-5795-40c6-a2b6-8f58add9da62+9:5765:x1870073693209472:12345-0@lo:501: Request processed in 273us (421us total) trans 0 rc 0/0 00000100:00100000:1.0:1783441322.771385:0:5778:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:0.0:1783441322.771528:0:5765:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@0000000058e6f65b pname:cluuid:pid:xid:nid:opc:job mount.lustre:6c1ddb50-5795-40c6-a2b6-8f58add9da62:5765:1870073693209472:0@lo:501: 00000100:00100000:0.0:1783441322.771561:0:5765:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@0000000058e6f65b pname:cluuid:pid:xid:nid:opc:job mount.lustre:6c1ddb50-5795-40c6-a2b6-8f58add9da62:5765:1870073693209600:0@lo:503: 00000100:00100000:0.0:1783441322.771595:0:5765:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783441322.771617:0:5765:0:(client.c:2702:ptlrpc_set_wait()) set 0000000066e2067a going to sleep for 11 seconds 00000100:00100000:2.0:1783441322.771671:0:5779:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073693209600 00000100:00100000:2.0:1783441322.771676:0:5779:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073693209600 00000100:00100000:2.0:1783441322.771707:0:5779:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:2.0:1783441322.771712:0:5779:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000ffd69784 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6c1ddb50-5795-40c6-a2b6-8f58add9da62+9:5765:x1870073693209600:12345-0@lo:503: 00000100:00100000:2.0:1783441322.771882:0:5779:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000ffd69784 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6c1ddb50-5795-40c6-a2b6-8f58add9da62+9:5765:x1870073693209600:12345-0@lo:503: Request processed in 170us (286us total) trans 0 rc 0/0 00000100:00100000:2.0:1783441322.771889:0:5779:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:0.0:1783441322.772032:0:5765:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@0000000058e6f65b pname:cluuid:pid:xid:nid:opc:job mount.lustre:6c1ddb50-5795-40c6-a2b6-8f58add9da62:5765:1870073693209600:0@lo:503: 00000100:00100000:0.0:1783441322.772500:0:5808:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@0000000058e6f65b pname:cluuid:pid:xid:nid:opc:job llog_process_th:6c1ddb50-5795-40c6-a2b6-8f58add9da62:5808:1870073693209728:0@lo:502: 00000100:00100000:0.0:1783441322.772545:0:5808:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783441322.772580:0:5808:0:(client.c:2702:ptlrpc_set_wait()) set 00000000f6cc39b9 going to sleep for 11 seconds 00000100:00100000:2.0:1783441322.772640:0:5779:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073693209728 00000100:00100000:2.0:1783441322.772645:0:5779:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073693209728 00000100:00100000:2.0:1783441322.772679:0:5779:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:2.0:1783441322.772686:0:5779:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000eb4f8def pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6c1ddb50-5795-40c6-a2b6-8f58add9da62+9:5808:x1870073693209728:12345-0@lo:502: 00000100:00100000:2.0:1783441322.772880:0:5779:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000eb4f8def pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6c1ddb50-5795-40c6-a2b6-8f58add9da62+9:5808:x1870073693209728:12345-0@lo:502: Request processed in 195us (335us total) trans 0 rc 0/0 00000100:00100000:2.0:1783441322.772887:0:5779:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:0.0:1783441322.773009:0:5808:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@0000000058e6f65b pname:cluuid:pid:xid:nid:opc:job llog_process_th:6c1ddb50-5795-40c6-a2b6-8f58add9da62:5808:1870073693209728:0@lo:502: 00000020:01000000:0.0:1783441322.773039:0:5808:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1783441322.773053:0:5808:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1783441322.773055:0:5808:0:(obd_config.c:1561:class_process_config()) marker 2 (0x1) lustre-MDT0000-m lov setup 00000020:01000000:0.0:1783441322.773061:0:5808:0:(obd_config.c:1967:class_config_llog_handler()) For 2.x interoperability, rename obd type from lov to lod (lustre-MDT0000) 00000020:00000080:0.0:1783441322.773064:0:5808:0:(obd_config.c:1470:class_process_config()) processing cmd: cf001 00000020:00000080:0.0:1783441322.773082:0:5808:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-mdtlov (000000005c25defb) 00000020:00000080:0.0:1783441322.773183:0:5808:0:(obd_config.c:720:class_attach_name()) OBD: dev 4 attached type lod with refcount 2 00000020:00000080:0.0:1783441322.773192:0:5808:0:(obd_config.c:1470:class_process_config()) processing cmd: cf003 00080000:01000000:0.0:1783441322.773304:0:5808:0:(osd_handler.c:1569:osd_obd_connect()) connect #2 00000020:00000080:0.0:1783441322.773313:0:5808:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0xa2426164df2c74a3 00000020:00000080:0.0:1783441322.773542:0:5808:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-mdtlov (uuid lustre-MDT0000-mdtlov_UUID) 00000020:01000000:0.0:1783441322.773547:0:5808:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1783441322.773550:0:5808:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1783441322.773552:0:5808:0:(obd_config.c:1561:class_process_config()) marker 2 (0x2) lustre-MDT0000-m lov setup 00000020:01000000:0.0:1783441322.773554:0:5808:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1783441322.773557:0:5808:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1783441322.773558:0:5808:0:(obd_config.c:1561:class_process_config()) marker 3 (0x1) lustre-MDT0000 add mdt 00000020:00000080:0.0:1783441322.773561:0:5808:0:(obd_config.c:1470:class_process_config()) processing cmd: cf001 00000020:00000080:0.0:1783441322.773566:0:5808:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000 (000000007d09270f) 00000020:00000080:0.0:1783441322.773574:0:5808:0:(obd_config.c:720:class_attach_name()) OBD: dev 5 attached type mdt with refcount 2 00000020:00000080:0.0:1783441322.773577:0:5808:0:(obd_config.c:1470:class_process_config()) processing cmd: cf007 00000020:00000080:0.0:1783441322.773578:0:5808:0:(obd_config.c:1514:class_process_config()) mountopt: profile lustre-MDT0000 osc lustre-MDT0000-mdtlov mdc (null) 00000020:01000000:0.0:1783441322.773581:0:5808:0:(obd_config.c:1148:class_add_profile()) Add profile lustre-MDT0000 00000020:00000080:0.0:1783441322.773587:0:5808:0:(obd_config.c:1470:class_process_config()) processing cmd: cf003 00000020:01000004:0.0:1783441322.773637:0:5808:0:(tgt_mount.c:153:server_get_mount()) get mount 000000009056e030 from lustre-MDT0000, refs=3 00000020:00000080:0.0:1783441322.773647:0:5808:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDD0000 (000000009d59d96b) 00000020:00000080:0.0:1783441322.773653:0:5808:0:(obd_config.c:720:class_attach_name()) OBD: dev 6 attached type mdd with refcount 2 00000004:01000000:0.0:1783441322.773701:0:5808:0:(lod_dev.c:2291:lod_obd_connect()) connect #0 00000020:00000080:0.0:1783441322.773706:0:5808:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0xa2426164df2c74b8 00000020:00000080:0.0:1783441322.776435:0:5808:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDD0000 (uuid lustre-MDD0000_UUID) 00000004:01000000:0.0:1783441322.776449:0:5808:0:(mdd_device.c:1596:mdd_obd_connect()) connect #0 00000020:00000080:0.0:1783441322.776461:0:5808:0:(genops.c:1406:class_connect()) connect: client lustre-MDD0000_UUID, cookie 0xa2426164df2c74bf 00080000:01000000:0.0:1783441322.776472:0:5808:0:(osd_handler.c:1569:osd_obd_connect()) connect #3 00000020:00000080:0.0:1783441322.776491:0:5808:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0xa2426164df2c74c6 00080000:10000000:0.0:1783441322.776954:0:5808:0:(osd_index.c:2102:osd_index_try()) lustre-MDT0000: index object [0x200000001:0x3:0x0] (8/8/3) registered 40000000:02000000:0.0:1783441322.777264:0:5808:0:(fid_handler.c:560:seq_server_init()) ctl-lustre-MDT0000: No data found on store. Initialize space. 40000000:02000000:1.0:1783441322.791822:0:5808:0:(fid_handler.c:560:seq_server_init()) srv-lustre-MDT0000: No data found on store. Initialize space. 00010000:00010000:2.0:1783441322.887696:0:5808:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-mdt-lustre-MDT0000_UUID-1 is initialized 00000001:02000400:2.0:1783441322.888227:0:5808:0:(tgt_lastrcvd.c:1878:tgt_server_data_init()) lustre-MDT0000: new disk, initializing 00000001:00000004:2.0:1783441322.891853:0:5808:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 1, last_transno is 0 00000001:00080000:2.0:1783441322.892281:0:5808:0:(tgt_lastrcvd.c:240:tgt_reply_header_write()) lustre-MDT0000: write reply_data header. magic=0xbdabda01 header_size=32 reply_size=32 00000020:00000080:3.0:1783441322.942396:0:5808:0:(genops.c:413:class_newdev()) Allocate new device lustre-QMT0000 (00000000086154b9) 00000020:00000080:3.0:1783441322.942422:0:5808:0:(obd_config.c:720:class_attach_name()) OBD: dev 7 attached type qmt with refcount 2 00080000:01000000:3.0:1783441322.942506:0:5808:0:(osd_handler.c:1569:osd_obd_connect()) connect #4 00000020:00000080:3.0:1783441322.942515:0:5808:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0xa2426164df2c74d4 00000020:00000080:3.0:1783441322.947442:0:5808:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-QMT0000 (uuid lustre-QMT0000_UUID) 00080000:10000000:3.0:1783441322.950946:0:5808:0:(osd_index.c:2102:osd_index_try()) lustre-MDT0000: index object [0x200000006:0x10000:0x0] (8/8/4) registered 00080000:10000000:3.0:1783441323.014834:0:5808:0:(osd_index.c:2102:osd_index_try()) lustre-MDT0000: index object [0x200000006:0x1010000:0x0] (8/8/4) registered 00080000:10000000:3.0:1783441323.048949:0:5808:0:(osd_index.c:2102:osd_index_try()) lustre-MDT0000: index object [0x200000006:0x2010000:0x0] (8/8/4) registered 00010000:00010000:3.0:1783441323.054926:0:5772:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00080000:10000000:3.0:1783441323.102192:0:5808:0:(osd_index.c:2102:osd_index_try()) lustre-MDT0000: index object [0x200000006:0x20000:0x0] (8/8/4) registered 00080000:10000000:2.0:1783441323.157620:0:5808:0:(osd_index.c:2102:osd_index_try()) lustre-MDT0000: index object [0x200000006:0x1020000:0x0] (8/8/4) registered 00080000:10000000:3.0:1783441323.211932:0:5808:0:(osd_index.c:2102:osd_index_try()) lustre-MDT0000: index object [0x200000006:0x2020000:0x0] (8/8/4) registered 00000020:00000080:3.0:1783441323.279693:0:5808:0:(genops.c:1406:class_connect()) connect: client lustre-QMT0000_UUID, cookie 0xa2426164df2c74db 00000020:00000080:3.0:1783441323.280432:0:5808:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000 (uuid lustre-MDT0000_UUID) 00000020:01000000:3.0:1783441323.280447:0:5808:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1783441323.280455:0:5808:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1783441323.280458:0:5808:0:(obd_config.c:1561:class_process_config()) marker 3 (0x2) lustre-MDT0000 add mdt 00000020:01000000:3.0:1783441323.280461:0:5808:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1783441323.280466:0:5808:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1783441323.280468:0:5808:0:(obd_config.c:1561:class_process_config()) marker 8 (0x1) lustre-MDT0000 mdt.identity_upcall 00000020:00000080:3.0:1783441323.280472:0:5808:0:(obd_config.c:1470:class_process_config()) processing cmd: cf00f 00000004:01000000:3.0:1783441323.280523:0:5808:0:(mdt_lproc.c:316:identity_upcall_store()) lustre-MDT0000: identity upcall set to /home/green/git/lustre-release/lustre/utils/l_getidentity 00000020:01000000:3.0:1783441323.280539:0:5808:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1783441323.280550:0:5808:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1783441323.280551:0:5808:0:(obd_config.c:1561:class_process_config()) marker 8 (0x2) lustre-MDT0000 mdt.identity_upcall 00000020:01000000:3.0:1783441323.280555:0:5808:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1783441323.280557:0:5808:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1783441323.280558:0:5808:0:(obd_config.c:1561:class_process_config()) marker 10 (0x1) lustre sys.timeout 00000020:00000080:3.0:1783441323.280561:0:5808:0:(obd_config.c:1470:class_process_config()) processing cmd: cf009 00000020:00000080:3.0:1783441323.280562:0:5808:0:(obd_config.c:1535:class_process_config()) changing lustre timeout from 20 to 20 00000100:00100000:3.0:1783441323.280607:0:5808:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@00000000bc1298e9 pname:cluuid:pid:xid:nid:opc:job llog_process_th:6c1ddb50-5795-40c6-a2b6-8f58add9da62:5808:1870073693209856:0@lo:502: 00000100:00100000:3.0:1783441323.280698:0:5808:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783441323.280973:0:5808:0:(client.c:2702:ptlrpc_set_wait()) set 0000000007417f15 going to sleep for 11 seconds 00000100:00100000:1.0:1783441323.281320:0:5778:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073693209856 00000100:00100000:1.0:1783441323.281328:0:5778:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073693209856 00000100:00100000:1.0:1783441323.281417:0:5778:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:1.0:1783441323.281426:0:5778:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000414d4a06 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6c1ddb50-5795-40c6-a2b6-8f58add9da62+9:5808:x1870073693209856:12345-0@lo:502: 00000100:00100000:1.0:1783441323.281798:0:5778:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000414d4a06 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6c1ddb50-5795-40c6-a2b6-8f58add9da62+9:5808:x1870073693209856:12345-0@lo:502: Request processed in 372us (1100us total) trans 0 rc 0/0 00000100:00100000:1.0:1783441323.281807:0:5778:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:3.0:1783441323.281901:0:5808:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@00000000bc1298e9 pname:cluuid:pid:xid:nid:opc:job llog_process_th:6c1ddb50-5795-40c6-a2b6-8f58add9da62:5808:1870073693209856:0@lo:502: 00000020:01000000:3.0:1783441323.281931:0:5808:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1783441323.281937:0:5808:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1783441323.281939:0:5808:0:(obd_config.c:1561:class_process_config()) marker 10 (0x2) lustre sys.timeout 00000040:00080000:3.0:1783441323.281942:0:5808:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 16 count 16 00000020:01000000:0.0:1783441323.282391:0:5765:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0000 gen 1-15 (rc=0) 10000000:01000000:0.0:1783441323.282413:0:5765:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.201.113@tcp: configuration from log 'lustre-MDT0000' succeeded (0). 00010000:00010000:0.0:1783441323.282438:0:5765:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.113@tcp lock: 00000000bc193132/0xa2426164df2c748e lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xa2426164df2c7495 expref: -99 pid: 5765 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783441323.282451:0:5765:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.113@tcp lock: 00000000bc193132/0xa2426164df2c748e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xa2426164df2c7495 expref: -99 pid: 5765 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1783441323.282460:0:5765:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-mdtir-ffff91a84869e800 from 1 10000000:01000000:0.0:1783441323.282462:0:5765:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:0.0:1783441323.282505:0:5765:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.113@tcp lock: 000000002d5ffa9a/0xa2426164df2c74e2 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5765 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783441323.282513:0:5765:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.113@tcp lock: 000000002d5ffa9a/0xa2426164df2c74e2 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5765 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783441323.282523:0:5765:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.113@tcp lock: 000000002d5ffa9a/0xa2426164df2c74e2 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5765 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783441323.282540:0:5765:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@0000000058e6f65b pname:cluuid:pid:xid:nid:opc:job mount.lustre:6c1ddb50-5795-40c6-a2b6-8f58add9da62:5765:1870073693209984:0@lo:101: 00000100:00100000:0.0:1783441323.282577:0:5765:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783441323.282830:0:5765:0:(client.c:2702:ptlrpc_set_wait()) set 0000000032ffd723 going to sleep for 11 seconds 00000100:00100000:2.0:1783441323.282943:0:5779:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073693209984 00000100:00100000:2.0:1783441323.282949:0:5779:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073693209984 00000100:00100000:2.0:1783441323.282992:0:5779:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:2.0:1783441323.283000:0:5779:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000d5ae588e pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6c1ddb50-5795-40c6-a2b6-8f58add9da62+9:5765:x1870073693209984:12345-0@lo:101: 00010000:00010000:2.0:1783441323.283011:0:5779:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1783441323.283024:0:5779:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 00000000ebb68469/0xa2426164df2c74e9 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xa2426164df2c74e2 expref: -99 pid: 5779 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783441323.283046:0:5779:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000ebb68469/0xa2426164df2c74e9 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xa2426164df2c74e2 expref: 10 pid: 5779 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783441323.283055:0:5779:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 00000000ebb68469/0xa2426164df2c74e9 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xa2426164df2c74e2 expref: 10 pid: 5779 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783441323.283065:0:5779:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 00000000ebb68469, rc 0) 00000100:00100000:2.0:1783441323.283113:0:5779:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000d5ae588e pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6c1ddb50-5795-40c6-a2b6-8f58add9da62+10:5765:x1870073693209984:12345-0@lo:101: Request processed in 114us (536us total) trans 0 rc 0/0 00000100:00100000:2.0:1783441323.283120:0:5779:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:0.0:1783441323.283220:0:5765:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@0000000058e6f65b pname:cluuid:pid:xid:nid:opc:job mount.lustre:6c1ddb50-5795-40c6-a2b6-8f58add9da62:5765:1870073693209984:0@lo:101: 00010000:00010000:0.0:1783441323.283233:0:5765:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.113@tcp lock: 000000002d5ffa9a/0xa2426164df2c74e2 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xa2426164df2c74e9 expref: -99 pid: 5765 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783441323.283240:0:5765:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.113@tcp lock: 000000002d5ffa9a/0xa2426164df2c74e2 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xa2426164df2c74e9 expref: -99 pid: 5765 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783441323.283822:0:5765:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@0000000058e6f65b pname:cluuid:pid:xid:nid:opc:job mount.lustre:6c1ddb50-5795-40c6-a2b6-8f58add9da62:5765:1870073693210112:0@lo:256: 00000100:00100000:0.0:1783441323.283881:0:5765:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783441323.283904:0:5765:0:(client.c:2702:ptlrpc_set_wait()) set 0000000032ffd723 going to sleep for 11 seconds 00000100:00100000:2.0:1783441323.284273:0:5779:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073693210112 00000100:00100000:2.0:1783441323.284279:0:5779:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073693210112 00000100:00100000:2.0:1783441323.284307:0:5779:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:2.0:1783441323.284313:0:5779:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000025ce0e3a pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6c1ddb50-5795-40c6-a2b6-8f58add9da62+10:5765:x1870073693210112:12345-0@lo:256: 20000000:01000000:2.0:1783441323.284328:0:5779:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 1048576. 20000000:01000000:2.0:1783441323.284334:0:5779:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 0, version 1 00000100:00100000:2.0:1783441323.284408:0:5779:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000025ce0e3a pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6c1ddb50-5795-40c6-a2b6-8f58add9da62+10:5765:x1870073693210112:12345-0@lo:256: Request processed in 95us (527us total) trans 0 rc 0/0 00000100:00100000:2.0:1783441323.284415:0:5779:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:0.0:1783441323.284623:0:5765:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@0000000058e6f65b pname:cluuid:pid:xid:nid:opc:job mount.lustre:6c1ddb50-5795-40c6-a2b6-8f58add9da62:5765:1870073693210112:0@lo:256: 10000000:01000000:0.0:1783441323.285356:0:5765:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.201.113@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:0.0:1783441323.285379:0:5765:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.113@tcp lock: 000000002d5ffa9a/0xa2426164df2c74e2 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xa2426164df2c74e9 expref: -99 pid: 5765 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783441323.285389:0:5765:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.113@tcp lock: 000000002d5ffa9a/0xa2426164df2c74e2 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xa2426164df2c74e9 expref: -99 pid: 5765 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1783441323.285396:0:5765:0:(mgc_request.c:1801:mgc_process_log()) Process log params-ffff91a84869e800 from 1 10000000:01000000:0.0:1783441323.285400:0:5765:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:0.0:1783441323.285427:0:5765:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.113@tcp lock: 00000000d7d17758/0xa2426164df2c74f0 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5765 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783441323.285434:0:5765:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.113@tcp lock: 00000000d7d17758/0xa2426164df2c74f0 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5765 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783441323.285442:0:5765:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.113@tcp lock: 00000000d7d17758/0xa2426164df2c74f0 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5765 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783441323.285458:0:5765:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@0000000058e6f65b pname:cluuid:pid:xid:nid:opc:job mount.lustre:6c1ddb50-5795-40c6-a2b6-8f58add9da62:5765:1870073693210240:0@lo:101: 00000100:00100000:0.0:1783441323.285569:0:5765:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783441323.285595:0:5765:0:(client.c:2702:ptlrpc_set_wait()) set 0000000032ffd723 going to sleep for 11 seconds 00000100:00100000:1.0:1783441323.285734:0:5778:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073693210240 00000100:00100000:1.0:1783441323.285751:0:5778:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073693210240 00000100:00100000:1.0:1783441323.285780:0:5778:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:1.0:1783441323.285786:0:5778:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000007d5f487 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6c1ddb50-5795-40c6-a2b6-8f58add9da62+10:5765:x1870073693210240:12345-0@lo:101: 00010000:00010000:1.0:1783441323.285796:0:5778:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1783441323.285810:0:5778:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 00000000f0cc14ae/0xa2426164df2c74f7 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xa2426164df2c74f0 expref: -99 pid: 5778 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783441323.285829:0:5778:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000f0cc14ae/0xa2426164df2c74f7 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xa2426164df2c74f0 expref: 11 pid: 5778 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783441323.285838:0:5778:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 00000000f0cc14ae/0xa2426164df2c74f7 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xa2426164df2c74f0 expref: 11 pid: 5778 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783441323.285845:0:5778:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 00000000f0cc14ae, rc 0) 00000100:00100000:1.0:1783441323.285873:0:5778:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000007d5f487 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6c1ddb50-5795-40c6-a2b6-8f58add9da62+11:5765:x1870073693210240:12345-0@lo:101: Request processed in 88us (305us total) trans 0 rc 0/0 00000100:00100000:1.0:1783441323.285879:0:5778:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:0.0:1783441323.286073:0:5765:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@0000000058e6f65b pname:cluuid:pid:xid:nid:opc:job mount.lustre:6c1ddb50-5795-40c6-a2b6-8f58add9da62:5765:1870073693210240:0@lo:101: 00010000:00010000:0.0:1783441323.286096:0:5765:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.113@tcp lock: 00000000d7d17758/0xa2426164df2c74f0 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xa2426164df2c74f7 expref: -99 pid: 5765 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783441323.286112:0:5765:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.113@tcp lock: 00000000d7d17758/0xa2426164df2c74f0 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xa2426164df2c74f7 expref: -99 pid: 5765 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783441323.286168:0:5765:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@0000000058e6f65b pname:cluuid:pid:xid:nid:opc:job mount.lustre:6c1ddb50-5795-40c6-a2b6-8f58add9da62:5765:1870073693210368:0@lo:501: 00000100:00100000:0.0:1783441323.286301:0:5765:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783441323.286326:0:5765:0:(client.c:2702:ptlrpc_set_wait()) set 0000000032ffd723 going to sleep for 11 seconds 00000100:00100000:1.0:1783441323.286378:0:5778:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073693210368 00000100:00100000:1.0:1783441323.286382:0:5778:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073693210368 00000100:00100000:1.0:1783441323.286412:0:5778:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:1.0:1783441323.286417:0:5778:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000d4e62d73 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6c1ddb50-5795-40c6-a2b6-8f58add9da62+11:5765:x1870073693210368:12345-0@lo:501: 00000100:00100000:1.0:1783441323.287253:0:5778:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000d4e62d73 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6c1ddb50-5795-40c6-a2b6-8f58add9da62+11:5765:x1870073693210368:12345-0@lo:501: Request processed in 833us (950us total) trans 0 rc 0/0 00000100:00100000:1.0:1783441323.287262:0:5778:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:0.0:1783441323.287466:0:5765:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@0000000058e6f65b pname:cluuid:pid:xid:nid:opc:job mount.lustre:6c1ddb50-5795-40c6-a2b6-8f58add9da62:5765:1870073693210368:0@lo:501: 00000100:00100000:0.0:1783441323.287631:0:5765:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@0000000058e6f65b pname:cluuid:pid:xid:nid:opc:job mount.lustre:6c1ddb50-5795-40c6-a2b6-8f58add9da62:5765:1870073693210496:0@lo:503: 00000100:00100000:0.0:1783441323.287679:0:5765:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783441323.287711:0:5765:0:(client.c:2702:ptlrpc_set_wait()) set 0000000032ffd723 going to sleep for 11 seconds 00000100:00100000:1.0:1783441323.287785:0:5778:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073693210496 00000100:00100000:1.0:1783441323.287791:0:5778:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073693210496 00000100:00100000:1.0:1783441323.287863:0:5778:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:1.0:1783441323.287872:0:5778:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000001edc6c86 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6c1ddb50-5795-40c6-a2b6-8f58add9da62+11:5765:x1870073693210496:12345-0@lo:503: 00000040:00080000:1.0:1783441323.287914:0:5778:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:1.0:1783441323.287950:0:5778:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000001edc6c86 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6c1ddb50-5795-40c6-a2b6-8f58add9da62+11:5765:x1870073693210496:12345-0@lo:503: Request processed in 80us (271us total) trans 0 rc 0/0 00000100:00100000:1.0:1783441323.287957:0:5778:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:0.0:1783441323.288036:0:5765:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@0000000058e6f65b pname:cluuid:pid:xid:nid:opc:job mount.lustre:6c1ddb50-5795-40c6-a2b6-8f58add9da62:5765:1870073693210496:0@lo:503: 00000040:00080000:0.0:1783441323.289639:0:5812:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 1 00000020:01000000:2.0:1783441323.290038:0:5765:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-0 (rc=0) 10000000:01000000:2.0:1783441323.290069:0:5765:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.201.113@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:2.0:1783441323.290099:0:5765:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.113@tcp lock: 00000000d7d17758/0xa2426164df2c74f0 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xa2426164df2c74f7 expref: -99 pid: 5765 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783441323.290111:0:5765:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.113@tcp lock: 00000000d7d17758/0xa2426164df2c74f0 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xa2426164df2c74f7 expref: -99 pid: 5765 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1783441323.290172:0:5765:0:(mgc_request.c:1943:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:2.0:1783441323.290176:0:5765:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff91a84869e800 10000000:01000000:2.0:1783441323.290179:0:5765:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff91a84869e800 10000000:01000000:2.0:1783441323.290192:0:5765:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:2.0:1783441323.290199:0:5765:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-client-ffff91a84869e800 from 1 10000000:01000000:2.0:1783441323.290202:0:5765:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:2.0:1783441323.290237:0:5765:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.113@tcp lock: 00000000eda5d318/0xa2426164df2c74fe lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5765 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783441323.290245:0:5765:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.113@tcp lock: 00000000eda5d318/0xa2426164df2c74fe lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5765 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783441323.290255:0:5765:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.113@tcp lock: 00000000eda5d318/0xa2426164df2c74fe lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5765 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783441323.290275:0:5765:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@00000000313bf145 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6c1ddb50-5795-40c6-a2b6-8f58add9da62:5765:1870073693210624:0@lo:101: 00000100:00100000:2.0:1783441323.290335:0:5765:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783441323.290381:0:5765:0:(client.c:2702:ptlrpc_set_wait()) set 00000000370d0679 going to sleep for 11 seconds 00000100:00100000:1.0:1783441323.290516:0:5779:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073693210624 00000100:00100000:1.0:1783441323.290527:0:5779:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073693210624 00000100:00100000:1.0:1783441323.290577:0:5779:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:1.0:1783441323.290586:0:5779:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000fc8a294c pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6c1ddb50-5795-40c6-a2b6-8f58add9da62+11:5765:x1870073693210624:12345-0@lo:101: 00010000:00010000:1.0:1783441323.290603:0:5779:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1783441323.290615:0:5779:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 00000000b3b22329/0xa2426164df2c7505 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0xa2426164df2c74fe expref: -99 pid: 5779 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783441323.290639:0:5779:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000b3b22329/0xa2426164df2c7505 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xa2426164df2c74fe expref: 12 pid: 5779 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783441323.290649:0:5779:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 00000000b3b22329/0xa2426164df2c7505 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xa2426164df2c74fe expref: 12 pid: 5779 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783441323.290657:0:5779:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 00000000b3b22329, rc 0) 00000100:00100000:1.0:1783441323.290696:0:5779:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000fc8a294c pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6c1ddb50-5795-40c6-a2b6-8f58add9da62+12:5765:x1870073693210624:12345-0@lo:101: Request processed in 113us (362us total) trans 0 rc 0/0 00000100:00100000:1.0:1783441323.290703:0:5779:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:2.0:1783441323.290980:0:5765:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@00000000313bf145 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6c1ddb50-5795-40c6-a2b6-8f58add9da62:5765:1870073693210624:0@lo:101: 00010000:00010000:2.0:1783441323.290995:0:5765:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.113@tcp lock: 00000000eda5d318/0xa2426164df2c74fe lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xa2426164df2c7505 expref: -99 pid: 5765 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783441323.291003:0:5765:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.113@tcp lock: 00000000eda5d318/0xa2426164df2c74fe lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0xa2426164df2c7505 expref: -99 pid: 5765 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783441323.291066:0:5765:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@00000000313bf145 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6c1ddb50-5795-40c6-a2b6-8f58add9da62:5765:1870073693210752:0@lo:501: 00000100:00100000:2.0:1783441323.291107:0:5765:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783441323.291138:0:5765:0:(client.c:2702:ptlrpc_set_wait()) set 00000000370d0679 going to sleep for 11 seconds 00000100:00100000:1.0:1783441323.291350:0:5780:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073693210752 00000100:00100000:1.0:1783441323.291356:0:5780:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073693210752 00000100:00100000:1.0:1783441323.291391:0:5780:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:1.0:1783441323.291398:0:5780:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000f36f5f58 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6c1ddb50-5795-40c6-a2b6-8f58add9da62+12:5765:x1870073693210752:12345-0@lo:501: 00000100:00100000:1.0:1783441323.291663:0:5780:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000f36f5f58 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6c1ddb50-5795-40c6-a2b6-8f58add9da62+12:5765:x1870073693210752:12345-0@lo:501: Request processed in 265us (555us total) trans 0 rc 0/0 00000100:00100000:1.0:1783441323.291679:0:5780:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:2.0:1783441323.291924:0:5765:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@00000000313bf145 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6c1ddb50-5795-40c6-a2b6-8f58add9da62:5765:1870073693210752:0@lo:501: 00000100:00100000:2.0:1783441323.292407:0:5765:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@00000000313bf145 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6c1ddb50-5795-40c6-a2b6-8f58add9da62:5765:1870073693210880:0@lo:503: 00000100:00100000:2.0:1783441323.292457:0:5765:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783441323.292571:0:5778:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073693210880 00000100:00100000:1.0:1783441323.292578:0:5778:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073693210880 00000100:00100000:1.0:1783441323.292622:0:5778:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:1.0:1783441323.292629:0:5778:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000a7902794 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6c1ddb50-5795-40c6-a2b6-8f58add9da62+12:5765:x1870073693210880:12345-0@lo:503: 00000100:00100000:1.0:1783441323.293041:0:5778:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000a7902794 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6c1ddb50-5795-40c6-a2b6-8f58add9da62+12:5765:x1870073693210880:12345-0@lo:503: Request processed in 411us (582us total) trans 0 rc 0/0 00000100:00100000:1.0:1783441323.293050:0:5778:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:2.0:1783441323.293323:0:5765:0:(client.c:2702:ptlrpc_set_wait()) set 00000000370d0679 going to sleep for 11 seconds 00000100:00100000:2.0:1783441323.293343:0:5765:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@00000000313bf145 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6c1ddb50-5795-40c6-a2b6-8f58add9da62:5765:1870073693210880:0@lo:503: 00000100:00100000:0.0:1783441323.294267:0:5813:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@0000000058e6f65b pname:cluuid:pid:xid:nid:opc:job llog_process_th:6c1ddb50-5795-40c6-a2b6-8f58add9da62:5813:1870073693211008:0@lo:502: 00000100:00100000:0.0:1783441323.294324:0:5813:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783441323.294392:0:5813:0:(client.c:2702:ptlrpc_set_wait()) set 000000003acfb6d1 going to sleep for 11 seconds 00000100:00100000:2.0:1783441323.294429:0:5779:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073693211008 00000100:00100000:2.0:1783441323.294436:0:5779:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073693211008 00000100:00100000:2.0:1783441323.294587:0:5779:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:2.0:1783441323.294595:0:5779:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000003944a0a pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6c1ddb50-5795-40c6-a2b6-8f58add9da62+12:5813:x1870073693211008:12345-0@lo:502: 00000100:00100000:0.0:1783441323.295409:0:5779:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000003944a0a pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6c1ddb50-5795-40c6-a2b6-8f58add9da62+12:5813:x1870073693211008:12345-0@lo:502: Request processed in 811us (1082us total) trans 0 rc 0/0 00000100:00100000:0.0:1783441323.295419:0:5779:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:1.0:1783441323.295571:0:5813:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@0000000058e6f65b pname:cluuid:pid:xid:nid:opc:job llog_process_th:6c1ddb50-5795-40c6-a2b6-8f58add9da62:5813:1870073693211008:0@lo:502: 00000020:01000004:1.0:1783441323.295634:0:5813:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-MDT0000 (typ=lwp) 00000020:00000080:1.0:1783441323.295661:0:5813:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-MDT0000 (00000000c5486558) 00000020:00000080:1.0:1783441323.295680:0:5813:0:(obd_config.c:720:class_attach_name()) OBD: dev 8 attached type lwp with refcount 2 00000020:01000004:1.0:1783441323.296446:0:5813:0:(tgt_mount.c:153:server_get_mount()) get mount 000000009056e030 from lustre-MDT0000, refs=4 00000020:01000004:1.0:1783441323.296452:0:5813:0:(tgt_mount.c:187:server_put_mount()) put mount 000000009056e030 from lustre-MDT0000, refs=4 00000020:01000004:1.0:1783441323.296454:0:5813:0:(obd_mount.c:710:lustre_put_lsi()) put 000000009056e030 4 00010000:00080000:1.0:1783441323.296565:0:5813:0:(ldlm_lib.c:102:import_set_conn()) imp 00000000b9032f27@lustre-MDT0000-lwp-MDT0000: add connection 192.168.201.113@tcp at head 00010000:00010000:1.0:1783441323.302034:0:5813:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-MDT0000-1 is initialized 00000020:00000080:1.0:1783441323.302696:0:5813:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-MDT0000 (uuid lustre-MDT0000-lwp-MDT0000_UUID) 00000010:01000000:1.0:1783441323.302736:0:5813:0:(lwp_dev.c:497:lwp_obd_connect()) connect #0 00000020:00000080:1.0:1783441323.302784:0:5813:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-lwp-MDT0000, cookie 0xa2426164df2c7513 00000100:00080000:1.0:1783441323.302796:0:5813:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:1.0:1783441323.302801:0:5813:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-MDT0000: import 00000000b9032f27 using connection 192.168.201.113@tcp/0@lo 00000100:00100000:1.0:1783441323.302852:0:5813:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@000000000b971195 x1870073693211136/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1783441323.302876:0:5813:0:(pinger.c:374:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-MDT0000_UUID->lustre-MDT0000_UUID 00000100:00100000:2.0:1783441323.303898:0:3302:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@000000000b971195 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3302:1870073693211136:0@lo:38: 00000100:00100000:2.0:1783441323.303985:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783441323.305784:0:5813:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@00000000830c97bc pname:cluuid:pid:xid:nid:opc:job llog_process_th:6c1ddb50-5795-40c6-a2b6-8f58add9da62:5813:1870073693211264:0@lo:502: 00000100:00100000:1.0:1783441323.305900:0:5813:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783441323.305946:0:5813:0:(client.c:2702:ptlrpc_set_wait()) set 0000000012bb818d going to sleep for 11 seconds 00000100:00100000:0.0:1783441323.309024:0:5785:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073693211136 00000100:00100000:0.0:1783441323.309042:0:5785:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073693211136 00000100:00100000:0.0:1783441323.309102:0:5785:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1783441323.309109:0:5785:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000313bf145 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3302:x1870073693211136:12345-0@lo:38: 00000100:00100000:0.0:1783441323.309234:0:5785:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000313bf145 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3302:x1870073693211136:12345-0@lo:38: Request processed in 123us (5249us total) trans 0 rc -11/-11 00000100:00100000:0.0:1783441323.309241:0:5785:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1783441323.309275:0:5780:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073693211264 00000100:00100000:0.0:1783441323.309279:0:5780:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073693211264 00000100:00100000:0.0:1783441323.309321:0:5780:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:0.0:1783441323.309327:0:5780:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000000d8b62cd pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6c1ddb50-5795-40c6-a2b6-8f58add9da62+12:5813:x1870073693211264:12345-0@lo:502: 00000100:00100000:0.0:1783441323.309730:0:5780:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000000d8b62cd pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6c1ddb50-5795-40c6-a2b6-8f58add9da62+12:5813:x1870073693211264:12345-0@lo:502: Request processed in 403us (3832us total) trans 0 rc 0/0 00000100:00100000:0.0:1783441323.309737:0:5780:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00100000:2.0:1783441323.310225:0:3302:0:(client.c:3112:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:2.0:1783441323.310234:0:3302:0:(import.c:65:import_set_state_nolock()) 00000000b9032f27 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1783441323.310239:0:3302:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-11) 00000100:00100000:2.0:1783441323.310242:0:3302:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@000000000b971195 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3302:1870073693211136:0@lo:38: 00000100:00100000:1.0:1783441323.310405:0:5813:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@00000000830c97bc pname:cluuid:pid:xid:nid:opc:job llog_process_th:6c1ddb50-5795-40c6-a2b6-8f58add9da62:5813:1870073693211264:0@lo:502: 00000040:00080000:1.0:1783441323.310438:0:5813:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 21 count 21 00000020:01000000:2.0:1783441323.310664:0:5765:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-20 (rc=0) 10000000:01000000:2.0:1783441323.310688:0:5765:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.201.113@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:2.0:1783441323.310710:0:5765:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.113@tcp lock: 00000000eda5d318/0xa2426164df2c74fe lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xa2426164df2c7505 expref: -99 pid: 5765 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783441323.310721:0:5765:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.113@tcp lock: 00000000eda5d318/0xa2426164df2c74fe lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xa2426164df2c7505 expref: -99 pid: 5765 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:2.0:1783441323.310806:0:5765:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:2.0:1783441323.310809:0:5765:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:2.0:1783441323.310810:0:5765:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1783441323.310811:0:5765:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1783441323.310813:0:5765:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1783441323.310814:0:5765:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1783441323.310815:0:5765:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:2.0:1783441323.310817:0:5765:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:2.0:1783441323.310818:0:5765:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:2.0:1783441323.310820:0:5765:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:2.0:1783441323.310822:0:5765:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1783441323.310823:0:5765:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:2.0:1783441323.310826:0:5765:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-MDT0000 0x40020065 00000020:01000004:2.0:1783441323.310828:0:5765:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:2.0:1783441323.310830:0:5765:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:2.0:1783441323.310831:0:5765:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1783441323.310832:0:5765:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1783441323.310833:0:5765:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1783441323.310834:0:5765:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1783441323.310835:0:5765:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:2.0:1783441323.310836:0:5765:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:2.0:1783441323.310836:0:5765:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:2.0:1783441323.310838:0:5765:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:2.0:1783441323.310838:0:5765:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1783441323.310839:0:5765:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:2.0:1783441323.310860:0:5765:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-MDT0000 00000100:00100000:2.0:1783441323.310877:0:5765:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@00000000ce872a30 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6c1ddb50-5795-40c6-a2b6-8f58add9da62:5765:1870073693211392:0@lo:253: 00000100:00100000:2.0:1783441323.310926:0:5765:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783441323.312132:0:5765:0:(client.c:2702:ptlrpc_set_wait()) set 00000000f5d730a9 going to sleep for 11 seconds 00000100:00100000:2.0:1783441323.313641:0:5779:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073693211392 00000100:00100000:2.0:1783441323.313654:0:5779:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073693211392 00000100:00100000:2.0:1783441323.313721:0:5779:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:2.0:1783441323.313730:0:5779:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000b56b2bf2 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6c1ddb50-5795-40c6-a2b6-8f58add9da62+12:5765:x1870073693211392:12345-0@lo:253: 20000000:01000000:2.0:1783441323.313789:0:5779:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 0 is ready to reconnect. 20000000:01000000:2.0:1783441323.313817:0:5779:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 20000000:01000000:0.0:1783441323.359072:0:5779:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:0.0:1783441323.359103:0:5779:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-MDT0000, index=0, rc=0 20000000:01000000:2.0:1783441323.359291:0:5801:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:2.0:1783441323.359296:0:5801:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:2.0:1783441323.359318:0:5801:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: 000000002d393ce2/0xa2426164df2c751a lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 5801 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783441323.359337:0:5801:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: 00000000ebb68469/0xa2426164df2c74e9 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xa2426164df2c74e2 expref: 12 pid: 5779 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783441323.359345:0:5801:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: 000000002d393ce2/0xa2426164df2c751a lrc: 4/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 5801 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783441323.359386:0:5801:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: 00000000ebb68469/0xa2426164df2c74e9 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xa2426164df2c74e2 expref: 12 pid: 5779 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783441323.359400:0:5801:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: 00000000ebb68469/0xa2426164df2c74e9 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xa2426164df2c74e2 expref: 12 pid: 5779 timeout: 311 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783441323.359415:0:5801:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@00000000f9346b43 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:5801:1870073693211520:0@lo:104: 00000100:00100000:2.0:1783441323.359479:0:5801:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783441323.359635:0:5801:0:(client.c:2702:ptlrpc_set_wait()) set 0000000008b5ee23 going to sleep for 11 seconds 00000100:00100000:1.0:1783441323.362456:0:5767:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073693211520 00000100:00100000:1.0:1783441323.362473:0:5767:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073693211520 00000100:00100000:1.0:1783441323.362611:0:5767:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1783441323.362621:0:5767:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000fc737ba2 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:6c1ddb50-5795-40c6-a2b6-8f58add9da62+3:5801:x1870073693211520:12345-0@lo:104: 00010000:00010000:1.0:1783441323.362639:0:5767:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.113@tcp lock: 000000002d5ffa9a/0xa2426164df2c74e2 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xa2426164df2c74e9 expref: -99 pid: 5765 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783441323.362764:0:5767:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:1.0:1783441323.362770:0:5767:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000fc737ba2 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:6c1ddb50-5795-40c6-a2b6-8f58add9da62+3:5801:x1870073693211520:12345-0@lo:104: Request processed in 152us (3292us total) trans 0 rc 0/0 00000100:00100000:1.0:1783441323.362777:0:5767:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1783441323.362871:0:5801:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@00000000f9346b43 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:5801:1870073693211520:0@lo:104: 00010000:00010000:0.0:1783441323.362900:0:5801:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: 000000002d393ce2/0xa2426164df2c751a lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 5801 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783441323.363308:0:5773:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1783441323.363314:0:5773:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.113@tcp lock: 000000002d5ffa9a/0xa2426164df2c74e2 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xa2426164df2c74e9 expref: -99 pid: 5765 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783441323.363322:0:5773:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 000000002d5ffa9a already unused, calling callback (0000000040a0c5f3) 10000000:00010000:3.0:1783441323.363325:0:5773:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.113@tcp lock: 000000002d5ffa9a/0xa2426164df2c74e2 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xa2426164df2c74e9 expref: -99 pid: 5765 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783441323.363332:0:5773:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.113@tcp lock: 000000002d5ffa9a/0xa2426164df2c74e2 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xa2426164df2c74e9 expref: -99 pid: 5765 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1783441323.363338:0:5773:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.113@tcp lock: 000000002d5ffa9a/0xa2426164df2c74e2 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xa2426164df2c74e9 expref: -99 pid: 5765 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1783441323.363343:0:5773:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:3.0:1783441323.363385:0:5773:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.113@tcp lock: 000000002d5ffa9a/0xa2426164df2c74e2 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xa2426164df2c74e9 expref: -99 pid: 5765 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783441323.363404:0:5773:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1783441323.363428:0:5773:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.113@tcp lock: 000000002d5ffa9a/0xa2426164df2c74e2 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xa2426164df2c74e9 expref: -99 pid: 5765 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783441323.363433:0:5773:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.113@tcp lock: 000000002d5ffa9a/0xa2426164df2c74e2 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xa2426164df2c74e9 expref: -99 pid: 5765 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783441323.363449:0:5773:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783441323.363451:0:5773:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783441323.363452:0:5773:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1783441323.363549:0:3304:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@00000000bc1298e9 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:6c1ddb50-5795-40c6-a2b6-8f58add9da62:3304:1870073693211648:0@lo:103: 00000100:00100000:0.0:1783441323.363594:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783441323.363801:0:5769:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073693211648 00000100:00100000:3.0:1783441323.363807:0:5769:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073693211648 00010000:00010000:3.0:1783441323.363826:0:5769:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: 00000000ebb68469/0xa2426164df2c74e9 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xa2426164df2c74e2 expref: 13 pid: 5779 timeout: 311 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783441323.363850:0:5769:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1783441323.363856:0:5769:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000fe267095 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:6c1ddb50-5795-40c6-a2b6-8f58add9da62+13:3304:x1870073693211648:12345-0@lo:103: 00010000:00010000:3.0:1783441323.363868:0:5769:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1783441323.363873:0:5769:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: 00000000ebb68469/0xa2426164df2c74e9 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xa2426164df2c74e2 expref: 13 pid: 5779 timeout: 311 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783441323.363883:0:5769:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: 00000000ebb68469/0xa2426164df2c74e9 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xa2426164df2c74e2 expref: 13 pid: 5779 timeout: 311 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783441323.363896:0:5769:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 00000000ebb68469/0xa2426164df2c74e9 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xa2426164df2c74e2 expref: 13 pid: 5779 timeout: 311 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783441323.363908:0:5769:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: 000000002d393ce2/0xa2426164df2c751a lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 5801 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783441323.363929:0:5769:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 000000002d393ce2/0xa2426164df2c751a lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 5801 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:3.0:1783441323.363944:0:5769:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.004649210s 00010000:00010000:3.0:1783441323.363949:0:5769:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: 000000002d393ce2/0xa2426164df2c751a lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 5801 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783441323.363954:0:5769:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: 000000002d393ce2/0xa2426164df2c751a lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5801 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783441323.363960:0:5769:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: 000000002d393ce2/0xa2426164df2c751a lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5801 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783441323.363977:0:5769:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: 000000002d393ce2/0xa2426164df2c751a lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5801 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783441323.363982:0:5769:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 000000002d393ce2 already unused, calling callback (000000003281bd88) 00010000:00010000:3.0:1783441323.363986:0:5769:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: 000000002d393ce2/0xa2426164df2c751a lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5801 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783441323.363992:0:5769:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: 000000002d393ce2/0xa2426164df2c751a lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 5801 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783441323.364002:0:5769:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: 000000002d393ce2/0xa2426164df2c751a lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5801 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783441323.364012:0:5769:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1783441323.364042:0:5769:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000fe267095 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:6c1ddb50-5795-40c6-a2b6-8f58add9da62+12:3304:x1870073693211648:12345-0@lo:103: Request processed in 187us (448us total) trans 0 rc 0/0 00000100:00100000:3.0:1783441323.364050:0:5769:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1783441323.364310:0:3304:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@00000000bc1298e9 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:6c1ddb50-5795-40c6-a2b6-8f58add9da62:3304:1870073693211648:0@lo:103: 00010000:00010000:0.0:1783441323.364334:0:5801:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: 000000002d393ce2/0xa2426164df2c751a lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5801 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783441323.364341:0:5801:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: 000000002d393ce2/0xa2426164df2c751a lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5801 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783441323.364347:0:5801:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 000000002d393ce2/0xa2426164df2c751a lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5801 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783441323.372780:0:5779:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000b56b2bf2 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6c1ddb50-5795-40c6-a2b6-8f58add9da62+11:5765:x1870073693211392:12345-0@lo:253: Request processed in 59005us (61808us total) trans 0 rc 0/0 00000100:00100000:0.0:1783441323.372798:0:5779:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00100000:2.0:1783441323.373075:0:5765:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@00000000ce872a30 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6c1ddb50-5795-40c6-a2b6-8f58add9da62:5765:1870073693211392:0@lo:253: 10000000:01000000:2.0:1783441323.373166:0:5765:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-MDT0000 got index = 0 00000020:01000004:2.0:1783441323.373170:0:5765:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:2.0:1783441323.373172:0:5765:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:2.0:1783441323.373173:0:5765:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1783441323.373175:0:5765:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1783441323.373176:0:5765:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1783441323.373177:0:5765:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1783441323.373242:0:5765:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:2.0:1783441323.373243:0:5765:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:2.0:1783441323.373245:0:5765:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:2.0:1783441323.373246:0:5765:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:2.0:1783441323.373255:0:5765:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1783441323.373256:0:5765:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:2.0:1783441323.373278:0:5765:0:(tgt_mount.c:2690:server_calc_timeout()) lustre-MDT0000: Imperative Recovery not enabled, recovery window 60-180 00080000:10000000:2.0:1783441323.379410:0:5765:0:(osd_index.c:2102:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xa:0x0] (8/8/4) registered 00080000:10000000:3.0:1783441323.380941:0:5765:0:(osd_index.c:2102:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x1:0x0] (8/8/1) registered 00080000:10000000:3.0:1783441323.381401:0:5765:0:(osd_index.c:2102:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xb:0x0] (8/8/4) registered 00080000:10000000:3.0:1783441323.381625:0:5765:0:(osd_index.c:2102:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x2:0x0] (8/8/1) registered 00080000:10000000:3.0:1783441323.381826:0:5765:0:(osd_index.c:2102:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xc:0x0] (8/8/4) registered 00080000:10000000:3.0:1783441323.382062:0:5765:0:(osd_index.c:2102:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x3:0x0] (8/8/1) registered 00080000:10000000:3.0:1783441323.382955:0:5765:0:(osd_index.c:2102:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xd:0x0] (8/8/4) registered 00080000:10000000:3.0:1783441323.383366:0:5765:0:(osd_index.c:2102:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x20001:0x0] (8/8/1) registered 00080000:10000000:3.0:1783441323.383623:0:5765:0:(osd_index.c:2102:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xe:0x0] (8/8/4) registered 00080000:10000000:3.0:1783441323.383800:0:5765:0:(osd_index.c:2102:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x20002:0x0] (8/8/1) registered 00080000:10000000:3.0:1783441323.384050:0:5765:0:(osd_index.c:2102:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xf:0x0] (8/8/4) registered 00080000:10000000:3.0:1783441323.384356:0:5765:0:(osd_index.c:2102:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x20003:0x0] (8/8/1) registered 40000000:02000000:2.0:1783441323.441281:0:5765:0:(fid_handler.c:119:__seq_server_alloc_super()) ctl-lustre-MDT0000: super-sequence allocation rc = 0 [0x0000000200000400-0x0000000240000400]:0:mdt 00000040:01000000:2.0:1783441323.491579:0:5765:0:(llog_obd.c:197:llog_setup()) obd lustre-MDT0000-osd ctxt 16 is initialized 00000020:00080000:1.0:1783441323.491666:0:5818:0:(update_trans.c:1530:distribute_txn_commit_thread()) lustre-MDT0000: start commit thread committed batchid 0 00000020:00080000:1.0:1783441323.491670:0:5818:0:(update_trans.c:1581:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 0 00000040:01000000:1.0:1783441323.491943:0:5819:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=0, read=32 00000040:01000000:2.0:1783441323.501326:0:5765:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 12 is initialized 00000040:00080000:2.0:1783441323.502018:0:5765:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000004:00000080:2.0:1783441323.502662:0:5765:0:(mdd_device.c:553:mdd_changelog_llog_init()) changelog starting index=0 00000040:01000000:2.0:1783441323.502674:0:5765:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 14 is initialized 00000040:00080000:2.0:1783441323.502917:0:5765:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1783441323.504390:0:5765:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x5:0x0] index 64768 count 1 00000040:00080000:2.0:1783441323.505578:0:5765:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x6:0x0] index 64768 count 1 00000040:01000000:2.0:1783441323.505630:0:5765:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 15 is initialized 00000040:00080000:2.0:1783441323.505908:0:5765:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00080000:10000000:2.0:1783441323.506950:0:5765:0:(osd_index.c:2102:osd_index_try()) lustre-MDT0000: index object [0x200000003:0x11:0x0] (8/8/4) registered 00100000:10000000:2.0:1783441323.508871:0:5765:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_00: rc = 0 00100000:10000000:2.0:1783441323.509095:0:5765:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_01: rc = 0 00100000:10000000:2.0:1783441323.509577:0:5765:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_02: rc = 0 00100000:10000000:2.0:1783441323.509786:0:5765:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_03: rc = 0 00100000:10000000:2.0:1783441323.509935:0:5765:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_04: rc = 0 00100000:10000000:2.0:1783441323.510108:0:5765:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_05: rc = 0 00100000:10000000:2.0:1783441323.510407:0:5765:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_06: rc = 0 00100000:10000000:2.0:1783441323.510569:0:5765:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_07: rc = 0 00100000:10000000:2.0:1783441323.510714:0:5765:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_08: rc = 0 00100000:10000000:2.0:1783441323.510924:0:5765:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_09: rc = 0 00100000:10000000:2.0:1783441323.511121:0:5765:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_10: rc = 0 00100000:10000000:2.0:1783441323.511397:0:5765:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_11: rc = 0 00100000:10000000:2.0:1783441323.511537:0:5765:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_12: rc = 0 00100000:10000000:2.0:1783441323.511706:0:5765:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_13: rc = 0 00100000:10000000:2.0:1783441323.511879:0:5765:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_14: rc = 0 00100000:10000000:2.0:1783441323.512043:0:5765:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_15: rc = 0 00100000:10000000:2.0:1783441323.512501:0:5765:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_00: rc = 0 00100000:10000000:2.0:1783441323.512669:0:5765:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_01: rc = 0 00100000:10000000:2.0:1783441323.512842:0:5765:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_02: rc = 0 00100000:10000000:2.0:1783441323.513006:0:5765:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_03: rc = 0 00100000:10000000:2.0:1783441323.513144:0:5765:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_04: rc = 0 00100000:10000000:2.0:1783441323.513666:0:5765:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_05: rc = 0 00100000:10000000:2.0:1783441323.513859:0:5765:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_06: rc = 0 00100000:10000000:2.0:1783441323.514016:0:5765:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_07: rc = 0 00100000:10000000:2.0:1783441323.514185:0:5765:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_08: rc = 0 00100000:10000000:2.0:1783441323.514399:0:5765:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_09: rc = 0 00100000:10000000:2.0:1783441323.514518:0:5765:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_10: rc = 0 00100000:10000000:2.0:1783441323.514670:0:5765:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_11: rc = 0 00100000:10000000:2.0:1783441323.514809:0:5765:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_12: rc = 0 00100000:10000000:2.0:1783441323.514949:0:5765:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_13: rc = 0 00100000:10000000:2.0:1783441323.515300:0:5765:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_14: rc = 0 00100000:10000000:2.0:1783441323.515433:0:5765:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_15: rc = 0 00000001:00000004:2.0:1783441323.515616:0:5765:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 1, last_transno is 4294967296 00000040:00080000:2.0:1783441323.539773:0:5819:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000001:00080000:1.0:1783441323.593704:0:5765:0:(tgt_lastrcvd.c:222:tgt_reply_header_read()) lustre-MDT0000: read reply_data header. magic=0xbdabda01 header_size=32 reply_size=32 00000004:00000080:1.0:1783441323.593769:0:5765:0:(mdd_device.c:2302:mdd_iocontrol()) lustre-MDD0000: cmd=c00866e6 len=0 karg=ffffaa8581c8f988 00100000:10000000:1.0:1783441323.593778:0:5765:0:(lfsck_lib.c:3085:lfsck_start()) lustre-MDT0000-osd: start master thread 00000040:00080000:3.0:1783441323.596399:0:5819:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x200000400:0x1:0x0] index 261376 count 1 00000004:00080000:3.0:1783441323.596477:0:5819:0:(lod_dev.c:521:lod_sub_recovery_thread()) lustre-MDT0000-osd retrieved update log, duration 0, retries 0 00000004:00080000:3.0:1783441323.596481:0:5819:0:(lod_dev.c:545:lod_sub_recovery_thread()) lustre-MDT0000 got update logs from all MDTs. 00000020:01000004:1.0:1783441323.597038:0:5765:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:1.0:1783441323.597056:0:5765:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.201.113@tcp: cl_mgc_mutex unlock 00000020:01000004:1.0:1783441323.597144:0:5765:0:(tgt_mount.c:2459:server_fill_super_common()) Server sb, dev=46 00000080:00000004:1.0:1783441323.597234:0:5765:0:(super25.c:187:lustre_fill_super()) lustre-mdt1/mdt1: Mount complete 00010000:00010000:3.0:1783441324.087216:0:5772:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783441325.100968:0:5773:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783441326.124913:0:5772:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783441327.149003:0:5773:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783441328.174363:0:5772:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:0.0:1783441328.274691:0:6061:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg113-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00000100:00100000:0.0:1783441328.494468:0:3305:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@00000000830c97bc pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:6c1ddb50-5795-40c6-a2b6-8f58add9da62:3305:1870073693211776:0@lo:400: 00000100:00100000:0.0:1783441328.494529:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783441328.494579:0:5778:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073693211776 00000100:00100000:2.0:1783441328.494590:0:5778:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073693211776 00000100:00080000:1.0:1783441328.494599:0:446:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 0 00000100:00080000:1.0:1783441328.494603:0:446:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:1.0:1783441328.494606:0:446:0:(import.c:65:import_set_state_nolock()) 00000000b9032f27 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1783441328.494621:0:446:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-MDT0000: import 00000000b9032f27 using connection 192.168.201.113@tcp/0@lo 00000100:00100000:1.0:1783441328.494639:0:446:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@00000000d376973c x1870073693211904/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1783441328.494647:0:5778:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:2.0:1783441328.494659:0:5778:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000be313aee pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6c1ddb50-5795-40c6-a2b6-8f58add9da62+11:3305:x1870073693211776:12345-0@lo:400: 00000100:00100000:2.0:1783441328.495342:0:5778:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000be313aee pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6c1ddb50-5795-40c6-a2b6-8f58add9da62+11:3305:x1870073693211776:12345-0@lo:400: Request processed in 682us (809us total) trans 0 rc 0/0 00000100:00100000:2.0:1783441328.495358:0:5778:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00100000:0.0:1783441328.495380:0:3305:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@00000000830c97bc pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:6c1ddb50-5795-40c6-a2b6-8f58add9da62:3305:1870073693211776:0@lo:400: 00000100:00100000:2.0:1783441328.495403:0:3302:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@00000000d376973c pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3302:1870073693211904:0@lo:38: 00000100:00100000:2.0:1783441328.495485:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783441328.495665:0:5787:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073693211904 00000100:00100000:0.0:1783441328.495670:0:5787:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073693211904 00000100:00100000:0.0:1783441328.495767:0:5787:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1783441328.495777:0:5787:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000ce872a30 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3302:x1870073693211904:12345-0@lo:38: 00010000:00080000:0.0:1783441328.495800:0:5787:0:(ldlm_lib.c:1432:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-MDT0000_UUID@0@lo t0 exp 0000000000000000 cur 166 last 0 00000020:00000080:0.0:1783441328.495838:0:5787:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-lwp-MDT0000_UUID, cookie 0xa2426164df2c7521 00000004:00100000:0.0:1783441328.495903:0:5787:0:(mdt_handler.c:7286:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:0.0:1783441328.496037:0:5787:0:(import.c:65:import_set_state_nolock()) 00000000d39e0093 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1783441328.496168:0:5787:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000ce872a30 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3302:x1870073693211904:12345-0@lo:38: Request processed in 390us (683us total) trans 0 rc 0/0 00000100:00100000:0.0:1783441328.496176:0:5787:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:3.0:1783441328.496219:0:3302:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@00000000d376973c x1870073693211904/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/416 e 0 to 0 dl 1783441338 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00080000:3.0:1783441328.496234:0:3302:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-MDT0000: connect to target with instance 1 00000100:00080000:3.0:1783441328.496244:0:3302:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-MDT0000: Resetting ns_connect_flags to server flags: 0x2041401047000020 00000100:00080000:3.0:1783441328.496251:0:3302:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:3.0:1783441328.496253:0:3302:0:(import.c:65:import_set_state_nolock()) 00000000b9032f27 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:3.0:1783441328.496259:0:3302:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@00000000d376973c pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3302:1870073693211904:0@lo:38: 00010000:00010000:3.0:1783441329.196959:0:5773:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783441330.231240:0:5772:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783441331.245295:0:5773:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:1.0:1783441332.076822:0:5783:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:1.0:1783441332.076830:0:5783:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-mdtir-ffff91a84869e800 from 3 10000000:01000000:1.0:1783441332.076835:0:5783:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:1.0:1783441332.076888:0:5783:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.113@tcp lock: 0000000089a42abc/0xa2426164df2c7528 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5783 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783441332.076900:0:5783:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.113@tcp lock: 0000000089a42abc/0xa2426164df2c7528 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5783 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783441332.076911:0:5783:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.113@tcp lock: 0000000089a42abc/0xa2426164df2c7528 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5783 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783441332.076941:0:5783:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@000000007a607c41 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6c1ddb50-5795-40c6-a2b6-8f58add9da62:5783:1870073693212032:0@lo:101: 00000100:00100000:1.0:1783441332.077008:0:5783:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783441332.077076:0:5783:0:(client.c:2702:ptlrpc_set_wait()) set 00000000777b3ba3 going to sleep for 11 seconds 00000100:00100000:3.0:1783441332.077263:0:5779:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073693212032 00000100:00100000:3.0:1783441332.077273:0:5779:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073693212032 00000100:00100000:3.0:1783441332.077319:0:5779:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:3.0:1783441332.077329:0:5779:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000068f10f93 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6c1ddb50-5795-40c6-a2b6-8f58add9da62+11:5783:x1870073693212032:12345-0@lo:101: 00010000:00010000:3.0:1783441332.077345:0:5779:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1783441332.077358:0:5779:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 00000000a1fbf00b/0xa2426164df2c752f lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xa2426164df2c7528 expref: -99 pid: 5779 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783441332.077494:0:5779:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000a1fbf00b/0xa2426164df2c752f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xa2426164df2c7528 expref: 12 pid: 5779 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783441332.077506:0:5779:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 00000000a1fbf00b/0xa2426164df2c752f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xa2426164df2c7528 expref: 12 pid: 5779 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783441332.077514:0:5779:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 00000000a1fbf00b, rc 0) 00000100:00100000:3.0:1783441332.077561:0:5779:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000068f10f93 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6c1ddb50-5795-40c6-a2b6-8f58add9da62+12:5783:x1870073693212032:12345-0@lo:101: Request processed in 233us (553us total) trans 0 rc 0/0 00000100:00100000:3.0:1783441332.077567:0:5779:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:1.0:1783441332.077653:0:5783:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@000000007a607c41 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6c1ddb50-5795-40c6-a2b6-8f58add9da62:5783:1870073693212032:0@lo:101: 00010000:00010000:1.0:1783441332.077667:0:5783:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.113@tcp lock: 0000000089a42abc/0xa2426164df2c7528 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xa2426164df2c752f expref: -99 pid: 5783 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783441332.077675:0:5783:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.113@tcp lock: 0000000089a42abc/0xa2426164df2c7528 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xa2426164df2c752f expref: -99 pid: 5783 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783441332.077729:0:5783:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@000000007a607c41 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6c1ddb50-5795-40c6-a2b6-8f58add9da62:5783:1870073693212160:0@lo:256: 00000100:00100000:1.0:1783441332.080908:0:5783:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783441332.080969:0:5783:0:(client.c:2702:ptlrpc_set_wait()) set 00000000777b3ba3 going to sleep for 11 seconds 00000100:00100000:3.0:1783441332.083331:0:5780:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073693212160 00000100:00100000:3.0:1783441332.083348:0:5780:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073693212160 00000100:00100000:3.0:1783441332.083413:0:5780:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:3.0:1783441332.083422:0:5780:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000ce4bb1b4 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6c1ddb50-5795-40c6-a2b6-8f58add9da62+12:5783:x1870073693212160:12345-0@lo:256: 20000000:01000000:3.0:1783441332.083450:0:5780:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:3.0:1783441332.083466:0:5780:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:3.0:1783441332.083469:0:5780:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 3 00000100:00100000:3.0:1783441332.083606:0:5780:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000ce4bb1b4 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6c1ddb50-5795-40c6-a2b6-8f58add9da62+12:5783:x1870073693212160:12345-0@lo:256: Request processed in 184us (2704us total) trans 0 rc 0/0 00000100:00100000:3.0:1783441332.083614:0:5780:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00100000:3.0:1783441332.083679:0:5783:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@000000007a607c41 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6c1ddb50-5795-40c6-a2b6-8f58add9da62:5783:1870073693212160:0@lo:256: 10000000:01000000:3.0:1783441332.083729:0:5783:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.201.113@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:3.0:1783441332.083737:0:5783:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.113@tcp lock: 0000000089a42abc/0xa2426164df2c7528 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xa2426164df2c752f expref: -99 pid: 5783 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783441332.083764:0:5783:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.113@tcp lock: 0000000089a42abc/0xa2426164df2c7528 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xa2426164df2c752f expref: -99 pid: 5783 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783441332.269723:0:5772:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783441333.293013:0:5773:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:1.0:1783441333.513086:0:6263:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007ffd4dace1a0 20000000:00000080:1.0:1783441333.513103:0:6263:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff91a847638800 uarg=0000000000000000 20000000:01000000:1.0:1783441333.513135:0:6263:0:(mgs_llog.c:6188:mgs_set_param2()) set_param2 fs='' device='general' param='debug_raw_pointers=Y' 20000000:01000000:1.0:1783441333.513142:0:6263:0:(mgs_llog.c:4643:mgs_write_log_param2()) next param 'debug_raw_pointers=Y' 20000000:01000000:1.0:1783441333.513146:0:6263:0:(mgs_llog.c:1379:mgs_modify_param()) modify params/general/debug_raw_pointers=Y del=0 00000040:00080000:1.0:1783441333.513371:0:6263:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 20000000:02000000:1.0:1783441333.513384:0:6263:0:(mgs_llog.c:4116:mgs_wlp_lcfg()) Modifying parameter general.debug_raw_pointers=Y in log params 00000040:00080000:1.0:1783441333.523344:0:6263:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1783441333.523551:0:6263:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].1, 224 off8416 00000040:00080000:1.0:1783441333.523589:0:6263:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].2, 112 off8528 00000040:00080000:1.0:1783441333.523628:0:6263:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].3, 224 off8752 10000000:01000000:1.0:1783441333.523642:0:6263:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 00010000:00010000:1.0:1783441333.523658:0:6263:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: 00000000802041fd/0xa2426164df2c7536 lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6263 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783441333.523698:0:6263:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: 00000000f0cc14ae/0xa2426164df2c74f7 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xa2426164df2c74f0 expref: 11 pid: 5778 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783441333.523703:0:6263:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: 00000000802041fd/0xa2426164df2c7536 lrc: 4/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 6263 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783441333.523754:0:6263:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: 00000000f0cc14ae/0xa2426164df2c74f7 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xa2426164df2c74f0 expref: 11 pid: 5778 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783441333.523768:0:6263:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: 00000000f0cc14ae/0xa2426164df2c74f7 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xa2426164df2c74f0 expref: 11 pid: 5778 timeout: 321 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783441333.523779:0:6263:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@0000000077674a13 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:6263:1870073693212288:0@lo:104: 00000100:00100000:1.0:1783441333.523832:0:6263:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783441333.524212:0:6263:0:(client.c:2702:ptlrpc_set_wait()) set 00000000c1ee1cea going to sleep for 11 seconds 00000100:00100000:3.0:1783441333.527659:0:5768:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073693212288 00000100:00100000:3.0:1783441333.527670:0:5768:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073693212288 00000100:00100000:3.0:1783441333.528206:0:5768:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1783441333.528227:0:5768:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000006290a779 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:6c1ddb50-5795-40c6-a2b6-8f58add9da62+3:6263:x1870073693212288:12345-0@lo:104: 00010000:00010000:3.0:1783441333.528245:0:5768:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.113@tcp lock: 00000000d7d17758/0xa2426164df2c74f0 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xa2426164df2c74f7 expref: -99 pid: 5765 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783441333.528344:0:5768:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1783441333.528349:0:5768:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000006290a779 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:6c1ddb50-5795-40c6-a2b6-8f58add9da62+3:6263:x1870073693212288:12345-0@lo:104: Request processed in 126us (4517us total) trans 0 rc 0/0 00000100:00100000:3.0:1783441333.528355:0:5768:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1783441333.528427:0:6263:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@0000000077674a13 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:6263:1870073693212288:0@lo:104: 00010000:00010000:0.0:1783441333.528450:0:6263:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: 00000000802041fd/0xa2426164df2c7536 lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 6263 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783441333.533577:0:5772:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1783441333.533590:0:5772:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.113@tcp lock: 00000000d7d17758/0xa2426164df2c74f0 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xa2426164df2c74f7 expref: -99 pid: 5765 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783441333.533613:0:5772:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 00000000d7d17758 already unused, calling callback (0000000040a0c5f3) 10000000:00010000:0.0:1783441333.533616:0:5772:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.113@tcp lock: 00000000d7d17758/0xa2426164df2c74f0 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xa2426164df2c74f7 expref: -99 pid: 5765 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783441333.533648:0:5772:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.113@tcp lock: 00000000d7d17758/0xa2426164df2c74f0 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xa2426164df2c74f7 expref: -99 pid: 5765 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1783441333.533655:0:5772:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.113@tcp lock: 00000000d7d17758/0xa2426164df2c74f0 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xa2426164df2c74f7 expref: -99 pid: 5765 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1783441333.533661:0:5772:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:0.0:1783441333.533719:0:5772:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.113@tcp lock: 00000000d7d17758/0xa2426164df2c74f0 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xa2426164df2c74f7 expref: -99 pid: 5765 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783441333.533727:0:5772:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1783441333.533776:0:5772:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.113@tcp lock: 00000000d7d17758/0xa2426164df2c74f0 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xa2426164df2c74f7 expref: -99 pid: 5765 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783441333.533783:0:5772:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.113@tcp lock: 00000000d7d17758/0xa2426164df2c74f0 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xa2426164df2c74f7 expref: -99 pid: 5765 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783441333.533806:0:5772:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783441333.533807:0:5772:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783441333.533809:0:5772:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1783441333.533816:0:3305:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1783441333.533835:0:3305:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@00000000e2405a10 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:6c1ddb50-5795-40c6-a2b6-8f58add9da62:3305:1870073693212416:0@lo:103: 00000100:00100000:0.0:1783441333.535815:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783441333.535949:0:5769:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073693212416 00000100:00100000:1.0:1783441333.535971:0:5769:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073693212416 00010000:00010000:1.0:1783441333.536021:0:5769:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: 00000000f0cc14ae/0xa2426164df2c74f7 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xa2426164df2c74f0 expref: 12 pid: 5778 timeout: 321 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783441333.536062:0:5769:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1783441333.536070:0:5769:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000f3a10142 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:6c1ddb50-5795-40c6-a2b6-8f58add9da62+12:3305:x1870073693212416:12345-0@lo:103: 00010000:00010000:1.0:1783441333.536083:0:5769:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1783441333.536086:0:5769:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: 00000000f0cc14ae/0xa2426164df2c74f7 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xa2426164df2c74f0 expref: 12 pid: 5778 timeout: 321 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783441333.536095:0:5769:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: 00000000f0cc14ae/0xa2426164df2c74f7 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xa2426164df2c74f0 expref: 12 pid: 5778 timeout: 321 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783441333.536108:0:5769:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 00000000f0cc14ae/0xa2426164df2c74f7 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xa2426164df2c74f0 expref: 12 pid: 5778 timeout: 321 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783441333.536121:0:5769:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: 00000000802041fd/0xa2426164df2c7536 lrc: 3/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 6263 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783441333.536127:0:5769:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000802041fd/0xa2426164df2c7536 lrc: 4/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 6263 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783441333.536138:0:5769:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: 00000000802041fd/0xa2426164df2c7536 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 6263 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783441333.536141:0:5769:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: 00000000802041fd/0xa2426164df2c7536 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 6263 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783441333.536145:0:5769:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: 00000000802041fd/0xa2426164df2c7536 lrc: 4/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 6263 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783441333.536148:0:5769:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: 00000000802041fd/0xa2426164df2c7536 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6263 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783441333.536157:0:5769:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 00000000802041fd already unused, calling callback (000000003281bd88) 00010000:00010000:1.0:1783441333.536160:0:5769:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: 00000000802041fd/0xa2426164df2c7536 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6263 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783441333.536165:0:5769:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: 00000000802041fd/0xa2426164df2c7536 lrc: 6/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 6263 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783441333.536172:0:5769:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: 00000000802041fd/0xa2426164df2c7536 lrc: 4/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6263 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783441333.536179:0:5769:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1783441333.536215:0:5769:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000f3a10142 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:6c1ddb50-5795-40c6-a2b6-8f58add9da62+11:3305:x1870073693212416:12345-0@lo:103: Request processed in 146us (408us total) trans 0 rc 0/0 00000100:00100000:1.0:1783441333.536220:0:5769:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1783441333.536252:0:3305:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@00000000e2405a10 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:6c1ddb50-5795-40c6-a2b6-8f58add9da62:3305:1870073693212416:0@lo:103: 00010000:00010000:0.0:1783441333.536306:0:6263:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: 00000000802041fd/0xa2426164df2c7536 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6263 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783441333.536312:0:6263:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: 00000000802041fd/0xa2426164df2c7536 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6263 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783441333.536316:0:6263:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 00000000802041fd/0xa2426164df2c7536 lrc: 0/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6263 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783441333.612999:0:3303:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@000000000a8a9f52 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3303:1870073693212544:0@lo:400: 00000100:00100000:0.0:1783441333.613085:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783441333.613339:0:5786:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073693212544 00000100:00100000:1.0:1783441333.613349:0:5786:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073693212544 00000100:00100000:1.0:1783441333.613398:0:5786:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1783441333.613406:0:5786:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000d794e251 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3303:x1870073693212544:12345-0@lo:400: 00000100:00100000:1.0:1783441333.613469:0:5786:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000d794e251 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3303:x1870073693212544:12345-0@lo:400: Request processed in 63us (384us total) trans 0 rc 0/0 00000100:00100000:1.0:1783441333.613476:0:5786:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00080000:1.0:1783441333.613520:0:3303:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@000000000a8a9f52 x1870073693212544/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1783441349 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1783441333.613534:0:3303:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@000000000a8a9f52 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3303:1870073693212544:0@lo:400: 00010000:00010000:3.0:1783441334.316932:0:5773:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783441335.341148:0:5772:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783441336.365053:0:5773:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783441337.388901:0:5772:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783441338.413026:0:5773:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1783441338.733267:0:3303:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1783441338.733380:0:3305:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@00000000ad69bd46 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3305:1870073693212800:0@lo:400: 00000100:00100000:0.0:1783441338.733456:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783441338.733523:0:5787:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073693212800 00000100:00100000:0.0:1783441338.733531:0:5787:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073693212800 00000100:00100000:0.0:1783441338.733588:0:5787:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1783441338.733596:0:5787:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000cb986229 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3305:x1870073693212800:12345-0@lo:400: 00000100:00100000:0.0:1783441338.733646:0:5787:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000cb986229 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3305:x1870073693212800:12345-0@lo:400: Request processed in 51us (191us total) trans 0 rc 0/0 00000100:00100000:0.0:1783441338.733653:0:5787:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:0.0:1783441338.733695:0:3305:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@00000000ad69bd46 x1870073693212800/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1783441354 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1783441338.733709:0:3305:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@00000000ad69bd46 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3305:1870073693212800:0@lo:400: 00000100:00100000:1.0:1783441338.734127:0:3303:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@000000000a8a9f52 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:6c1ddb50-5795-40c6-a2b6-8f58add9da62:3303:1870073693212672:0@lo:400: 00000100:00100000:1.0:1783441338.734161:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783441338.734309:0:5780:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073693212672 00000100:00100000:2.0:1783441338.734314:0:5780:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073693212672 00000100:00100000:2.0:1783441338.734351:0:5780:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:2.0:1783441338.734358:0:5780:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000c59311c3 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6c1ddb50-5795-40c6-a2b6-8f58add9da62+11:3303:x1870073693212672:12345-0@lo:400: 00000100:00100000:2.0:1783441338.734406:0:5780:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000c59311c3 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6c1ddb50-5795-40c6-a2b6-8f58add9da62+11:3303:x1870073693212672:12345-0@lo:400: Request processed in 49us (245us total) trans 0 rc 0/0 00000100:00100000:2.0:1783441338.734412:0:5780:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00100000:0.0:1783441338.734544:0:3303:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@000000000a8a9f52 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:6c1ddb50-5795-40c6-a2b6-8f58add9da62:3303:1870073693212672:0@lo:400: 00010000:00010000:0.0:1783441339.438045:0:5772:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:3.0:1783441339.470331:0:6577:0:(obd_mount.c:923:lmd_print()) mount data: 00000020:01000004:3.0:1783441339.470335:0:6577:0:(obd_mount.c:926:lmd_print()) device: lustre-ost1/ost1 00000080:01200004:3.0:1783441339.470479:0:6577:0:(super25.c:130:lustre_fill_super()) VFS Op: sb 00000000dafcae11 00000020:01000004:3.0:1783441339.470498:0:6577:0:(tgt_mount.c:2501:osd_start()) Attempting to start lustre-OST0000, type=osd-zfs, lsifl=200062, mountfl=0 00000020:01000004:3.0:1783441339.470509:0:6577:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-OST0000-osd (typ=osd-zfs) 00000020:00000080:3.0:1783441339.470521:0:6577:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000-osd (00000000cd80dc7f) 00000020:00000080:3.0:1783441339.470538:0:6577:0:(obd_config.c:720:class_attach_name()) OBD: dev 9 attached type osd-zfs with refcount 2 00100000:10000000:2.0:1783441339.487000:0:6577:0:(scrub.c:229:scrub_file_store()) lustre-OST0000: store scrub file: rc = 0 00100000:10000000:2.0:1783441339.487398:0:6577:0:(scrub.c:229:scrub_file_store()) lustre-OST0000: store scrub file: rc = 0 00100000:10000000:3.0:1783441339.506391:0:6577:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0000: refresh OI map for scrub, op 1, force yes, [0x200000001:0x1017:0x0] => 0 (CONFIGS): rc = 1 00100000:10000000:3.0:1783441339.511043:0:6577:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0000: refresh OI map for scrub, op 1, force yes, [0x200000007:0x1:0x0] => 0 (ROOT): rc = 1 00100000:10000000:3.0:1783441339.511074:0:6577:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0000: refresh OI map for scrub, op 1, force yes, [0x200000001:0x3:0x0] => 0 (fld): rc = 1 00100000:10000000:3.0:1783441339.511212:0:6577:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0000: refresh OI map for scrub, op 1, force yes, [0x200000009:0x0:0x0] => 0 (update_log): rc = 1 00100000:10000000:3.0:1783441339.511245:0:6577:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0000: refresh OI map for scrub, op 1, force yes, [0x20000000a:0x0:0x0] => 0 (update_log_dir): rc = 1 00000020:00000080:3.0:1783441339.511611:0:6577:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000-osd (uuid lustre-OST0000-osd_UUID) 00080000:01000000:3.0:1783441339.511623:0:6577:0:(osd_handler.c:1569:osd_obd_connect()) connect #0 00000020:00000080:3.0:1783441339.511632:0:6577:0:(genops.c:1406:class_connect()) connect: client lustre-OST0000-osd_UUID, cookie 0xa2426164df2c7544 00000020:01000004:3.0:1783441339.511640:0:6577:0:(tgt_mount.c:2586:server_fill_super()) Found service lustre-OST0000 on device lustre-ost1/ost1 00000020:01000004:3.0:1783441339.511664:0:6577:0:(obd_mount.c:403:lustre_start_mgc()) MGC192.168.201.113@tcp:Set MGC reconnect 1 10000000:01000000:3.0:1783441339.511668:0:6577:0:(mgc_request.c:1071:mgc_set_info_async()) InitRecov MGC192.168.201.113@tcp 1/d0:i0:r0:or0:FULL 00000020:01000004:3.0:1783441339.511674:0:6577:0:(tgt_mount.c:1810:server_start_targets()) starting target lustre-OST0000 00000020:01000004:3.0:1783441339.511679:0:6577:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD OSS (typ=ost) 00000020:00000080:3.0:1783441339.511689:0:6577:0:(genops.c:413:class_newdev()) Allocate new device OSS (0000000037d21d94) 00000020:00000080:3.0:1783441339.511700:0:6577:0:(obd_config.c:720:class_attach_name()) OBD: dev 10 attached type ost with refcount 2 00000100:00100000:3.0:1783441339.514120:0:6577:0:(service.c:155:ptlrpc_grow_req_bufs()) ost: allocate 64 new 32768-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1783441339.514397:0:6577:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 0 min 3 max 116 00000100:00100000:3.0:1783441339.514403:0:6577:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost00_000' 00000100:00100000:1.0:1783441339.520495:0:6577:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 1 min 3 max 116 00000100:00100000:1.0:1783441339.520513:0:6577:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost00_001' 00000100:00100000:1.0:1783441339.521054:0:6577:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 2 min 3 max 116 00000100:00100000:1.0:1783441339.521060:0:6577:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost00_002' 00000100:00100000:1.0:1783441339.523035:0:6577:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_create: allocate 64 new 32768-byte reqbufs (0/64 left), rc = 0 00000100:00100000:1.0:1783441339.523203:0:6577:0:(service.c:3462:ptlrpc_start_thread()) ost_create[0] started 0 min 2 max 16 00000100:00100000:1.0:1783441339.523209:0:6577:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_create00_000' 00000100:00100000:3.0:1783441339.524217:0:6577:0:(service.c:3462:ptlrpc_start_thread()) ost_create[0] started 1 min 2 max 16 00000100:00100000:3.0:1783441339.524227:0:6577:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_create00_001' 00000100:00100000:3.0:1783441339.560284:0:6577:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_io: allocate 64 new 524288-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1783441339.560510:0:6577:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 0 min 3 max 116 00000100:00100000:3.0:1783441339.560515:0:6577:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_io00_000' 00000100:00100000:3.0:1783441339.562638:0:6577:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 1 min 3 max 116 00000100:00100000:3.0:1783441339.562654:0:6577:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_io00_001' 00000100:00100000:3.0:1783441339.566097:0:6577:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 2 min 3 max 116 00000100:00100000:3.0:1783441339.566128:0:6577:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_io00_002' 00000100:00100000:3.0:1783441339.573365:0:6577:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_seq: allocate 64 new 32768-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1783441339.573587:0:6577:0:(service.c:3462:ptlrpc_start_thread()) ost_seq[0] started 0 min 2 max 16 00000100:00100000:3.0:1783441339.573593:0:6577:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_seq00_000' 00000100:00100000:3.0:1783441339.576674:0:6577:0:(service.c:3462:ptlrpc_start_thread()) ost_seq[0] started 1 min 2 max 16 00000100:00100000:3.0:1783441339.576690:0:6577:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_seq00_001' 00000100:00100000:0.0:1783441339.641193:0:6577:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_out: allocate 64 new 1048576-byte reqbufs (0/64 left), rc = 0 00000100:00100000:0.0:1783441339.641437:0:6577:0:(service.c:3462:ptlrpc_start_thread()) ost_out[0] started 0 min 2 max 16 00000100:00100000:0.0:1783441339.641444:0:6577:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_out00_000' 00000100:00100000:0.0:1783441339.643795:0:6577:0:(service.c:3462:ptlrpc_start_thread()) ost_out[0] started 1 min 2 max 16 00000100:00100000:0.0:1783441339.643818:0:6577:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_out00_001' 00000020:00000080:3.0:1783441339.644559:0:6577:0:(obd_config.c:826:class_setup()) finished setup of obd OSS (uuid OSS_uuid) 00000020:01000004:3.0:1783441339.644582:0:6577:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for lustre-ost1/ost1 10000000:01000000:3.0:1783441339.644589:0:6577:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.201.113@tcp: cl_mgc_mutex lustre-OST0000-osd for locked: rc = 0 00000040:01000000:2.0:1783441339.671132:0:6577:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.201.113@tcp ctxt 0 is initialized 00000020:01000004:2.0:1783441339.671166:0:6577:0:(tgt_mount.c:1418:server_register_target()) Registration lustre-OST0000, fs=lustre, 192.168.201.113@tcp, index=0000, flags=0x20062 00000020:01000004:2.0:1783441339.671170:0:6577:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:2.0:1783441339.671172:0:6577:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:2.0:1783441339.671174:0:6577:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1783441339.671175:0:6577:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1783441339.671176:0:6577:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1783441339.671177:0:6577:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1783441339.671178:0:6577:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1783441339.671180:0:6577:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:2.0:1783441339.671181:0:6577:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:2.0:1783441339.671183:0:6577:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1783441339.671184:0:6577:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:2.0:1783441339.671187:0:6577:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0000 0x10020062 00000020:01000004:2.0:1783441339.671189:0:6577:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:2.0:1783441339.671190:0:6577:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:2.0:1783441339.671192:0:6577:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1783441339.671193:0:6577:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1783441339.671194:0:6577:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1783441339.671195:0:6577:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1783441339.671199:0:6577:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1783441339.671200:0:6577:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:2.0:1783441339.671200:0:6577:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:2.0:1783441339.671201:0:6577:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1783441339.671202:0:6577:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:2.0:1783441339.671226:0:6577:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0000 00000100:00100000:2.0:1783441339.671242:0:6577:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@00000000074ee1cc pname:cluuid:pid:xid:nid:opc:job mount.lustre:6c1ddb50-5795-40c6-a2b6-8f58add9da62:6577:1870073693212928:0@lo:253: 00000100:00100000:2.0:1783441339.671309:0:6577:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783441339.671562:0:6577:0:(client.c:2702:ptlrpc_set_wait()) set 0000000054218680 going to sleep for 11 seconds 00000100:00100000:3.0:1783441339.671844:0:5779:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073693212928 00000100:00100000:3.0:1783441339.671852:0:5779:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073693212928 00000100:00100000:3.0:1783441339.671911:0:5779:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:3.0:1783441339.671920:0:5779:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000002b6ee832 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6c1ddb50-5795-40c6-a2b6-8f58add9da62+11:6577:x1870073693212928:12345-0@lo:253: 20000000:01000000:3.0:1783441339.671950:0:5779:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 0 is registered to MGS. 20000000:01000000:3.0:1783441339.671954:0:5779:0:(mgs_handler.c:599:mgs_target_reg()) updating lustre-OST0000, index=0 20000000:01000000:3.0:1783441339.671959:0:5779:0:(mgs_llog.c:869:mgs_set_index()) Set index for lustre-OST0000 to 0 20000000:01000000:3.0:1783441339.671963:0:5779:0:(mgs_llog.c:3858:mgs_write_log_ost()) writing new ost lustre-OST0000 00000040:00080000:3.0:1783441339.672973:0:5779:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1783441339.673194:0:5779:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].1, 224 off8416 20000000:01000000:3.0:1783441339.673210:0:5779:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0000 0xcf001 obdfilter lustre-OST0000_UUID (null) (null) 00000040:00080000:3.0:1783441339.673272:0:5779:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].2, 128 off8544 20000000:01000000:3.0:1783441339.673282:0:5779:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0000 0xcf003 dev type f (null) 00000040:00080000:3.0:1783441339.673315:0:5779:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].3, 112 off8656 00000040:00080000:3.0:1783441339.673374:0:5779:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].4, 224 off8880 00000040:00080000:3.0:1783441339.673720:0:5779:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].16, 224 off11152 20000000:01000000:3.0:1783441339.673738:0:5779:0:(mgs_llog.c:3811:mgs_write_log_osc_to_lov()) add nid 192.168.201.113@tcp 20000000:01000000:3.0:1783441339.673764:0:5779:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf005 192.168.201.113@tcp (null) (null) (null) 00000040:00080000:3.0:1783441339.673797:0:5779:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].17, 88 off11240 20000000:01000000:3.0:1783441339.673804:0:5779:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0000-osc-MDT0000 0xcf001 osc lustre-MDT0000-mdtlov_UUID (null) (null) 00000040:00080000:3.0:1783441339.673844:0:5779:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].18, 144 off11384 20000000:01000000:3.0:1783441339.673852:0:5779:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0000-osc-MDT0000 0xcf003 lustre-OST0000_UUID 192.168.201.113@tcp (null) (null) 00000040:00080000:3.0:1783441339.673882:0:5779:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].19, 152 off11536 20000000:01000000:3.0:1783441339.673904:0:5779:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0000-mdtlov 0xcf00d lustre-OST0000_UUID 0 1 (null) 00000040:00080000:3.0:1783441339.673937:0:5779:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].20, 136 off11672 00000040:00080000:3.0:1783441339.674006:0:5779:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].21, 224 off11896 00000040:00080000:3.0:1783441339.674689:0:5779:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].21, 224 off11952 20000000:01000000:3.0:1783441339.674706:0:5779:0:(mgs_llog.c:3811:mgs_write_log_osc_to_lov()) add nid 192.168.201.113@tcp 20000000:01000000:3.0:1783441339.674708:0:5779:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf005 192.168.201.113@tcp (null) (null) (null) 00000040:00080000:3.0:1783441339.674773:0:5779:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].22, 88 off12040 20000000:01000000:3.0:1783441339.674782:0:5779:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0000-osc 0xcf001 osc lustre-clilov_UUID (null) (null) 00000040:00080000:3.0:1783441339.674813:0:5779:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].23, 128 off12168 20000000:01000000:3.0:1783441339.674821:0:5779:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0000-osc 0xcf003 lustre-OST0000_UUID 192.168.201.113@tcp (null) (null) 00000040:00080000:3.0:1783441339.674867:0:5779:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].24, 144 off12312 20000000:01000000:3.0:1783441339.674875:0:5779:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-clilov 0xcf00d lustre-OST0000_UUID 0 1 (null) 00000040:00080000:3.0:1783441339.675596:0:5779:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].25, 128 off12440 00000040:00080000:3.0:1783441339.675701:0:5779:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].26, 224 off12664 20000000:01000000:3.0:1783441339.675721:0:5779:0:(mgs_llog.c:5248:mgs_write_log_target()) remaining string: ' autodegrade=on ', param: 'sys.timeout=20' 20000000:01000000:3.0:1783441339.675724:0:5779:0:(mgs_llog.c:4744:mgs_write_log_param()) next param 'sys.timeout=20' 20000000:01000000:3.0:1783441339.675727:0:5779:0:(mgs_llog.c:4177:mgs_write_log_sys()) global 'sys.timeout=20' val=20 20000000:01000000:3.0:1783441339.675767:0:5779:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping . 20000000:01000000:3.0:1783441339.675770:0:5779:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping .. 20000000:01000000:3.0:1783441339.675963:0:5779:0:(mgs_llog.c:2546:mgs_write_log_direct_all()) Changing log lustre-OST0000 20000000:01000000:3.0:1783441339.675966:0:5779:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-OST0000/lustre/sys.timeout fl=4 00000040:00080000:0.0:1783441339.677040:0:6593:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 5 count 5 00000040:00080000:3.0:1783441339.677376:0:5779:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].5, 224 off9104 00000040:00080000:3.0:1783441339.677418:0:5779:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].6, 80 off9184 00000040:00080000:3.0:1783441339.677504:0:5779:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].7, 224 off9408 20000000:01000000:3.0:1783441339.677518:0:5779:0:(mgs_llog.c:2546:mgs_write_log_direct_all()) Changing log lustre-client 20000000:01000000:3.0:1783441339.677521:0:5779:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-client/lustre/sys.timeout fl=4 20000000:01000000:1.0:1783441339.683277:0:6594:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 18 marker 9 1->4: lustre sys.timeout 20000000:01000000:1.0:1783441339.683375:0:6594:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 20 marker 9 2->4: lustre sys.timeout 00000040:00080000:1.0:1783441339.683426:0:6594:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 27 count 27 00000040:00080000:3.0:1783441339.684296:0:5779:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].27, 224 off12888 00000040:00080000:3.0:1783441339.684342:0:5779:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].28, 80 off12968 00000040:00080000:3.0:1783441339.684380:0:5779:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].29, 224 off13192 20000000:01000000:3.0:1783441339.684392:0:5779:0:(mgs_llog.c:2546:mgs_write_log_direct_all()) Changing log lustre-MDT0000 20000000:01000000:3.0:1783441339.684395:0:5779:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-MDT0000/lustre/sys.timeout fl=4 20000000:01000000:1.0:1783441339.692801:0:6595:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 13 marker 10 1->4: lustre sys.timeout 20000000:01000000:1.0:1783441339.692923:0:6595:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 15 marker 10 2->4: lustre sys.timeout 00000040:00080000:1.0:1783441339.692987:0:6595:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 22 count 22 00000040:00080000:3.0:1783441339.693871:0:5779:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].22, 224 off12120 00000040:00080000:3.0:1783441339.694243:0:5779:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].23, 80 off12200 00000040:00080000:3.0:1783441339.694324:0:5779:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].24, 224 off12424 20000000:01000000:3.0:1783441339.694341:0:5779:0:(mgs_llog.c:5248:mgs_write_log_target()) remaining string: ' ', param: 'autodegrade=on' 20000000:01000000:3.0:1783441339.694343:0:5779:0:(mgs_llog.c:4744:mgs_write_log_param()) next param 'autodegrade=on' 10000000:01000000:3.0:1783441339.694367:0:5779:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x0 (lustre) 00010000:00010000:3.0:1783441339.694385:0:5779:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: 000000002ec9816f/0xa2426164df2c7552 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 5779 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783441339.694409:0:5779:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: 000000000f13d6dc/0xa2426164df2c7479 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xa2426164df2c7472 expref: 11 pid: 5779 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783441339.694415:0:5779:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: 00000000c5d6d16a/0xa2426164df2c7495 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xa2426164df2c748e expref: 11 pid: 5780 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783441339.694421:0:5779:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: 00000000b3b22329/0xa2426164df2c7505 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xa2426164df2c74fe expref: 11 pid: 5779 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783441339.694427:0:5779:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: 000000002ec9816f/0xa2426164df2c7552 lrc: 6/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 5779 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783441339.694471:0:5779:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: 00000000b3b22329/0xa2426164df2c7505 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xa2426164df2c74fe expref: 11 pid: 5779 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783441339.694489:0:5779:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: 00000000b3b22329/0xa2426164df2c7505 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xa2426164df2c74fe expref: 11 pid: 5779 timeout: 327 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783441339.694504:0:5779:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@0000000071683d47 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0001:MGS:5779:1870073693213056:0@lo:104: 00000100:00100000:3.0:1783441339.694573:0:5779:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1783441339.694634:0:5779:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: 00000000c5d6d16a/0xa2426164df2c7495 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xa2426164df2c748e expref: 11 pid: 5780 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783441339.694642:0:5779:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: 00000000c5d6d16a/0xa2426164df2c7495 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xa2426164df2c748e expref: 11 pid: 5780 timeout: 327 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783441339.694649:0:5779:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@000000009d1a7b83 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0001:MGS:5779:1870073693213184:0@lo:104: 00000100:00100000:3.0:1783441339.694678:0:5779:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1783441339.694710:0:5779:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: 000000000f13d6dc/0xa2426164df2c7479 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xa2426164df2c7472 expref: 11 pid: 5779 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783441339.694718:0:5779:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: 000000000f13d6dc/0xa2426164df2c7479 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xa2426164df2c7472 expref: 11 pid: 5779 timeout: 327 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783441339.694726:0:5779:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@000000002e982c95 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0001:MGS:5779:1870073693213312:0@lo:104: 00000100:00100000:3.0:1783441339.694793:0:5779:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783441339.694803:0:5779:0:(client.c:2702:ptlrpc_set_wait()) set 00000000c5fff1bc going to sleep for 11 seconds 00000100:00100000:0.0:1783441339.694921:0:5768:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073693213056 00000100:00100000:0.0:1783441339.694940:0:5768:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073693213056 00000100:00100000:0.0:1783441339.694988:0:5768:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073693213184 00000100:00100000:0.0:1783441339.694991:0:5768:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073693213184 00000100:00100000:0.0:1783441339.694999:0:5768:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073693213312 00000100:00100000:0.0:1783441339.695001:0:5768:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073693213312 00000100:00100000:0.0:1783441339.695013:0:5768:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1783441339.695019:0:5768:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000055038395 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:6c1ddb50-5795-40c6-a2b6-8f58add9da62+5:5779:x1870073693213056:12345-0@lo:104: 00010000:00010000:0.0:1783441339.695032:0:5768:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.113@tcp lock: 00000000eda5d318/0xa2426164df2c74fe lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xa2426164df2c7505 expref: -99 pid: 5765 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783441339.695090:0:5768:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:0.0:1783441339.695095:0:5768:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000055038395 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:6c1ddb50-5795-40c6-a2b6-8f58add9da62+5:5779:x1870073693213056:12345-0@lo:104: Request processed in 76us (523us total) trans 0 rc 0/0 00000100:00100000:0.0:1783441339.695102:0:5768:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1783441339.695116:0:5768:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1783441339.695121:0:5768:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000000ed50cf3 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:6c1ddb50-5795-40c6-a2b6-8f58add9da62+4:5779:x1870073693213184:12345-0@lo:104: 00010000:00010000:0.0:1783441339.695137:0:5768:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.113@tcp lock: 00000000bc193132/0xa2426164df2c748e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xa2426164df2c7495 expref: -99 pid: 5765 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783441339.695166:0:5768:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:0.0:1783441339.695169:0:5768:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000000ed50cf3 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:6c1ddb50-5795-40c6-a2b6-8f58add9da62+4:5779:x1870073693213184:12345-0@lo:104: Request processed in 49us (492us total) trans 0 rc 0/0 00000100:00100000:0.0:1783441339.695175:0:5768:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1783441339.695186:0:5768:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:0.0:1783441339.695191:0:5768:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000b6aba2de pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:6c1ddb50-5795-40c6-a2b6-8f58add9da62+3:5779:x1870073693213312:12345-0@lo:104: 00010000:00010000:0.0:1783441339.695197:0:5768:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.113@tcp lock: 000000008550020f/0xa2426164df2c7472 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xa2426164df2c7479 expref: -99 pid: 5765 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783441339.695217:0:5768:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to priority blp list, 3 blwis in pool 00000100:00100000:0.0:1783441339.695225:0:5768:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000b6aba2de pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:6c1ddb50-5795-40c6-a2b6-8f58add9da62+3:5779:x1870073693213312:12345-0@lo:104: Request processed in 35us (442us total) trans 0 rc 0/0 00000100:00100000:0.0:1783441339.695231:0:5768:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00010000:00010000:0.0:1783441339.695246:0:5772:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:0.0:1783441339.695250:0:5772:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.113@tcp lock: 00000000eda5d318/0xa2426164df2c74fe lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xa2426164df2c7505 expref: -99 pid: 5765 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783441339.695258:0:5772:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 00000000eda5d318 already unused, calling callback (0000000040a0c5f3) 10000000:00010000:0.0:1783441339.695261:0:5772:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.113@tcp lock: 00000000eda5d318/0xa2426164df2c74fe lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0xa2426164df2c7505 expref: -99 pid: 5765 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783441339.695268:0:5772:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.113@tcp lock: 00000000eda5d318/0xa2426164df2c74fe lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0xa2426164df2c7505 expref: -99 pid: 5765 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1783441339.695274:0:5772:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.113@tcp lock: 00000000eda5d318/0xa2426164df2c74fe lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0xa2426164df2c7505 expref: -99 pid: 5765 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1783441339.695281:0:5772:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:0.0:1783441339.695308:0:5772:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.113@tcp lock: 00000000eda5d318/0xa2426164df2c74fe lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xa2426164df2c7505 expref: -99 pid: 5765 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783441339.695315:0:5772:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1783441339.695338:0:5772:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.113@tcp lock: 00000000eda5d318/0xa2426164df2c74fe lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xa2426164df2c7505 expref: -99 pid: 5765 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783441339.695344:0:5772:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.113@tcp lock: 00000000eda5d318/0xa2426164df2c74fe lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xa2426164df2c7505 expref: -99 pid: 5765 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783441339.695357:0:5772:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1783441339.695359:0:5772:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.113@tcp lock: 00000000bc193132/0xa2426164df2c748e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xa2426164df2c7495 expref: -99 pid: 5765 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783441339.695375:0:5772:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 00000000bc193132 already unused, calling callback (0000000040a0c5f3) 10000000:00010000:0.0:1783441339.695377:0:5772:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.113@tcp lock: 00000000bc193132/0xa2426164df2c748e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0xa2426164df2c7495 expref: -99 pid: 5765 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783441339.695383:0:5772:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.113@tcp lock: 00000000bc193132/0xa2426164df2c748e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0xa2426164df2c7495 expref: -99 pid: 5765 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1783441339.695387:0:5772:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.113@tcp lock: 00000000bc193132/0xa2426164df2c748e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0xa2426164df2c7495 expref: -99 pid: 5765 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1783441339.695392:0:5772:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:0.0:1783441339.695404:0:5772:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.113@tcp lock: 00000000bc193132/0xa2426164df2c748e lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xa2426164df2c7495 expref: -99 pid: 5765 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783441339.695410:0:5772:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1783441339.695422:0:5772:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.113@tcp lock: 00000000bc193132/0xa2426164df2c748e lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xa2426164df2c7495 expref: -99 pid: 5765 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783441339.695428:0:5772:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.113@tcp lock: 00000000bc193132/0xa2426164df2c748e lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xa2426164df2c7495 expref: -99 pid: 5765 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783441339.695437:0:5772:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1783441339.695439:0:5772:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.113@tcp lock: 000000008550020f/0xa2426164df2c7472 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xa2426164df2c7479 expref: -99 pid: 5765 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783441339.695444:0:5772:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 000000008550020f already unused, calling callback (0000000040a0c5f3) 10000000:00010000:0.0:1783441339.695446:0:5772:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.113@tcp lock: 000000008550020f/0xa2426164df2c7472 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xa2426164df2c7479 expref: -99 pid: 5765 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783441339.695461:0:5772:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.113@tcp lock: 000000008550020f/0xa2426164df2c7472 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xa2426164df2c7479 expref: -99 pid: 5765 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1783441339.695467:0:5772:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.113@tcp lock: 000000008550020f/0xa2426164df2c7472 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xa2426164df2c7479 expref: -99 pid: 5765 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1783441339.695472:0:5772:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:0.0:1783441339.695482:0:5772:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.113@tcp lock: 000000008550020f/0xa2426164df2c7472 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xa2426164df2c7479 expref: -99 pid: 5765 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783441339.695487:0:5772:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1783441339.695491:0:5772:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.113@tcp lock: 000000008550020f/0xa2426164df2c7472 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xa2426164df2c7479 expref: -99 pid: 5765 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783441339.695497:0:5772:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.113@tcp lock: 000000008550020f/0xa2426164df2c7472 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xa2426164df2c7479 expref: -99 pid: 5765 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783441339.695510:0:5772:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783441339.695512:0:5772:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783441339.695513:0:5772:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1783441339.695529:0:3305:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1783441339.695539:0:3305:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@0000000060c4f53b pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:6c1ddb50-5795-40c6-a2b6-8f58add9da62:3305:1870073693213440:0@lo:103: 00000100:00100000:0.0:1783441339.695568:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783441339.695599:0:3303:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@0000000066bbf0b5 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:6c1ddb50-5795-40c6-a2b6-8f58add9da62:3303:1870073693213568:0@lo:103: 00000100:00100000:0.0:1783441339.695617:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783441339.695630:0:3303:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1783441339.695634:0:3303:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@0000000046270c4a pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:6c1ddb50-5795-40c6-a2b6-8f58add9da62:3303:1870073693213696:0@lo:103: 00000100:00100000:0.0:1783441339.695650:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783441339.695684:0:5771:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073693213440 00000100:00100000:0.0:1783441339.695689:0:5771:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073693213440 00010000:00010000:0.0:1783441339.695706:0:5771:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: 00000000b3b22329/0xa2426164df2c7505 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xa2426164df2c74fe expref: 12 pid: 5779 timeout: 327 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783441339.695720:0:5771:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073693213568 00000100:00100000:0.0:1783441339.695722:0:5771:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073693213568 00010000:00010000:0.0:1783441339.695729:0:5771:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: 00000000c5d6d16a/0xa2426164df2c7495 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xa2426164df2c748e expref: 13 pid: 5780 timeout: 327 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783441339.695738:0:5771:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073693213696 00000100:00100000:0.0:1783441339.695764:0:5771:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073693213696 00010000:00010000:0.0:1783441339.695773:0:5771:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: 000000000f13d6dc/0xa2426164df2c7479 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xa2426164df2c7472 expref: 14 pid: 5779 timeout: 327 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783441339.695784:0:5771:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1783441339.695789:0:5771:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000b707f376 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:6c1ddb50-5795-40c6-a2b6-8f58add9da62+14:3305:x1870073693213440:12345-0@lo:103: 00010000:00010000:0.0:1783441339.695798:0:5771:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1783441339.695802:0:5771:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: 00000000b3b22329/0xa2426164df2c7505 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xa2426164df2c74fe expref: 14 pid: 5779 timeout: 327 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783441339.695824:0:5771:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: 00000000b3b22329/0xa2426164df2c7505 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xa2426164df2c74fe expref: 14 pid: 5779 timeout: 327 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783441339.695839:0:5771:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1783441339.695863:0:5771:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000b707f376 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:6c1ddb50-5795-40c6-a2b6-8f58add9da62+14:3305:x1870073693213440:12345-0@lo:103: Request processed in 74us (295us total) trans 0 rc 0/0 00000100:00100000:0.0:1783441339.695869:0:5771:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1783441339.695880:0:5771:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1783441339.695898:0:5771:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000001f8e40d2 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:6c1ddb50-5795-40c6-a2b6-8f58add9da62+13:3303:x1870073693213568:12345-0@lo:103: 00010000:00010000:0.0:1783441339.695904:0:5771:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1783441339.695913:0:5771:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: 00000000c5d6d16a/0xa2426164df2c7495 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xa2426164df2c748e expref: 13 pid: 5780 timeout: 327 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783441339.695920:0:5771:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: 00000000c5d6d16a/0xa2426164df2c7495 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xa2426164df2c748e expref: 13 pid: 5780 timeout: 327 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783441339.695928:0:5771:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1783441339.695952:0:5771:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000001f8e40d2 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:6c1ddb50-5795-40c6-a2b6-8f58add9da62+13:3303:x1870073693213568:12345-0@lo:103: Request processed in 67us (334us total) trans 0 rc 0/0 00000100:00100000:0.0:1783441339.695957:0:5771:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1783441339.695969:0:5771:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:0.0:1783441339.695974:0:5771:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000001f1adf2c pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:6c1ddb50-5795-40c6-a2b6-8f58add9da62+12:3303:x1870073693213696:12345-0@lo:103: 00010000:00010000:0.0:1783441339.695980:0:5771:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1783441339.695983:0:5771:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: 000000000f13d6dc/0xa2426164df2c7479 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xa2426164df2c7472 expref: 12 pid: 5779 timeout: 327 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783441339.695990:0:5771:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: 000000000f13d6dc/0xa2426164df2c7479 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xa2426164df2c7472 expref: 12 pid: 5779 timeout: 327 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783441339.696000:0:5771:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: 000000002ec9816f/0xa2426164df2c7552 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 5779 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783441339.696007:0:5771:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 000000002ec9816f/0xa2426164df2c7552 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 5779 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783441339.696019:0:5771:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: 000000002ec9816f/0xa2426164df2c7552 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 5779 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783441339.696026:0:5771:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: 000000002ec9816f/0xa2426164df2c7552 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5779 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783441339.696032:0:5771:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: 000000002ec9816f/0xa2426164df2c7552 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5779 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783441339.696043:0:5771:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: 000000002ec9816f/0xa2426164df2c7552 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5779 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783441339.696048:0:5771:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 000000002ec9816f already unused, calling callback (000000003281bd88) 00010000:00010000:0.0:1783441339.696051:0:5771:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: 000000002ec9816f/0xa2426164df2c7552 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5779 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783441339.696058:0:5771:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: 000000002ec9816f/0xa2426164df2c7552 lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 5779 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783441339.696065:0:5771:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: 000000002ec9816f/0xa2426164df2c7552 lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5779 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783441339.696074:0:5771:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1783441339.696093:0:5771:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000001f1adf2c pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:6c1ddb50-5795-40c6-a2b6-8f58add9da62+12:3303:x1870073693213696:12345-0@lo:103: Request processed in 120us (443us total) trans 0 rc 0/0 00000100:00100000:0.0:1783441339.696099:0:5771:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:0.0:1783441339.696138:0:3305:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@0000000060c4f53b pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:6c1ddb50-5795-40c6-a2b6-8f58add9da62:3305:1870073693213440:0@lo:103: 00000100:00100000:0.0:1783441339.696161:0:3303:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@0000000046270c4a pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:6c1ddb50-5795-40c6-a2b6-8f58add9da62:3303:1870073693213696:0@lo:103: 00000100:00100000:0.0:1783441339.696169:0:3303:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@0000000066bbf0b5 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:6c1ddb50-5795-40c6-a2b6-8f58add9da62:3303:1870073693213568:0@lo:103: 00010000:00010000:3.0:1783441339.696516:0:5773:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783441339.696537:0:5779:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 00000000b3b22329/0xa2426164df2c7505 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xa2426164df2c74fe expref: 11 pid: 5779 timeout: 327 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783441339.696548:0:5779:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@0000000071683d47 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0001:MGS:5779:1870073693213056:0@lo:104: 00010000:00010000:3.0:1783441339.696557:0:5779:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 00000000c5d6d16a/0xa2426164df2c7495 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xa2426164df2c748e expref: 10 pid: 5780 timeout: 327 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783441339.696564:0:5779:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@000000009d1a7b83 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0001:MGS:5779:1870073693213184:0@lo:104: 00010000:00010000:3.0:1783441339.696571:0:5779:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 000000000f13d6dc/0xa2426164df2c7479 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xa2426164df2c7472 expref: 9 pid: 5779 timeout: 327 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783441339.696580:0:5779:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@000000002e982c95 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0001:MGS:5779:1870073693213312:0@lo:104: 00010000:00010000:3.0:1783441339.696597:0:5779:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: 000000002ec9816f/0xa2426164df2c7552 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5779 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783441339.696605:0:5779:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: 000000002ec9816f/0xa2426164df2c7552 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5779 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783441339.696611:0:5779:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: 000000002ec9816f/0xa2426164df2c7552 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5779 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783441339.696624:0:5779:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 000000002ec9816f/0xa2426164df2c7552 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5779 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:3.0:1783441339.696637:0:5779:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0000, index=0, rc=0 00000100:00100000:0.0:1783441339.770097:0:5779:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000002b6ee832 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6c1ddb50-5795-40c6-a2b6-8f58add9da62+8:6577:x1870073693212928:12345-0@lo:253: Request processed in 98169us (98779us total) trans 0 rc 0/0 00000100:00100000:0.0:1783441339.770115:0:5779:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:2.0:1783441339.770285:0:6577:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@00000000074ee1cc pname:cluuid:pid:xid:nid:opc:job mount.lustre:6c1ddb50-5795-40c6-a2b6-8f58add9da62:6577:1870073693212928:0@lo:253: 10000000:01000000:2.0:1783441339.770422:0:6577:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0000 got index = 0 00000020:01000004:2.0:1783441339.770425:0:6577:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:2.0:1783441339.770427:0:6577:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:2.0:1783441339.770428:0:6577:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1783441339.770430:0:6577:0:(tgt_mount.c:1178:server_mti_print()) uuid: lustre-OST0000_UUID 00000020:01000004:2.0:1783441339.770431:0:6577:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1783441339.770432:0:6577:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1783441339.770434:0:6577:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1783441339.770435:0:6577:0:(tgt_mount.c:1196:server_mti_print()) LDD_F_REWRITE_LDD 00000020:01000004:2.0:1783441339.770437:0:6577:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1783441339.770438:0:6577:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:2.0:1783441339.770461:0:6577:0:(tgt_mount.c:101:server_register_mount()) register mount 00000000dafcae11 from lustre-OST0000 10000000:01000000:2.0:1783441339.770490:0:6577:0:(mgc_request.c:1943:mgc_process_config()) parse_log lustre-OST0000 from 0 10000000:01000000:2.0:1783441339.770492:0:6577:0:(mgc_request.c:329:config_log_add()) add config log lustre-OST0000-0000000000000000 10000000:01000000:2.0:1783441339.770500:0:6577:0:(mgc_request_server.c:874:mgc_get_local_copy()) Get log lustre-sptlrpc-ffff91a84767cd40 local copy 10000000:01000000:2.0:1783441339.770504:0:6577:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:2.0:1783441339.770543:0:6577:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.113@tcp lock: 0000000002951a15/0xa2426164df2c7559 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6577 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783441339.770554:0:6577:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x0 ns: MGC192.168.201.113@tcp lock: 0000000002951a15/0xa2426164df2c7559 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6577 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783441339.770564:0:6577:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.113@tcp lock: 0000000002951a15/0xa2426164df2c7559 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6577 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783441339.770607:0:6577:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@00000000074ee1cc pname:cluuid:pid:xid:nid:opc:job mount.lustre:6c1ddb50-5795-40c6-a2b6-8f58add9da62:6577:1870073693213824:0@lo:101: 00000100:00100000:2.0:1783441339.770652:0:6577:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783441339.770770:0:6577:0:(client.c:2702:ptlrpc_set_wait()) set 000000006bf7aa2f going to sleep for 11 seconds 00000100:00100000:1.0:1783441339.770924:0:5778:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073693213824 00000100:00100000:1.0:1783441339.771079:0:5778:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073693213824 00000100:00100000:1.0:1783441339.771231:0:5778:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:1.0:1783441339.771240:0:5778:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000007f0c8b0 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6c1ddb50-5795-40c6-a2b6-8f58add9da62+8:6577:x1870073693213824:12345-0@lo:101: 00010000:00010000:1.0:1783441339.771254:0:5778:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1783441339.771269:0:5778:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 00000000455653ba/0xa2426164df2c7560 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xa2426164df2c7559 expref: -99 pid: 5778 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783441339.771305:0:5778:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000455653ba/0xa2426164df2c7560 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xa2426164df2c7559 expref: 9 pid: 5778 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783441339.771314:0:5778:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 00000000455653ba/0xa2426164df2c7560 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xa2426164df2c7559 expref: 9 pid: 5778 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783441339.771323:0:5778:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 00000000455653ba, rc 0) 00000100:00100000:1.0:1783441339.771372:0:5778:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000007f0c8b0 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6c1ddb50-5795-40c6-a2b6-8f58add9da62+9:6577:x1870073693213824:12345-0@lo:101: Request processed in 134us (720us total) trans 0 rc 0/0 00000100:00100000:1.0:1783441339.771387:0:5778:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:2.0:1783441339.771457:0:6577:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@00000000074ee1cc pname:cluuid:pid:xid:nid:opc:job mount.lustre:6c1ddb50-5795-40c6-a2b6-8f58add9da62:6577:1870073693213824:0@lo:101: 00010000:00010000:2.0:1783441339.771470:0:6577:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.113@tcp lock: 0000000002951a15/0xa2426164df2c7559 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0xa2426164df2c7560 expref: -99 pid: 6577 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783441339.771478:0:6577:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.113@tcp lock: 0000000002951a15/0xa2426164df2c7559 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0xa2426164df2c7560 expref: -99 pid: 6577 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783441339.771590:0:6577:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@00000000074ee1cc pname:cluuid:pid:xid:nid:opc:job mount.lustre:6c1ddb50-5795-40c6-a2b6-8f58add9da62:6577:1870073693213952:0@lo:501: 00000100:00100000:2.0:1783441339.771619:0:6577:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783441339.784967:0:6577:0:(client.c:2702:ptlrpc_set_wait()) set 000000006bf7aa2f going to sleep for 11 seconds 00000100:00100000:0.0:1783441339.795947:0:5780:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073693213952 00000100:00100000:0.0:1783441339.795967:0:5780:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073693213952 00000100:00100000:0.0:1783441339.796051:0:5780:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:0.0:1783441339.796060:0:5780:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000006497096a pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6c1ddb50-5795-40c6-a2b6-8f58add9da62+9:6577:x1870073693213952:12345-0@lo:501: 00000100:00100000:0.0:1783441339.799231:0:5780:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000006497096a pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6c1ddb50-5795-40c6-a2b6-8f58add9da62+9:6577:x1870073693213952:12345-0@lo:501: Request processed in 3161us (27601us total) trans 0 rc -2/-2 00000100:00100000:0.0:1783441339.799248:0:5780:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:2.0:1783441339.799297:0:6577:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@00000000074ee1cc pname:cluuid:pid:xid:nid:opc:job mount.lustre:6c1ddb50-5795-40c6-a2b6-8f58add9da62:6577:1870073693213952:0@lo:501: 10000000:01000000:2.0:1783441339.799325:0:6577:0:(mgc_request_server.c:765:mgc_llog_local_copy()) MGC192.168.201.113@tcp: no remote llog for lustre-sptlrpc, check MGS config 10000000:01000000:2.0:1783441339.799385:0:6577:0:(mgc_request_server.c:897:mgc_get_local_copy()) MGC192.168.201.113@tcp: can't save local copy of 'lustre-sptlrpc': rc = -2. 00010000:00010000:2.0:1783441339.799394:0:6577:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.113@tcp lock: 0000000002951a15/0xa2426164df2c7559 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0xa2426164df2c7560 expref: -99 pid: 6577 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783441339.799406:0:6577:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.113@tcp lock: 0000000002951a15/0xa2426164df2c7559 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000400000000 nid: local remote: 0xa2426164df2c7560 expref: -99 pid: 6577 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783441339.799412:0:6577:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.201.113@tcp lock: 0000000002951a15/0xa2426164df2c7559 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000400000000 nid: local remote: 0xa2426164df2c7560 expref: -99 pid: 6577 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783441339.799431:0:6577:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:2.0:1783441339.799477:0:6577:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff91a867cf2000 10000000:01000000:2.0:1783441339.799483:0:6577:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:2.0:1783441339.799488:0:6577:0:(mgc_request.c:194:do_config_log_add()) do adding config log nodemap-ffff91a84767cd40 10000000:01000000:2.0:1783441339.799490:0:6577:0:(mgc_request.c:68:mgc_name2resid()) log nodemap to resid 0x70616d65646f6e/0x4 (nodemap) 10000000:01000000:2.0:1783441339.799493:0:6577:0:(mgc_request.c:1801:mgc_process_log()) Process log nodemap-ffff91a84767cd40 from 1 10000000:01000000:2.0:1783441339.799496:0:6577:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for nodemap (res 0x70616d65646f6e) 00010000:00010000:2.0:1783441339.799532:0:6577:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.113@tcp lock: 000000002d393ce2/0xa2426164df2c7567 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6577 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783441339.799541:0:6577:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.113@tcp lock: 000000002d393ce2/0xa2426164df2c7567 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6577 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783441339.799550:0:6577:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.113@tcp lock: 000000002d393ce2/0xa2426164df2c7567 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6577 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783441339.799569:0:6577:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@00000000074ee1cc pname:cluuid:pid:xid:nid:opc:job mount.lustre:6c1ddb50-5795-40c6-a2b6-8f58add9da62:6577:1870073693214080:0@lo:101: 00010000:00010000:0.0:1783441339.799589:0:5772:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1783441339.799594:0:5772:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.113@tcp lock: 0000000002951a15/0xa2426164df2c7559 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x400000000 nid: local remote: 0xa2426164df2c7560 expref: -99 pid: 6577 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783441339.799602:0:5772:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 0000000002951a15 already unused, calling callback (0000000040a0c5f3) 00000100:00100000:2.0:1783441339.799603:0:6577:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 10000000:00010000:0.0:1783441339.799605:0:5772:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.113@tcp lock: 0000000002951a15/0xa2426164df2c7559 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x400000000 nid: local remote: 0xa2426164df2c7560 expref: -99 pid: 6577 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783441339.799613:0:5772:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.113@tcp lock: 0000000002951a15/0xa2426164df2c7559 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x8400000000 nid: local remote: 0xa2426164df2c7560 expref: -99 pid: 6577 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1783441339.799619:0:5772:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.113@tcp lock: 0000000002951a15/0xa2426164df2c7559 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x9400000000 nid: local remote: 0xa2426164df2c7560 expref: -99 pid: 6577 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1783441339.799624:0:5772:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00000100:00100000:2.0:1783441339.799638:0:6577:0:(client.c:2702:ptlrpc_set_wait()) set 00000000e58762b2 going to sleep for 11 seconds 00010000:00010000:0.0:1783441339.799642:0:5772:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.113@tcp lock: 0000000002951a15/0xa2426164df2c7559 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x4809400000020 nid: local remote: 0xa2426164df2c7560 expref: -99 pid: 6577 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783441339.799647:0:5772:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1783441339.799665:0:5772:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.113@tcp lock: 0000000002951a15/0xa2426164df2c7559 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x4809400000020 nid: local remote: 0xa2426164df2c7560 expref: -99 pid: 6577 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783441339.799672:0:5772:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.113@tcp lock: 0000000002951a15/0xa2426164df2c7559 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x4809400000020 nid: local remote: 0xa2426164df2c7560 expref: -99 pid: 6577 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783441339.799678:0:3305:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@0000000066bbf0b5 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:6c1ddb50-5795-40c6-a2b6-8f58add9da62:3305:1870073693214208:0@lo:103: 00010000:00010000:0.0:1783441339.799686:0:5772:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783441339.799688:0:5772:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783441339.799695:0:5772:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1783441339.799704:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783441339.799709:0:5780:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073693214080 00000100:00100000:0.0:1783441339.799714:0:5780:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073693214080 00000100:00100000:2.0:1783441339.799753:0:5771:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073693214208 00000100:00100000:2.0:1783441339.799757:0:5771:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073693214208 00000100:00100000:0.0:1783441339.799772:0:5780:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:0.0:1783441339.799779:0:5780:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000001aa64703 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6c1ddb50-5795-40c6-a2b6-8f58add9da62+10:6577:x1870073693214080:12345-0@lo:101: 00000100:00100000:2.0:1783441339.799782:0:5771:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1783441339.799786:0:5771:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000050815cc9 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:6c1ddb50-5795-40c6-a2b6-8f58add9da62+10:3305:x1870073693214208:12345-0@lo:103: 00010000:00010000:0.0:1783441339.799791:0:5780:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1783441339.799795:0:5771:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1783441339.799800:0:5780:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 00000000bc193132/0xa2426164df2c756e lrc: 2/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xa2426164df2c7567 expref: -99 pid: 5780 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783441339.799807:0:5771:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 00000000455653ba/0xa2426164df2c7560 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xa2426164df2c7559 expref: 10 pid: 5778 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783441339.799821:0:5771:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1783441339.799846:0:5771:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000050815cc9 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:6c1ddb50-5795-40c6-a2b6-8f58add9da62+10:3305:x1870073693214208:12345-0@lo:103: Request processed in 59us (142us total) trans 0 rc 0/0 00000100:00100000:2.0:1783441339.799857:0:5771:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1783441339.799895:0:3305:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@0000000066bbf0b5 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:6c1ddb50-5795-40c6-a2b6-8f58add9da62:3305:1870073693214208:0@lo:103: 00010000:00010000:0.0:1783441339.799897:0:5780:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000bc193132/0xa2426164df2c756e lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xa2426164df2c7567 expref: 9 pid: 5780 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783441339.799907:0:5780:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 00000000bc193132/0xa2426164df2c756e lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xa2426164df2c7567 expref: 9 pid: 5780 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783441339.799914:0:5780:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 00000000bc193132, rc 0) 00000100:00100000:0.0:1783441339.800450:0:5780:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000001aa64703 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6c1ddb50-5795-40c6-a2b6-8f58add9da62+9:6577:x1870073693214080:12345-0@lo:101: Request processed in 670us (846us total) trans 0 rc 0/0 00000100:00100000:0.0:1783441339.800457:0:5780:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00100000:2.0:1783441339.800531:0:6577:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@00000000074ee1cc pname:cluuid:pid:xid:nid:opc:job mount.lustre:6c1ddb50-5795-40c6-a2b6-8f58add9da62:6577:1870073693214080:0@lo:101: 00010000:00010000:2.0:1783441339.800545:0:6577:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.113@tcp lock: 000000002d393ce2/0xa2426164df2c7567 lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xa2426164df2c756e expref: -99 pid: 6577 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783441339.800553:0:6577:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.113@tcp lock: 000000002d393ce2/0xa2426164df2c7567 lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xa2426164df2c756e expref: -99 pid: 6577 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1783441339.800569:0:6577:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.201.113@tcp: configuration from log 'nodemap' succeeded (0). 00010000:00010000:2.0:1783441339.800585:0:6577:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.113@tcp lock: 000000002d393ce2/0xa2426164df2c7567 lrc: 3/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xa2426164df2c756e expref: -99 pid: 6577 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783441339.800593:0:6577:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.113@tcp lock: 000000002d393ce2/0xa2426164df2c7567 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xa2426164df2c756e expref: -99 pid: 6577 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1783441339.800599:0:6577:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-OST0000-0000000000000000 10000000:01000000:2.0:1783441339.800603:0:6577:0:(mgc_request.c:68:mgc_name2resid()) log lustre-OST0000 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:2.0:1783441339.800607:0:6577:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-OST0000-0000000000000000 from 1 10000000:01000000:2.0:1783441339.800610:0:6577:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0000 (res 0x65727473756c) 00010000:00010000:2.0:1783441339.800625:0:6577:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.113@tcp lock: 00000000ebb68469/0xa2426164df2c7575 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6577 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783441339.800631:0:6577:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.113@tcp lock: 00000000ebb68469/0xa2426164df2c7575 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6577 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783441339.800638:0:6577:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.113@tcp lock: 00000000ebb68469/0xa2426164df2c7575 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6577 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783441339.800663:0:6577:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@00000000074ee1cc pname:cluuid:pid:xid:nid:opc:job mount.lustre:6c1ddb50-5795-40c6-a2b6-8f58add9da62:6577:1870073693214336:0@lo:101: 00000100:00100000:2.0:1783441339.800694:0:6577:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783441339.800726:0:6577:0:(client.c:2702:ptlrpc_set_wait()) set 00000000e58762b2 going to sleep for 11 seconds 00000100:00100000:3.0:1783441339.800911:0:5779:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073693214336 00000100:00100000:3.0:1783441339.800917:0:5779:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073693214336 00000100:00100000:3.0:1783441339.800963:0:5779:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:3.0:1783441339.800970:0:5779:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000279302b3 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6c1ddb50-5795-40c6-a2b6-8f58add9da62+9:6577:x1870073693214336:12345-0@lo:101: 00010000:00010000:3.0:1783441339.800979:0:5779:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1783441339.800989:0:5779:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 000000002ec9816f/0xa2426164df2c757c lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xa2426164df2c7575 expref: -99 pid: 5779 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783441339.801003:0:5779:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 000000002ec9816f/0xa2426164df2c757c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xa2426164df2c7575 expref: 10 pid: 5779 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783441339.801010:0:5779:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 000000002ec9816f/0xa2426164df2c757c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xa2426164df2c7575 expref: 10 pid: 5779 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783441339.801017:0:5779:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 000000002ec9816f, rc 0) 00000100:00100000:3.0:1783441339.801052:0:5779:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000279302b3 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6c1ddb50-5795-40c6-a2b6-8f58add9da62+10:6577:x1870073693214336:12345-0@lo:101: Request processed in 83us (358us total) trans 0 rc 0/0 00000100:00100000:3.0:1783441339.801058:0:5779:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00100000:2.0:1783441339.801165:0:6577:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@00000000074ee1cc pname:cluuid:pid:xid:nid:opc:job mount.lustre:6c1ddb50-5795-40c6-a2b6-8f58add9da62:6577:1870073693214336:0@lo:101: 00010000:00010000:2.0:1783441339.801174:0:6577:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.113@tcp lock: 00000000ebb68469/0xa2426164df2c7575 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xa2426164df2c757c expref: -99 pid: 6577 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783441339.801182:0:6577:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.113@tcp lock: 00000000ebb68469/0xa2426164df2c7575 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xa2426164df2c757c expref: -99 pid: 6577 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783441339.801267:0:6577:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@00000000074ee1cc pname:cluuid:pid:xid:nid:opc:job mount.lustre:6c1ddb50-5795-40c6-a2b6-8f58add9da62:6577:1870073693214464:0@lo:501: 00000100:00100000:2.0:1783441339.801291:0:6577:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783441339.801321:0:6577:0:(client.c:2702:ptlrpc_set_wait()) set 00000000e58762b2 going to sleep for 11 seconds 00000100:00100000:1.0:1783441339.801423:0:5778:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073693214464 00000100:00100000:1.0:1783441339.801428:0:5778:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073693214464 00000100:00100000:1.0:1783441339.801456:0:5778:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:1.0:1783441339.801461:0:5778:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000140ddae3 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6c1ddb50-5795-40c6-a2b6-8f58add9da62+10:6577:x1870073693214464:12345-0@lo:501: 00000100:00100000:1.0:1783441339.801670:0:5778:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000140ddae3 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6c1ddb50-5795-40c6-a2b6-8f58add9da62+10:6577:x1870073693214464:12345-0@lo:501: Request processed in 208us (378us total) trans 0 rc 0/0 00000100:00100000:1.0:1783441339.801677:0:5778:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00100000:2.0:1783441339.801699:0:6577:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@00000000074ee1cc pname:cluuid:pid:xid:nid:opc:job mount.lustre:6c1ddb50-5795-40c6-a2b6-8f58add9da62:6577:1870073693214464:0@lo:501: 00000100:00100000:2.0:1783441339.801723:0:6577:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@00000000074ee1cc pname:cluuid:pid:xid:nid:opc:job mount.lustre:6c1ddb50-5795-40c6-a2b6-8f58add9da62:6577:1870073693214592:0@lo:503: 00000100:00100000:2.0:1783441339.801796:0:6577:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783441339.801812:0:6577:0:(client.c:2702:ptlrpc_set_wait()) set 00000000e58762b2 going to sleep for 11 seconds 00000100:00100000:1.0:1783441339.801950:0:5780:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073693214592 00000100:00100000:1.0:1783441339.801955:0:5780:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073693214592 00000100:00100000:1.0:1783441339.801981:0:5780:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:1.0:1783441339.801986:0:5780:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000001bd08fba pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6c1ddb50-5795-40c6-a2b6-8f58add9da62+10:6577:x1870073693214592:12345-0@lo:503: 00000100:00100000:1.0:1783441339.802126:0:5780:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000001bd08fba pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6c1ddb50-5795-40c6-a2b6-8f58add9da62+10:6577:x1870073693214592:12345-0@lo:503: Request processed in 139us (329us total) trans 0 rc 0/0 00000100:00100000:1.0:1783441339.802133:0:5780:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00100000:0.0:1783441339.802213:0:6577:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@00000000074ee1cc pname:cluuid:pid:xid:nid:opc:job mount.lustre:6c1ddb50-5795-40c6-a2b6-8f58add9da62:6577:1870073693214592:0@lo:503: 00000040:00080000:0.0:1783441339.802515:0:6577:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:0.0:1783441339.802573:0:6577:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@0000000046270c4a pname:cluuid:pid:xid:nid:opc:job mount.lustre:6c1ddb50-5795-40c6-a2b6-8f58add9da62:6577:1870073693214720:0@lo:502: 00000100:00100000:0.0:1783441339.802605:0:6577:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783441339.802628:0:6577:0:(client.c:2702:ptlrpc_set_wait()) set 000000007cf42ebd going to sleep for 11 seconds 00000100:00100000:3.0:1783441339.802669:0:5779:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073693214720 00000100:00100000:3.0:1783441339.802674:0:5779:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073693214720 00000100:00100000:3.0:1783441339.802707:0:5779:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:3.0:1783441339.802713:0:5779:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000c0d1ca02 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6c1ddb50-5795-40c6-a2b6-8f58add9da62+10:6577:x1870073693214720:12345-0@lo:502: 00000100:00100000:3.0:1783441339.802893:0:5779:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000c0d1ca02 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6c1ddb50-5795-40c6-a2b6-8f58add9da62+10:6577:x1870073693214720:12345-0@lo:502: Request processed in 170us (277us total) trans 0 rc 0/0 00000100:00100000:3.0:1783441339.802909:0:5779:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00100000:0.0:1783441339.803340:0:6577:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@0000000046270c4a pname:cluuid:pid:xid:nid:opc:job mount.lustre:6c1ddb50-5795-40c6-a2b6-8f58add9da62:6577:1870073693214720:0@lo:502: 00000040:00080000:0.0:1783441339.803582:0:6577:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].1, 224 off8416 00000040:00080000:0.0:1783441339.803640:0:6577:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].2, 128 off8544 00000040:00080000:0.0:1783441339.803673:0:6577:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].3, 112 off8656 00000040:00080000:0.0:1783441339.803730:0:6577:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].4, 224 off8880 00000040:00080000:0.0:1783441339.803794:0:6577:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].5, 224 off9104 00000040:00080000:0.0:1783441339.803825:0:6577:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].6, 80 off9184 00000100:00100000:0.0:1783441339.803851:0:6577:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@0000000046270c4a pname:cluuid:pid:xid:nid:opc:job mount.lustre:6c1ddb50-5795-40c6-a2b6-8f58add9da62:6577:1870073693214848:0@lo:502: 00000100:00100000:0.0:1783441339.803906:0:6577:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783441339.803932:0:6577:0:(client.c:2702:ptlrpc_set_wait()) set 000000007cf42ebd going to sleep for 11 seconds 00000100:00100000:2.0:1783441339.803989:0:5778:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073693214848 00000100:00100000:2.0:1783441339.803994:0:5778:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073693214848 00000100:00100000:2.0:1783441339.804036:0:5778:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:2.0:1783441339.804044:0:5778:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000054fcea7 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6c1ddb50-5795-40c6-a2b6-8f58add9da62+10:6577:x1870073693214848:12345-0@lo:502: 00000100:00100000:2.0:1783441339.804213:0:5778:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000054fcea7 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6c1ddb50-5795-40c6-a2b6-8f58add9da62+10:6577:x1870073693214848:12345-0@lo:502: Request processed in 170us (307us total) trans 0 rc 0/0 00000100:00100000:2.0:1783441339.804220:0:5778:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00000100:00100000:0.0:1783441339.804403:0:6577:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@0000000046270c4a pname:cluuid:pid:xid:nid:opc:job mount.lustre:6c1ddb50-5795-40c6-a2b6-8f58add9da62:6577:1870073693214848:0@lo:502: 00000040:00080000:0.0:1783441339.804484:0:6577:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].7, 224 off9408 00000040:00080000:0.0:1783441339.804494:0:6577:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 7 count 8 00000020:01000000:1.0:1783441339.807023:0:6598:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:1.0:1783441339.807035:0:6598:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0000 (0) in 0 of lustre-ost1/ost1 00000020:00000080:1.0:1783441339.807043:0:6598:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1783441339.807045:0:6598:0:(obd_config.c:1561:class_process_config()) marker 11 (0x1) lustre-OST0000 add ost 00000020:00000080:1.0:1783441339.807052:0:6598:0:(obd_config.c:1470:class_process_config()) processing cmd: cf001 00000020:00000080:1.0:1783441339.807067:0:6598:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000 (00000000d725a4b6) 00000020:00000080:1.0:1783441339.807089:0:6598:0:(obd_config.c:720:class_attach_name()) OBD: dev 11 attached type obdfilter with refcount 2 00000020:00000080:1.0:1783441339.807096:0:6598:0:(obd_config.c:1470:class_process_config()) processing cmd: cf003 00000020:01000004:1.0:1783441339.807190:0:6598:0:(tgt_mount.c:153:server_get_mount()) get mount 00000000dafcae11 from lustre-OST0000, refs=2 00080000:01000000:1.0:1783441339.807199:0:6598:0:(osd_handler.c:1569:osd_obd_connect()) connect #1 00000020:00000080:1.0:1783441339.807206:0:6598:0:(genops.c:1406:class_connect()) connect: client lustre-OST0000-osd_UUID, cookie 0xa2426164df2c758a 00010000:00010000:2.0:1783441339.817544:0:6598:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-filter-lustre-OST0000_UUID-2 is initialized 00000001:02000400:2.0:1783441339.823178:0:6598:0:(tgt_lastrcvd.c:1878:tgt_server_data_init()) lustre-OST0000: new disk, initializing 00000001:00000004:2.0:1783441339.828039:0:6598:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 0 40000000:02000000:2.0:1783441339.828326:0:6598:0:(fid_handler.c:560:seq_server_init()) srv-lustre-OST0000: No data found on store. Initialize space. 00080000:10000000:3.0:1783441339.848199:0:6598:0:(osd_index.c:2102:osd_index_try()) lustre-OST0000: index object [0x200000001:0x3:0x0] (8/8/3) registered 00080000:10000000:3.0:1783441339.849203:0:6598:0:(osd_index.c:2102:osd_index_try()) lustre-OST0000: index object [0x200000003:0x3:0x0] (8/8/4) registered 00000020:00000080:3.0:1783441339.857191:0:6598:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000 (uuid lustre-OST0000_UUID) 00000020:01000000:3.0:1783441339.857204:0:6598:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1783441339.857211:0:6598:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1783441339.857213:0:6598:0:(obd_config.c:1561:class_process_config()) marker 11 (0x2) lustre-OST0000 add ost 00000020:01000000:3.0:1783441339.857217:0:6598:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1783441339.857220:0:6598:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1783441339.857222:0:6598:0:(obd_config.c:1561:class_process_config()) marker 14 (0x1) lustre sys.timeout 00000020:00000080:3.0:1783441339.857225:0:6598:0:(obd_config.c:1470:class_process_config()) processing cmd: cf009 00000020:00000080:3.0:1783441339.858429:0:6598:0:(obd_config.c:1535:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:3.0:1783441339.858523:0:6598:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1783441339.858529:0:6598:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1783441339.858530:0:6598:0:(obd_config.c:1561:class_process_config()) marker 14 (0x2) lustre sys.timeout 00000040:00080000:3.0:1783441339.858533:0:6598:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 8 count 8 00000020:01000000:2.0:1783441339.868847:0:6577:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0000 gen 1-7 (rc=0) 10000000:01000000:2.0:1783441339.868900:0:6577:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.201.113@tcp: configuration from log 'lustre-OST0000' succeeded (0). 00010000:00010000:2.0:1783441339.868921:0:6577:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.113@tcp lock: 00000000ebb68469/0xa2426164df2c7575 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xa2426164df2c757c expref: -99 pid: 6577 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783441339.868935:0:6577:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.113@tcp lock: 00000000ebb68469/0xa2426164df2c7575 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xa2426164df2c757c expref: -99 pid: 6577 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1783441339.869465:0:6577:0:(mgc_request.c:1801:mgc_process_log()) Process log params-ffff91a867cf2000 from 1 10000000:01000000:3.0:1783441339.869470:0:6577:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:3.0:1783441339.869511:0:6577:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.113@tcp lock: 00000000c5d6d16a/0xa2426164df2c7591 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6577 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783441339.869519:0:6577:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.113@tcp lock: 00000000c5d6d16a/0xa2426164df2c7591 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6577 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783441339.869530:0:6577:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.113@tcp lock: 00000000c5d6d16a/0xa2426164df2c7591 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6577 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783441339.869554:0:6577:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@000000002e982c95 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6c1ddb50-5795-40c6-a2b6-8f58add9da62:6577:1870073693214976:0@lo:101: 00000100:00100000:3.0:1783441339.869627:0:6577:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783441339.870732:0:6577:0:(client.c:2702:ptlrpc_set_wait()) set 000000002df5f011 going to sleep for 11 seconds 00000100:00100000:3.0:1783441339.872221:0:5780:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073693214976 00000100:00100000:3.0:1783441339.872441:0:5780:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073693214976 00000100:00100000:3.0:1783441339.872639:0:5780:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:3.0:1783441339.872650:0:5780:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000d6050928 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6c1ddb50-5795-40c6-a2b6-8f58add9da62+10:6577:x1870073693214976:12345-0@lo:101: 00010000:00010000:3.0:1783441339.872669:0:5780:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1783441339.872688:0:5780:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 000000002447fd4e/0xa2426164df2c7598 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xa2426164df2c7591 expref: -99 pid: 5780 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783441339.872716:0:5780:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 000000002447fd4e/0xa2426164df2c7598 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xa2426164df2c7591 expref: 11 pid: 5780 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783441339.872726:0:5780:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 000000002447fd4e/0xa2426164df2c7598 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xa2426164df2c7591 expref: 11 pid: 5780 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783441339.872735:0:5780:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 000000002447fd4e, rc 0) 00000100:00100000:3.0:1783441339.875620:0:5780:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000d6050928 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6c1ddb50-5795-40c6-a2b6-8f58add9da62+11:6577:x1870073693214976:12345-0@lo:101: Request processed in 2963us (5984us total) trans 0 rc 0/0 00000100:00100000:3.0:1783441339.875635:0:5780:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00000100:00100000:0.0:1783441339.875786:0:6577:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@000000002e982c95 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6c1ddb50-5795-40c6-a2b6-8f58add9da62:6577:1870073693214976:0@lo:101: 00010000:00010000:0.0:1783441339.875824:0:6577:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.113@tcp lock: 00000000c5d6d16a/0xa2426164df2c7591 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xa2426164df2c7598 expref: -99 pid: 6577 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783441339.875838:0:6577:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.113@tcp lock: 00000000c5d6d16a/0xa2426164df2c7591 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xa2426164df2c7598 expref: -99 pid: 6577 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783441339.876416:0:6577:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@0000000046270c4a pname:cluuid:pid:xid:nid:opc:job mount.lustre:6c1ddb50-5795-40c6-a2b6-8f58add9da62:6577:1870073693215104:0@lo:501: 00000100:00100000:0.0:1783441339.876476:0:6577:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783441339.876523:0:6577:0:(client.c:2702:ptlrpc_set_wait()) set 00000000e01439f1 going to sleep for 11 seconds 00000100:00100000:2.0:1783441339.876593:0:5779:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073693215104 00000100:00100000:2.0:1783441339.876600:0:5779:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073693215104 00000100:00100000:2.0:1783441339.876645:0:5779:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:2.0:1783441339.876652:0:5779:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000065e45314 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6c1ddb50-5795-40c6-a2b6-8f58add9da62+11:6577:x1870073693215104:12345-0@lo:501: 00000100:00100000:2.0:1783441339.876989:0:5779:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000065e45314 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6c1ddb50-5795-40c6-a2b6-8f58add9da62+11:6577:x1870073693215104:12345-0@lo:501: Request processed in 336us (513us total) trans 0 rc 0/0 00000100:00100000:2.0:1783441339.876998:0:5779:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00000100:00100000:0.0:1783441339.877985:0:6577:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@0000000046270c4a pname:cluuid:pid:xid:nid:opc:job mount.lustre:6c1ddb50-5795-40c6-a2b6-8f58add9da62:6577:1870073693215104:0@lo:501: 00000100:00100000:0.0:1783441339.878038:0:6577:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@0000000046270c4a pname:cluuid:pid:xid:nid:opc:job mount.lustre:6c1ddb50-5795-40c6-a2b6-8f58add9da62:6577:1870073693215232:0@lo:503: 00000100:00100000:0.0:1783441339.878094:0:6577:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783441339.878117:0:6577:0:(client.c:2702:ptlrpc_set_wait()) set 00000000e01439f1 going to sleep for 11 seconds 00000100:00100000:2.0:1783441339.879056:0:5779:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073693215232 00000100:00100000:2.0:1783441339.879069:0:5779:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073693215232 00000100:00100000:2.0:1783441339.879116:0:5779:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:2.0:1783441339.879122:0:5779:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000059ae6c9c pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6c1ddb50-5795-40c6-a2b6-8f58add9da62+11:6577:x1870073693215232:12345-0@lo:503: 00000100:00100000:2.0:1783441339.881067:0:5779:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000059ae6c9c pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6c1ddb50-5795-40c6-a2b6-8f58add9da62+11:6577:x1870073693215232:12345-0@lo:503: Request processed in 1938us (2966us total) trans 0 rc 0/0 00000100:00100000:2.0:1783441339.881081:0:5779:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00000100:00100000:0.0:1783441339.881441:0:6577:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@0000000046270c4a pname:cluuid:pid:xid:nid:opc:job mount.lustre:6c1ddb50-5795-40c6-a2b6-8f58add9da62:6577:1870073693215232:0@lo:503: 00000040:00080000:0.0:1783441339.881777:0:6577:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:0.0:1783441339.882726:0:6577:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@0000000046270c4a pname:cluuid:pid:xid:nid:opc:job mount.lustre:6c1ddb50-5795-40c6-a2b6-8f58add9da62:6577:1870073693215360:0@lo:502: 00000100:00100000:0.0:1783441339.885629:0:6577:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783441339.885677:0:6577:0:(client.c:2702:ptlrpc_set_wait()) set 00000000e01439f1 going to sleep for 11 seconds 00000100:00100000:2.0:1783441339.886077:0:5778:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073693215360 00000100:00100000:2.0:1783441339.886088:0:5778:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073693215360 00000100:00100000:2.0:1783441339.886146:0:5778:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:2.0:1783441339.886154:0:5778:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000055fcdcb5 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6c1ddb50-5795-40c6-a2b6-8f58add9da62+11:6577:x1870073693215360:12345-0@lo:502: 00000100:00100000:2.0:1783441339.886641:0:5778:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000055fcdcb5 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6c1ddb50-5795-40c6-a2b6-8f58add9da62+11:6577:x1870073693215360:12345-0@lo:502: Request processed in 486us (1014us total) trans 0 rc 0/0 00000100:00100000:2.0:1783441339.886650:0:5778:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00000100:00100000:0.0:1783441339.887461:0:6577:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@0000000046270c4a pname:cluuid:pid:xid:nid:opc:job mount.lustre:6c1ddb50-5795-40c6-a2b6-8f58add9da62:6577:1870073693215360:0@lo:502: 00000040:00080000:0.0:1783441339.888570:0:6577:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].1, 224 off8416 00000040:00080000:0.0:1783441339.888657:0:6577:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].2, 112 off8528 00000100:00100000:0.0:1783441339.888707:0:6577:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@0000000046270c4a pname:cluuid:pid:xid:nid:opc:job mount.lustre:6c1ddb50-5795-40c6-a2b6-8f58add9da62:6577:1870073693215488:0@lo:502: 00000100:00100000:0.0:1783441339.889505:0:6577:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783441339.890220:0:6577:0:(client.c:2702:ptlrpc_set_wait()) set 00000000e01439f1 going to sleep for 11 seconds 00000100:00100000:3.0:1783441339.890489:0:5780:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073693215488 00000100:00100000:3.0:1783441339.890499:0:5780:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073693215488 00000100:00100000:3.0:1783441339.890573:0:5780:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:3.0:1783441339.890581:0:5780:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000009dfecbde pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6c1ddb50-5795-40c6-a2b6-8f58add9da62+11:6577:x1870073693215488:12345-0@lo:502: 00000100:00100000:3.0:1783441339.892208:0:5780:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000009dfecbde pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6c1ddb50-5795-40c6-a2b6-8f58add9da62+11:6577:x1870073693215488:12345-0@lo:502: Request processed in 1620us (2701us total) trans 0 rc 0/0 00000100:00100000:3.0:1783441339.892221:0:5780:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00000100:00100000:0.0:1783441339.896574:0:6577:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@0000000046270c4a pname:cluuid:pid:xid:nid:opc:job mount.lustre:6c1ddb50-5795-40c6-a2b6-8f58add9da62:6577:1870073693215488:0@lo:502: 00000040:00080000:0.0:1783441339.897471:0:6577:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].3, 224 off8752 00000040:00080000:0.0:1783441339.897493:0:6577:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 3 count 4 00000020:01000000:0.0:1783441339.905555:0:6602:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1783441339.905570:0:6602:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1783441339.905573:0:6602:0:(obd_config.c:1561:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:0.0:1783441339.905581:0:6602:0:(obd_config.c:2005:class_config_llog_handler()) cmd ce032, instance name: general-ffff91a867cf2000 00000020:00000080:0.0:1783441339.905583:0:6602:0:(obd_config.c:1470:class_process_config()) processing cmd: ce032 00000020:01000000:0.0:1783441339.905622:0:6602:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1783441339.905624:0:6602:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1783441339.905626:0:6602:0:(obd_config.c:1561:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000040:00080000:0.0:1783441339.905629:0:6602:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 4 count 4 00000020:01000000:2.0:1783441339.908707:0:6577:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-3 (rc=0) 10000000:01000000:2.0:1783441339.908893:0:6577:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.201.113@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:2.0:1783441339.908975:0:6577:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.113@tcp lock: ffff91a85eb3d200/0xa2426164df2c7591 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xa2426164df2c7598 expref: -99 pid: 6577 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783441339.908992:0:6577:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.113@tcp lock: ffff91a85eb3d200/0xa2426164df2c7591 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xa2426164df2c7598 expref: -99 pid: 6577 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1783441339.909207:0:6577:0:(mgc_request.c:1943:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:3.0:1783441339.909211:0:6577:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff91a867cf2000 10000000:01000000:3.0:1783441339.909214:0:6577:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff91a867cf2000 10000000:01000000:3.0:1783441339.909218:0:6577:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:3.0:1783441339.909237:0:6577:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-client-ffff91a867cf2000 from 1 10000000:01000000:3.0:1783441339.909255:0:6577:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:3.0:1783441339.909293:0:6577:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.113@tcp lock: ffff91a85eb3c600/0xa2426164df2c759f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6577 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783441339.909302:0:6577:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.113@tcp lock: ffff91a85eb3c600/0xa2426164df2c759f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6577 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783441339.909313:0:6577:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.113@tcp lock: ffff91a85eb3c600/0xa2426164df2c759f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6577 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783441339.909336:0:6577:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff91a875691880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6c1ddb50-5795-40c6-a2b6-8f58add9da62:6577:1870073693215616:0@lo:101: 00000100:00100000:3.0:1783441339.909409:0:6577:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783441339.909462:0:6577:0:(client.c:2702:ptlrpc_set_wait()) set ffff91a7410c8180 going to sleep for 11 seconds 00000100:00100000:2.0:1783441339.909651:0:5779:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073693215616 00000100:00100000:2.0:1783441339.909658:0:5779:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073693215616 00000100:00100000:2.0:1783441339.909710:0:5779:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 39 00000100:00100000:2.0:1783441339.909719:0:5779:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a848f37c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6c1ddb50-5795-40c6-a2b6-8f58add9da62+11:6577:x1870073693215616:12345-0@lo:101: 00010000:00010000:2.0:1783441339.909734:0:5779:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1783441339.909767:0:5779:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff91a85f83d400/0xa2426164df2c75a6 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xa2426164df2c759f expref: -99 pid: 5779 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783441339.909790:0:5779:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff91a85f83d400/0xa2426164df2c75a6 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xa2426164df2c759f expref: 12 pid: 5779 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783441339.909801:0:5779:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff91a85f83d400/0xa2426164df2c75a6 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xa2426164df2c759f expref: 12 pid: 5779 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783441339.909809:0:5779:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91a85f83d400, rc 0) 00000100:00100000:2.0:1783441339.909858:0:5779:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a848f37c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6c1ddb50-5795-40c6-a2b6-8f58add9da62+12:6577:x1870073693215616:12345-0@lo:101: Request processed in 140us (450us total) trans 0 rc 0/0 00000100:00100000:2.0:1783441339.909864:0:5779:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 39 00000100:00100000:1.0:1783441339.910120:0:6577:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff91a875691880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6c1ddb50-5795-40c6-a2b6-8f58add9da62:6577:1870073693215616:0@lo:101: 00010000:00010000:1.0:1783441339.910138:0:6577:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.113@tcp lock: ffff91a85eb3c600/0xa2426164df2c759f lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xa2426164df2c75a6 expref: -99 pid: 6577 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783441339.910154:0:6577:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.113@tcp lock: ffff91a85eb3c600/0xa2426164df2c759f lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xa2426164df2c75a6 expref: -99 pid: 6577 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783441339.910275:0:6577:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff91a867cd5500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6c1ddb50-5795-40c6-a2b6-8f58add9da62:6577:1870073693215744:0@lo:501: 00000100:00100000:1.0:1783441339.910303:0:6577:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783441339.910336:0:6577:0:(client.c:2702:ptlrpc_set_wait()) set ffff91a8431f3a80 going to sleep for 11 seconds 00000100:00100000:3.0:1783441339.910554:0:5778:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073693215744 00000100:00100000:3.0:1783441339.910559:0:5778:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073693215744 00000100:00100000:3.0:1783441339.910597:0:5778:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:3.0:1783441339.910605:0:5778:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a848f36050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6c1ddb50-5795-40c6-a2b6-8f58add9da62+12:6577:x1870073693215744:12345-0@lo:501: 00000100:00100000:3.0:1783441339.910906:0:5778:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a848f36050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6c1ddb50-5795-40c6-a2b6-8f58add9da62+12:6577:x1870073693215744:12345-0@lo:501: Request processed in 301us (600us total) trans 0 rc 0/0 00000100:00100000:3.0:1783441339.910914:0:5778:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00000100:00100000:1.0:1783441339.911270:0:6577:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff91a867cd5500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6c1ddb50-5795-40c6-a2b6-8f58add9da62:6577:1870073693215744:0@lo:501: 00000100:00100000:1.0:1783441339.911304:0:6577:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff91a867cd5500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6c1ddb50-5795-40c6-a2b6-8f58add9da62:6577:1870073693215872:0@lo:503: 00000100:00100000:1.0:1783441339.911584:0:6577:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783441339.911614:0:6577:0:(client.c:2702:ptlrpc_set_wait()) set ffff91a8431f3a80 going to sleep for 11 seconds 00000100:00100000:3.0:1783441339.911667:0:5778:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073693215872 00000100:00100000:3.0:1783441339.911672:0:5778:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073693215872 00000100:00100000:3.0:1783441339.911707:0:5778:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:3.0:1783441339.911713:0:5778:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a848f37850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6c1ddb50-5795-40c6-a2b6-8f58add9da62+12:6577:x1870073693215872:12345-0@lo:503: 00000100:00100000:3.0:1783441339.912057:0:5778:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a848f37850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6c1ddb50-5795-40c6-a2b6-8f58add9da62+12:6577:x1870073693215872:12345-0@lo:503: Request processed in 342us (472us total) trans 0 rc 0/0 00000100:00100000:3.0:1783441339.912064:0:5778:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00000100:00100000:1.0:1783441339.912423:0:6577:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff91a867cd5500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6c1ddb50-5795-40c6-a2b6-8f58add9da62:6577:1870073693215872:0@lo:503: 00000040:00080000:1.0:1783441339.913150:0:6577:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:1.0:1783441339.913446:0:6577:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff91a867cd5500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6c1ddb50-5795-40c6-a2b6-8f58add9da62:6577:1870073693216000:0@lo:502: 00000100:00100000:1.0:1783441339.913910:0:6577:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783441339.914148:0:6577:0:(client.c:2702:ptlrpc_set_wait()) set ffff91a8431f3a80 going to sleep for 11 seconds 00000100:00100000:2.0:1783441339.914216:0:5779:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073693216000 00000100:00100000:2.0:1783441339.914224:0:5779:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073693216000 00000100:00100000:2.0:1783441339.914289:0:5779:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:2.0:1783441339.914301:0:5779:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a848f36850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6c1ddb50-5795-40c6-a2b6-8f58add9da62+12:6577:x1870073693216000:12345-0@lo:502: 00000100:00100000:2.0:1783441339.914583:0:5779:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a848f36850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6c1ddb50-5795-40c6-a2b6-8f58add9da62+12:6577:x1870073693216000:12345-0@lo:502: Request processed in 284us (673us total) trans 0 rc 0/0 00000100:00100000:2.0:1783441339.914590:0:5779:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00000100:00100000:1.0:1783441339.914888:0:6577:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff91a867cd5500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6c1ddb50-5795-40c6-a2b6-8f58add9da62:6577:1870073693216000:0@lo:502: 00000040:00080000:1.0:1783441339.915160:0:6577:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].1, 224 off8416 00000040:00080000:1.0:1783441339.915208:0:6577:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].2, 120 off8536 00000040:00080000:1.0:1783441339.915238:0:6577:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].3, 168 off8704 00000040:00080000:1.0:1783441339.915279:0:6577:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].4, 224 off8928 00000040:00080000:1.0:1783441339.915311:0:6577:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].5, 224 off9152 00000040:00080000:1.0:1783441339.915391:0:6577:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].6, 120 off9272 00000040:00080000:1.0:1783441339.915431:0:6577:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].7, 168 off9440 00000040:00080000:1.0:1783441339.915465:0:6577:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].8, 224 off9664 00000040:00080000:1.0:1783441339.915513:0:6577:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].9, 224 off9888 00000040:00080000:1.0:1783441339.915548:0:6577:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].10, 120 off10008 00000040:00080000:1.0:1783441339.915593:0:6577:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].11, 224 off10232 00000040:00080000:1.0:1783441339.915660:0:6577:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].12, 224 off10456 00000040:00080000:1.0:1783441339.915692:0:6577:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].13, 88 off10544 00000040:00080000:1.0:1783441339.915724:0:6577:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].14, 128 off10672 00000040:00080000:1.0:1783441339.915829:0:6577:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].15, 144 off10816 00000040:00080000:1.0:1783441339.915866:0:6577:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].16, 160 off10976 00000040:00080000:1.0:1783441339.915911:0:6577:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].17, 224 off11200 00000040:00080000:1.0:1783441339.915962:0:6577:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].18, 224 off11424 00000040:00080000:1.0:1783441339.915999:0:6577:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].19, 80 off11504 00000040:00080000:1.0:1783441339.916034:0:6577:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].20, 224 off11728 00000040:00080000:1.0:1783441339.916084:0:6577:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].21, 224 off11952 00000040:00080000:1.0:1783441339.916119:0:6577:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].22, 88 off12040 00000040:00080000:1.0:1783441339.916152:0:6577:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].23, 128 off12168 00000040:00080000:1.0:1783441339.916200:0:6577:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].24, 144 off12312 00000040:00080000:1.0:1783441339.916236:0:6577:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].25, 128 off12440 00000040:00080000:1.0:1783441339.916270:0:6577:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].26, 224 off12664 00000040:00080000:1.0:1783441339.916318:0:6577:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].27, 224 off12888 00000040:00080000:1.0:1783441339.916374:0:6577:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].28, 80 off12968 00000100:00100000:1.0:1783441339.916422:0:6577:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff91a867cd5500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6c1ddb50-5795-40c6-a2b6-8f58add9da62:6577:1870073693216128:0@lo:502: 00000100:00100000:1.0:1783441339.916494:0:6577:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783441339.916545:0:6577:0:(client.c:2702:ptlrpc_set_wait()) set ffff91a8431f3a80 going to sleep for 11 seconds 00000100:00100000:3.0:1783441339.916860:0:5778:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073693216128 00000100:00100000:3.0:1783441339.916868:0:5778:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073693216128 00000100:00100000:3.0:1783441339.916927:0:5778:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 43 00000100:00100000:3.0:1783441339.916946:0:5778:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a848f35450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6c1ddb50-5795-40c6-a2b6-8f58add9da62+12:6577:x1870073693216128:12345-0@lo:502: 00000100:00100000:3.0:1783441339.917171:0:5778:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a848f35450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6c1ddb50-5795-40c6-a2b6-8f58add9da62+12:6577:x1870073693216128:12345-0@lo:502: Request processed in 236us (676us total) trans 0 rc 0/0 00000100:00100000:3.0:1783441339.917179:0:5778:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 43 00000100:00100000:1.0:1783441339.917729:0:6577:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff91a867cd5500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6c1ddb50-5795-40c6-a2b6-8f58add9da62:6577:1870073693216128:0@lo:502: 00000040:00080000:1.0:1783441339.919106:0:6577:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].29, 224 off13192 00000040:00080000:1.0:1783441339.919128:0:6577:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 29 count 30 00000020:01000004:3.0:1783441339.920720:0:6603:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-OST0000 (typ=lwp) 00000020:00000080:3.0:1783441339.923611:0:6603:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-OST0000 (ffff91a877f799c0) 00000020:00000080:3.0:1783441339.923681:0:6603:0:(obd_config.c:720:class_attach_name()) OBD: dev 12 attached type lwp with refcount 2 00000020:01000004:3.0:1783441339.924221:0:6603:0:(tgt_mount.c:153:server_get_mount()) get mount ffff91a867cf2000 from lustre-OST0000, refs=3 00000020:01000004:3.0:1783441339.924240:0:6603:0:(tgt_mount.c:187:server_put_mount()) put mount ffff91a867cf2000 from lustre-OST0000, refs=3 00000020:01000004:3.0:1783441339.924243:0:6603:0:(obd_mount.c:710:lustre_put_lsi()) put ffff91a867cf2000 3 00010000:00080000:3.0:1783441339.924278:0:6603:0:(ldlm_lib.c:102:import_set_conn()) imp ffff91a877f8a800@lustre-MDT0000-lwp-OST0000: add connection 192.168.201.113@tcp at head 00010000:00010000:3.0:1783441339.930733:0:6603:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-OST0000-2 is initialized 00000020:00000080:3.0:1783441339.931553:0:6603:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-OST0000 (uuid lustre-MDT0000-lwp-OST0000_UUID) 00000010:01000000:3.0:1783441339.931611:0:6603:0:(lwp_dev.c:497:lwp_obd_connect()) connect #0 00000020:00000080:3.0:1783441339.931625:0:6603:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-lwp-OST0000, cookie 0xa2426164df2c75b4 00000100:00080000:3.0:1783441339.931637:0:6603:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 0 00000100:00080000:3.0:1783441339.931643:0:6603:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff91a877f8a800 using connection 192.168.201.113@tcp/0@lo 00000100:00100000:3.0:1783441339.931686:0:6603:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff91a875690380 x1870073693216256/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1783441339.931721:0:6603:0:(pinger.c:374:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID 00000100:00100000:2.0:1783441339.932496:0:3302:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff91a875690380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3302:1870073693216256:0@lo:38: 00000100:00100000:2.0:1783441339.932587:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783441339.933072:0:5785:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073693216256 00000100:00100000:0.0:1783441339.933082:0:5785:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073693216256 00000100:00100000:0.0:1783441339.933123:0:5785:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1783441339.933133:0:5785:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a846f25880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3302:x1870073693216256:12345-0@lo:38: 00010000:00080000:0.0:1783441339.933164:0:5785:0:(ldlm_lib.c:1432:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-OST0000_UUID@0@lo t0 exp 0000000000000000 cur 177 last 0 00000020:00000080:0.0:1783441339.933199:0:5785:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-lwp-OST0000_UUID, cookie 0xa2426164df2c75bb 00000004:00100000:0.0:1783441339.933215:0:5785:0:(mdt_handler.c:7286:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00100000:3.0:1783441339.935197:0:3306:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff91a875692d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3306:1870073693216384:0@lo:400: 00000100:00100000:3.0:1783441339.936170:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783441339.936517:0:5787:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 3 min 3 max 116 00000100:00100000:2.0:1783441339.936528:0:5787:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt00_003' 00000100:00100000:2.0:1783441339.936703:0:5787:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073693216384 00000100:00100000:2.0:1783441339.936711:0:5787:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073693216384 00000100:00100000:2.0:1783441339.936762:0:5787:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 3 min 3 max 116 00000100:00100000:2.0:1783441339.936772:0:5787:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1783441339.936780:0:5787:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a875690a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3306:x1870073693216384:12345-0@lo:400: 00000100:00100000:2.0:1783441339.936843:0:5787:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a875690a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3306:x1870073693216384:12345-0@lo:400: Request processed in 64us (677us total) trans 0 rc 0/0 00000100:00100000:2.0:1783441339.936851:0:5787:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00080000:3.0:1783441339.937063:0:3306:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@ffff91a875692d80 x1870073693216384/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1783441355 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1783441339.937081:0:3306:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff91a875692d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3306:1870073693216384:0@lo:400: 00000100:00080000:0.0:1783441339.937227:0:5785:0:(import.c:65:import_set_state_nolock()) ffff91a74422f000 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1783441339.937290:0:5785:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a846f25880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3302:x1870073693216256:12345-0@lo:38: Request processed in 4158us (4704us total) trans 0 rc 0/0 00000100:00100000:0.0:1783441339.937297:0:5785:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00080000:3.0:1783441339.938259:0:3302:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@ffff91a875690380 x1870073693216256/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/416 e 0 to 0 dl 1783441349 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1783441339.938277:0:3302:0:(client.c:3112:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0000: committing for last_committed 0 gen 2 00000100:00080000:3.0:1783441339.938286:0:3302:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-OST0000: connect to target with instance 1 00000100:00080000:3.0:1783441339.938295:0:3302:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-OST0000: Resetting ns_connect_flags to server flags: 0x2041401043000020 00000100:00080000:3.0:1783441339.938301:0:3302:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:3.0:1783441339.938304:0:3302:0:(import.c:65:import_set_state_nolock()) ffff91a877f8a800 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:3.0:1783441339.938310:0:3302:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff91a875690380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3302:1870073693216256:0@lo:38: 00000040:00080000:3.0:1783441339.940215:0:6603:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 30 count 30 00000020:01000000:1.0:1783441339.940607:0:6577:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-29 (rc=0) 10000000:01000000:1.0:1783441339.940637:0:6577:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.201.113@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:1.0:1783441339.940657:0:6577:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.113@tcp lock: ffff91a85eb3c600/0xa2426164df2c759f lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xa2426164df2c75a6 expref: -99 pid: 6577 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783441339.940667:0:6577:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.113@tcp lock: ffff91a85eb3c600/0xa2426164df2c759f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xa2426164df2c75a6 expref: -99 pid: 6577 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:1.0:1783441339.940734:0:6577:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:1.0:1783441339.940736:0:6577:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:1.0:1783441339.940737:0:6577:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1783441339.941086:0:6577:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1783441339.941089:0:6577:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1783441339.941090:0:6577:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1783441339.941092:0:6577:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:1.0:1783441339.941094:0:6577:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:1.0:1783441339.941096:0:6577:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:1.0:1783441339.941098:0:6577:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1783441339.941099:0:6577:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:1.0:1783441339.941103:0:6577:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0000 0x40020062 00000020:01000004:1.0:1783441339.941106:0:6577:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:1.0:1783441339.941108:0:6577:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:1.0:1783441339.941109:0:6577:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1783441339.941110:0:6577:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1783441339.941111:0:6577:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1783441339.941113:0:6577:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1783441339.941114:0:6577:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:1.0:1783441339.941114:0:6577:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:1.0:1783441339.941115:0:6577:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:1.0:1783441339.941116:0:6577:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1783441339.941117:0:6577:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:1.0:1783441339.941144:0:6577:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0000 00000100:00100000:1.0:1783441339.941162:0:6577:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff91a867cd5500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6c1ddb50-5795-40c6-a2b6-8f58add9da62:6577:1870073693216512:0@lo:253: 00000100:00100000:1.0:1783441339.942770:0:6577:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783441339.942818:0:6577:0:(client.c:2702:ptlrpc_set_wait()) set ffff91a843df4180 going to sleep for 11 seconds 00000100:00100000:3.0:1783441339.943797:0:5780:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073693216512 00000100:00100000:3.0:1783441339.943809:0:5780:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073693216512 00000100:00100000:3.0:1783441339.943863:0:5780:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 44 00000100:00100000:3.0:1783441339.943872:0:5780:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a848f35850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6c1ddb50-5795-40c6-a2b6-8f58add9da62+12:6577:x1870073693216512:12345-0@lo:253: 20000000:01000000:3.0:1783441339.943913:0:5780:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 0 is ready to reconnect. 20000000:01000000:3.0:1783441339.943926:0:5780:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 20000000:01000000:2.0:1783441339.976266:0:5780:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:2.0:1783441339.976292:0:5780:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0000, index=0, rc=0 20000000:01000000:1.0:1783441339.976343:0:5801:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:1.0:1783441339.976348:0:5801:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:1.0:1783441339.976375:0:5801:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff91a841477800/0xa2426164df2c75c2 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 5801 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783441339.976396:0:5801:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff91a85eb3da00/0xa2426164df2c752f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xa2426164df2c7528 expref: 12 pid: 5779 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783441339.976422:0:5801:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff91a841477800/0xa2426164df2c75c2 lrc: 4/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 5801 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783441339.976462:0:5801:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff91a85eb3da00/0xa2426164df2c752f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xa2426164df2c7528 expref: 12 pid: 5779 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783441339.976478:0:5801:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff91a85eb3da00/0xa2426164df2c752f lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xa2426164df2c7528 expref: 12 pid: 5779 timeout: 327 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783441339.976493:0:5801:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff91a867cd4000 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:5801:1870073693216640:0@lo:104: 00000100:00100000:1.0:1783441339.976557:0:5801:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783441339.976622:0:5801:0:(client.c:2702:ptlrpc_set_wait()) set ffff91a843df4480 going to sleep for 11 seconds 00000100:00100000:2.0:1783441339.976982:0:5768:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073693216640 00000100:00100000:2.0:1783441339.976990:0:5768:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073693216640 00000100:00100000:2.0:1783441339.977048:0:5768:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:2.0:1783441339.977058:0:5768:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a867cd4380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:6c1ddb50-5795-40c6-a2b6-8f58add9da62+3:5801:x1870073693216640:12345-0@lo:104: 00010000:00010000:2.0:1783441339.977072:0:5768:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.113@tcp lock: ffff91a841476e00/0xa2426164df2c7528 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xa2426164df2c752f expref: -99 pid: 5783 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783441339.977132:0:5768:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:2.0:1783441339.977146:0:5768:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a867cd4380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:6c1ddb50-5795-40c6-a2b6-8f58add9da62+3:5801:x1870073693216640:12345-0@lo:104: Request processed in 90us (589us total) trans 0 rc 0/0 00000100:00100000:2.0:1783441339.977154:0:5768:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:2.0:1783441339.977196:0:5801:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff91a867cd4000 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:5801:1870073693216640:0@lo:104: 00010000:00010000:2.0:1783441339.977215:0:5801:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff91a841477800/0xa2426164df2c75c2 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 5801 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783441339.985030:0:5773:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1783441339.985046:0:5773:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.113@tcp lock: ffff91a841476e00/0xa2426164df2c7528 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xa2426164df2c752f expref: -99 pid: 5783 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783441339.985060:0:5773:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91a841476e00 already unused, calling callback (ffffffffc1b78c20) 10000000:00010000:1.0:1783441339.985065:0:5773:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.113@tcp lock: ffff91a841476e00/0xa2426164df2c7528 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xa2426164df2c752f expref: -99 pid: 5783 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783441339.985075:0:5773:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.113@tcp lock: ffff91a841476e00/0xa2426164df2c7528 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xa2426164df2c752f expref: -99 pid: 5783 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1783441339.985083:0:5773:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.113@tcp lock: ffff91a841476e00/0xa2426164df2c7528 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xa2426164df2c752f expref: -99 pid: 5783 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1783441339.985089:0:5773:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:1.0:1783441339.985145:0:5773:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.113@tcp lock: ffff91a841476e00/0xa2426164df2c7528 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xa2426164df2c752f expref: -99 pid: 5783 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783441339.985168:0:5773:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1783441339.985191:0:5773:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.113@tcp lock: ffff91a841476e00/0xa2426164df2c7528 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xa2426164df2c752f expref: -99 pid: 5783 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783441339.985198:0:5773:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.113@tcp lock: ffff91a841476e00/0xa2426164df2c7528 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xa2426164df2c752f expref: -99 pid: 5783 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783441339.985217:0:5773:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783441339.985219:0:5773:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783441339.985220:0:5773:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1783441339.985363:0:3303:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff91a867cd7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:6c1ddb50-5795-40c6-a2b6-8f58add9da62:3303:1870073693216768:0@lo:103: 00000100:00100000:1.0:1783441339.985433:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783441339.985495:0:5770:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073693216768 00000100:00100000:1.0:1783441339.985503:0:5770:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073693216768 00010000:00010000:1.0:1783441339.987153:0:5770:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff91a85eb3da00/0xa2426164df2c752f lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xa2426164df2c7528 expref: 13 pid: 5779 timeout: 327 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783441339.987201:0:5770:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:1.0:1783441339.987214:0:5770:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a84545bc50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:6c1ddb50-5795-40c6-a2b6-8f58add9da62+13:3303:x1870073693216768:12345-0@lo:103: 00010000:00010000:1.0:1783441339.987245:0:5770:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1783441339.987251:0:5770:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff91a85eb3da00/0xa2426164df2c752f lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xa2426164df2c7528 expref: 13 pid: 5779 timeout: 327 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783441339.987265:0:5770:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff91a85eb3da00/0xa2426164df2c752f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xa2426164df2c7528 expref: 13 pid: 5779 timeout: 327 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783441339.987284:0:5770:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff91a85eb3da00/0xa2426164df2c752f lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xa2426164df2c7528 expref: 13 pid: 5779 timeout: 327 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783441339.987322:0:5770:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff91a841477800/0xa2426164df2c75c2 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 5801 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783441339.987331:0:5770:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff91a841477800/0xa2426164df2c75c2 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 5801 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:1.0:1783441339.987350:0:5770:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.011001960s 00010000:00010000:1.0:1783441339.987355:0:5770:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff91a841477800/0xa2426164df2c75c2 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 5801 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783441339.987362:0:5770:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff91a841477800/0xa2426164df2c75c2 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5801 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783441339.987369:0:5770:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff91a841477800/0xa2426164df2c75c2 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5801 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783441339.987375:0:5770:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff91a841477800/0xa2426164df2c75c2 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5801 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783441339.987381:0:5770:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91a841477800 already unused, calling callback (ffffffffc155ff90) 00010000:00010000:1.0:1783441339.987386:0:5770:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff91a841477800/0xa2426164df2c75c2 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5801 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783441339.987393:0:5770:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff91a841477800/0xa2426164df2c75c2 lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 5801 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783441339.987405:0:5770:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff91a841477800/0xa2426164df2c75c2 lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5801 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783441339.987418:0:5770:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1783441339.987503:0:5770:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a84545bc50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:6c1ddb50-5795-40c6-a2b6-8f58add9da62+12:3303:x1870073693216768:12345-0@lo:103: Request processed in 292us (2069us total) trans 0 rc 0/0 00000100:00100000:1.0:1783441339.987521:0:5770:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:1.0:1783441339.987606:0:3303:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff91a867cd7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:6c1ddb50-5795-40c6-a2b6-8f58add9da62:3303:1870073693216768:0@lo:103: 00010000:00010000:2.0:1783441339.988474:0:5801:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff91a841477800/0xa2426164df2c75c2 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5801 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783441339.988486:0:5801:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff91a841477800/0xa2426164df2c75c2 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5801 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783441339.988492:0:5801:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff91a841477800/0xa2426164df2c75c2 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5801 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783441339.988913:0:5780:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a848f35850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6c1ddb50-5795-40c6-a2b6-8f58add9da62+11:6577:x1870073693216512:12345-0@lo:253: Request processed in 44868us (45974us total) trans 0 rc 0/0 00000100:00100000:0.0:1783441339.988924:0:5780:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 44 00000100:00100000:1.0:1783441339.989025:0:6577:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff91a867cd5500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6c1ddb50-5795-40c6-a2b6-8f58add9da62:6577:1870073693216512:0@lo:253: 10000000:01000000:1.0:1783441339.989040:0:6577:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0000 got index = 0 00000020:01000004:1.0:1783441339.989043:0:6577:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:1.0:1783441339.989044:0:6577:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:1.0:1783441339.989046:0:6577:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1783441339.989047:0:6577:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1783441339.989049:0:6577:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1783441339.989050:0:6577:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1783441339.989052:0:6577:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:1.0:1783441339.989054:0:6577:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:1.0:1783441339.989055:0:6577:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:1.0:1783441339.989057:0:6577:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1783441339.989058:0:6577:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:1.0:1783441339.989069:0:6577:0:(tgt_mount.c:2690:server_calc_timeout()) lustre-OST0000: Imperative Recovery not enabled, recovery window 60-180 00080000:10000000:0.0:1783441340.003828:0:6577:0:(osd_index.c:2102:osd_index_try()) lustre-OST0000: index object [0x200000003:0x5:0x0] (8/8/4) registered 00080000:10000000:0.0:1783441340.004208:0:6577:0:(osd_index.c:2102:osd_index_try()) lustre-OST0000: index object [0x200000005:0x1:0x0] (8/8/1) registered 00080000:10000000:0.0:1783441340.004473:0:6577:0:(osd_index.c:2102:osd_index_try()) lustre-OST0000: index object [0x200000003:0x6:0x0] (8/8/4) registered 00080000:10000000:0.0:1783441340.004630:0:6577:0:(osd_index.c:2102:osd_index_try()) lustre-OST0000: index object [0x200000005:0x2:0x0] (8/8/1) registered 00080000:10000000:0.0:1783441340.005397:0:6577:0:(osd_index.c:2102:osd_index_try()) lustre-OST0000: index object [0x200000003:0x7:0x0] (8/8/4) registered 00080000:10000000:0.0:1783441340.005672:0:6577:0:(osd_index.c:2102:osd_index_try()) lustre-OST0000: index object [0x200000005:0x3:0x0] (8/8/1) registered 00000001:00000004:2.0:1783441340.009600:0:6577:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 4294967296 10000000:01000000:2.0:1783441340.133729:0:5783:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:2.0:1783441340.133736:0:5783:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-client-ffff91a84869e800 from 21 10000000:01000000:2.0:1783441340.133768:0:5783:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:2.0:1783441340.133813:0:5783:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.113@tcp lock: ffff91a85f83ce00/0xa2426164df2c75c9 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5783 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783441340.133825:0:5783:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.113@tcp lock: ffff91a85f83ce00/0xa2426164df2c75c9 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5783 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783441340.133836:0:5783:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.113@tcp lock: ffff91a85f83ce00/0xa2426164df2c75c9 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5783 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783441340.133863:0:5783:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff91a846f26680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6c1ddb50-5795-40c6-a2b6-8f58add9da62:5783:1870073693216896:0@lo:101: 00000100:00100000:2.0:1783441340.133947:0:5783:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783441340.133998:0:5783:0:(client.c:2702:ptlrpc_set_wait()) set ffff91a8591db600 going to sleep for 11 seconds 00000100:00100000:2.0:1783441340.134018:0:5779:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073693216896 00000100:00100000:2.0:1783441340.134025:0:5779:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073693216896 00000100:00100000:2.0:1783441340.134070:0:5779:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 45 00000100:00100000:2.0:1783441340.134080:0:5779:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a848f37050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6c1ddb50-5795-40c6-a2b6-8f58add9da62+11:5783:x1870073693216896:12345-0@lo:101: 00010000:00010000:2.0:1783441340.134094:0:5779:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1783441340.134106:0:5779:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff91a85f83cc00/0xa2426164df2c75d0 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0xa2426164df2c75c9 expref: -99 pid: 5779 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783441340.134127:0:5779:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff91a85f83cc00/0xa2426164df2c75d0 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xa2426164df2c75c9 expref: 12 pid: 5779 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783441340.134138:0:5779:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff91a85f83cc00/0xa2426164df2c75d0 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xa2426164df2c75c9 expref: 12 pid: 5779 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783441340.134147:0:5779:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91a85f83cc00, rc 0) 00000100:00100000:2.0:1783441340.134185:0:5779:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a848f37050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6c1ddb50-5795-40c6-a2b6-8f58add9da62+12:5783:x1870073693216896:12345-0@lo:101: Request processed in 106us (238us total) trans 0 rc 0/0 00000100:00100000:2.0:1783441340.134191:0:5779:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 45 00000100:00100000:2.0:1783441340.135398:0:5783:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff91a846f26680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6c1ddb50-5795-40c6-a2b6-8f58add9da62:5783:1870073693216896:0@lo:101: 00010000:00010000:2.0:1783441340.135419:0:5783:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.113@tcp lock: ffff91a85f83ce00/0xa2426164df2c75c9 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xa2426164df2c75d0 expref: -99 pid: 5783 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783441340.135429:0:5783:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.113@tcp lock: ffff91a85f83ce00/0xa2426164df2c75c9 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0xa2426164df2c75d0 expref: -99 pid: 5783 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783441340.135489:0:5783:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff91a846f26680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6c1ddb50-5795-40c6-a2b6-8f58add9da62:5783:1870073693217024:0@lo:501: 00000100:00100000:2.0:1783441340.135525:0:5783:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783441340.135554:0:5783:0:(client.c:2702:ptlrpc_set_wait()) set ffff91a8591db600 going to sleep for 11 seconds 00000100:00100000:0.0:1783441340.139347:0:5780:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073693217024 00000100:00100000:0.0:1783441340.139367:0:5780:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073693217024 00000100:00100000:0.0:1783441340.139436:0:5780:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 46 00000100:00100000:0.0:1783441340.139446:0:5780:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a848f34050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6c1ddb50-5795-40c6-a2b6-8f58add9da62+12:5783:x1870073693217024:12345-0@lo:501: 00000100:00100000:0.0:1783441340.139737:0:5780:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a848f34050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6c1ddb50-5795-40c6-a2b6-8f58add9da62+12:5783:x1870073693217024:12345-0@lo:501: Request processed in 291us (4210us total) trans 0 rc 0/0 00000100:00100000:0.0:1783441340.139759:0:5780:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 46 00000100:00100000:0.0:1783441340.139838:0:5783:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff91a846f26680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6c1ddb50-5795-40c6-a2b6-8f58add9da62:5783:1870073693217024:0@lo:501: 00000100:00100000:0.0:1783441340.139909:0:5783:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff91a8756a4a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6c1ddb50-5795-40c6-a2b6-8f58add9da62:5783:1870073693217152:0@lo:503: 00000100:00100000:0.0:1783441340.139957:0:5783:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783441340.139979:0:5783:0:(client.c:2702:ptlrpc_set_wait()) set ffff91a848f226c0 going to sleep for 11 seconds 00000100:00100000:3.0:1783441340.143771:0:5778:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073693217152 00000100:00100000:3.0:1783441340.143788:0:5778:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073693217152 00000100:00100000:3.0:1783441340.143933:0:5778:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 47 00000100:00100000:3.0:1783441340.143944:0:5778:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a848f34450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6c1ddb50-5795-40c6-a2b6-8f58add9da62+12:5783:x1870073693217152:12345-0@lo:503: 00000100:00100000:3.0:1783441340.144191:0:5778:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a848f34450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6c1ddb50-5795-40c6-a2b6-8f58add9da62+12:5783:x1870073693217152:12345-0@lo:503: Request processed in 248us (4233us total) trans 0 rc 0/0 00000100:00100000:3.0:1783441340.144199:0:5778:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 47 00000100:00100000:0.0:1783441340.150078:0:5783:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff91a8756a4a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6c1ddb50-5795-40c6-a2b6-8f58add9da62:5783:1870073693217152:0@lo:503: 00000100:00100000:1.0:1783441340.156086:0:6608:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff91a867cd5500 pname:cluuid:pid:xid:nid:opc:job llog_process_th:6c1ddb50-5795-40c6-a2b6-8f58add9da62:6608:1870073693217280:0@lo:502: 00000100:00100000:1.0:1783441340.156171:0:6608:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783441340.156450:0:6608:0:(client.c:2702:ptlrpc_set_wait()) set ffff91a843df4000 going to sleep for 11 seconds 00000100:00100000:2.0:1783441340.156505:0:5779:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073693217280 00000100:00100000:2.0:1783441340.156514:0:5779:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073693217280 00000100:00100000:2.0:1783441340.156606:0:5779:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 48 00000100:00100000:2.0:1783441340.156615:0:5779:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a848f37450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6c1ddb50-5795-40c6-a2b6-8f58add9da62+12:6608:x1870073693217280:12345-0@lo:502: 00000100:00100000:2.0:1783441340.156865:0:5779:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a848f37450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6c1ddb50-5795-40c6-a2b6-8f58add9da62+12:6608:x1870073693217280:12345-0@lo:502: Request processed in 250us (694us total) trans 0 rc 0/0 00000100:00100000:2.0:1783441340.156872:0:5779:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 48 00000100:00100000:1.0:1783441340.160305:0:6608:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff91a867cd5500 pname:cluuid:pid:xid:nid:opc:job llog_process_th:6c1ddb50-5795-40c6-a2b6-8f58add9da62:6608:1870073693217280:0@lo:502: 00000100:00100000:1.0:1783441340.160395:0:6608:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff91a867cd5500 pname:cluuid:pid:xid:nid:opc:job llog_process_th:6c1ddb50-5795-40c6-a2b6-8f58add9da62:6608:1870073693217408:0@lo:502: 00000100:00100000:1.0:1783441340.160476:0:6608:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783441340.164452:0:5778:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073693217408 00000100:00100000:0.0:1783441340.164470:0:5778:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073693217408 00000100:00100000:0.0:1783441340.164529:0:5778:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 49 00000100:00100000:0.0:1783441340.164546:0:5778:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a848f35c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6c1ddb50-5795-40c6-a2b6-8f58add9da62+12:6608:x1870073693217408:12345-0@lo:502: 00000100:00100000:0.0:1783441340.164843:0:5778:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a848f35c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6c1ddb50-5795-40c6-a2b6-8f58add9da62+12:6608:x1870073693217408:12345-0@lo:502: Request processed in 298us (4367us total) trans 0 rc 0/0 00000100:00100000:0.0:1783441340.164852:0:5778:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 49 00000100:00100000:1.0:1783441340.166602:0:6608:0:(client.c:2702:ptlrpc_set_wait()) set ffff91a843df4000 going to sleep for 11 seconds 00000100:00100000:1.0:1783441340.166643:0:6608:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff91a867cd5500 pname:cluuid:pid:xid:nid:opc:job llog_process_th:6c1ddb50-5795-40c6-a2b6-8f58add9da62:6608:1870073693217408:0@lo:502: 00000040:00080000:1.0:1783441340.166685:0:6608:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 30 count 30 00000020:01000000:2.0:1783441340.166900:0:5783:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 21-29 (rc=0) 10000000:01000000:2.0:1783441340.166921:0:5783:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.201.113@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:2.0:1783441340.166932:0:5783:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.113@tcp lock: ffff91a85f83ce00/0xa2426164df2c75c9 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xa2426164df2c75d0 expref: -99 pid: 5783 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783441340.166943:0:5783:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.113@tcp lock: ffff91a85f83ce00/0xa2426164df2c75c9 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xa2426164df2c75d0 expref: -99 pid: 5783 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1783441340.166953:0:5783:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:2.0:1783441340.166955:0:5783:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-mdtir-ffff91a84869e800 from 4 10000000:01000000:2.0:1783441340.166958:0:5783:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:2.0:1783441340.166992:0:5783:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.113@tcp lock: ffff91a85f83c400/0xa2426164df2c75d7 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5783 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783441340.167000:0:5783:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.113@tcp lock: ffff91a85f83c400/0xa2426164df2c75d7 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5783 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783441340.167010:0:5783:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.113@tcp lock: ffff91a85f83c400/0xa2426164df2c75d7 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5783 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783441340.167028:0:5783:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff91a846f27b80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6c1ddb50-5795-40c6-a2b6-8f58add9da62:5783:1870073693217536:0@lo:101: 00000100:00100000:2.0:1783441340.167087:0:5783:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783441340.167112:0:5783:0:(client.c:2702:ptlrpc_set_wait()) set ffff91a8591db780 going to sleep for 11 seconds 00000100:00100000:2.0:1783441340.167136:0:5778:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073693217536 00000100:00100000:2.0:1783441340.167142:0:5778:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073693217536 00000100:00100000:2.0:1783441340.167172:0:5778:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 50 00000100:00100000:2.0:1783441340.167178:0:5778:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a848f35050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6c1ddb50-5795-40c6-a2b6-8f58add9da62+12:5783:x1870073693217536:12345-0@lo:101: 00010000:00010000:2.0:1783441340.167190:0:5778:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1783441340.167200:0:5778:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff91a85f83d800/0xa2426164df2c75de lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xa2426164df2c75d7 expref: -99 pid: 5778 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783441340.167287:0:5778:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff91a85f83d800/0xa2426164df2c75de lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xa2426164df2c75d7 expref: 13 pid: 5778 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783441340.167298:0:5778:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff91a85f83d800/0xa2426164df2c75de lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xa2426164df2c75d7 expref: 13 pid: 5778 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783441340.167307:0:5778:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91a85f83d800, rc 0) 00000100:00100000:2.0:1783441340.167338:0:5778:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a848f35050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6c1ddb50-5795-40c6-a2b6-8f58add9da62+13:5783:x1870073693217536:12345-0@lo:101: Request processed in 159us (252us total) trans 0 rc 0/0 00000100:00100000:2.0:1783441340.167344:0:5778:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 50 00000100:00100000:2.0:1783441340.167385:0:5783:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff91a846f27b80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6c1ddb50-5795-40c6-a2b6-8f58add9da62:5783:1870073693217536:0@lo:101: 00010000:00010000:2.0:1783441340.167395:0:5783:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.113@tcp lock: ffff91a85f83c400/0xa2426164df2c75d7 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xa2426164df2c75de expref: -99 pid: 5783 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783441340.167404:0:5783:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.113@tcp lock: ffff91a85f83c400/0xa2426164df2c75d7 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xa2426164df2c75de expref: -99 pid: 5783 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783441340.167441:0:5783:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff91a846f27b80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6c1ddb50-5795-40c6-a2b6-8f58add9da62:5783:1870073693217664:0@lo:256: 00000100:00100000:2.0:1783441340.167465:0:5783:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783441340.167476:0:5783:0:(client.c:2702:ptlrpc_set_wait()) set ffff91a8591db780 going to sleep for 11 seconds 00000100:00100000:1.0:1783441340.167566:0:5780:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073693217664 00000100:00100000:1.0:1783441340.167570:0:5780:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073693217664 00000100:00100000:1.0:1783441340.167602:0:5780:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 51 00000100:00100000:1.0:1783441340.167607:0:5780:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a848f34c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6c1ddb50-5795-40c6-a2b6-8f58add9da62+13:5783:x1870073693217664:12345-0@lo:256: 20000000:01000000:1.0:1783441340.167620:0:5780:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:1.0:1783441340.167635:0:5780:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:1.0:1783441340.167638:0:5780:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 4 00000100:00100000:1.0:1783441340.167715:0:5780:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a848f34c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6c1ddb50-5795-40c6-a2b6-8f58add9da62+13:5783:x1870073693217664:12345-0@lo:256: Request processed in 107us (248us total) trans 0 rc 0/0 00000100:00100000:1.0:1783441340.167721:0:5780:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 51 00000100:00100000:1.0:1783441340.167778:0:5783:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff91a846f27b80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6c1ddb50-5795-40c6-a2b6-8f58add9da62:5783:1870073693217664:0@lo:256: 10000000:01000000:1.0:1783441340.167955:0:5783:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.201.113@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:1.0:1783441340.167960:0:5783:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.113@tcp lock: ffff91a85f83c400/0xa2426164df2c75d7 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xa2426164df2c75de expref: -99 pid: 5783 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783441340.167967:0:5783:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.113@tcp lock: ffff91a85f83c400/0xa2426164df2c75d7 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xa2426164df2c75de expref: -99 pid: 5783 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1783441340.167974:0:5783:0:(mgc_request.c:611:do_requeue()) updating log lustre-MDT0000 10000000:01000000:1.0:1783441340.167975:0:5783:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-MDT0000-0000000000000000 from 16 10000000:01000000:1.0:1783441340.167978:0:5783:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0000 (res 0x65727473756c) 00010000:00010000:1.0:1783441340.167993:0:5783:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.113@tcp lock: ffff91a841476e00/0xa2426164df2c75e5 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5783 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783441340.167999:0:5783:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.113@tcp lock: ffff91a841476e00/0xa2426164df2c75e5 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5783 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783441340.168006:0:5783:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.113@tcp lock: ffff91a841476e00/0xa2426164df2c75e5 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5783 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783441340.168018:0:5783:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff91a867cd5500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6c1ddb50-5795-40c6-a2b6-8f58add9da62:5783:1870073693217792:0@lo:101: 00000100:00100000:1.0:1783441340.168050:0:5783:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783441340.168078:0:5783:0:(client.c:2702:ptlrpc_set_wait()) set ffff91a843df46c0 going to sleep for 11 seconds 00000100:00100000:2.0:1783441340.168905:0:5779:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073693217792 00000100:00100000:2.0:1783441340.168920:0:5779:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073693217792 00000100:00100000:2.0:1783441340.168951:0:5779:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 52 00000100:00100000:2.0:1783441340.168958:0:5779:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a8655e5450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6c1ddb50-5795-40c6-a2b6-8f58add9da62+13:5783:x1870073693217792:12345-0@lo:101: 00010000:00010000:2.0:1783441340.168970:0:5779:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1783441340.168982:0:5779:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff91a85f83d000/0xa2426164df2c75ec lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0xa2426164df2c75e5 expref: -99 pid: 5779 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783441340.169002:0:5779:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff91a85f83d000/0xa2426164df2c75ec lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xa2426164df2c75e5 expref: 14 pid: 5779 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783441340.169011:0:5779:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff91a85f83d000/0xa2426164df2c75ec lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xa2426164df2c75e5 expref: 14 pid: 5779 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783441340.169019:0:5779:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91a85f83d000, rc 0) 00000100:00100000:2.0:1783441340.169056:0:5779:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a8655e5450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6c1ddb50-5795-40c6-a2b6-8f58add9da62+14:5783:x1870073693217792:12345-0@lo:101: Request processed in 99us (1006us total) trans 0 rc 0/0 00000100:00100000:2.0:1783441340.169061:0:5779:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 52 00000100:00100000:1.0:1783441340.169957:0:5783:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff91a867cd5500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6c1ddb50-5795-40c6-a2b6-8f58add9da62:5783:1870073693217792:0@lo:101: 00010000:00010000:1.0:1783441340.169978:0:5783:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.113@tcp lock: ffff91a841476e00/0xa2426164df2c75e5 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xa2426164df2c75ec expref: -99 pid: 5783 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783441340.169988:0:5783:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.113@tcp lock: ffff91a841476e00/0xa2426164df2c75e5 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0xa2426164df2c75ec expref: -99 pid: 5783 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783441340.170059:0:5783:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff91a867cd5500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6c1ddb50-5795-40c6-a2b6-8f58add9da62:5783:1870073693217920:0@lo:501: 00000100:00100000:1.0:1783441340.170095:0:5783:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783441340.170127:0:5783:0:(client.c:2702:ptlrpc_set_wait()) set ffff91a843df46c0 going to sleep for 11 seconds 00000100:00100000:1.0:1783441340.170141:0:5778:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073693217920 00000100:00100000:1.0:1783441340.170145:0:5778:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073693217920 00000100:00100000:1.0:1783441340.170173:0:5778:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 53 00000100:00100000:1.0:1783441340.170180:0:5778:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a8655e5850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6c1ddb50-5795-40c6-a2b6-8f58add9da62+14:5783:x1870073693217920:12345-0@lo:501: 00000100:00100000:1.0:1783441340.172408:0:5778:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a8655e5850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6c1ddb50-5795-40c6-a2b6-8f58add9da62+14:5783:x1870073693217920:12345-0@lo:501: Request processed in 2214us (2298us total) trans 0 rc 0/0 00000100:00100000:1.0:1783441340.172424:0:5778:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 53 00000100:00100000:1.0:1783441340.172520:0:5783:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff91a867cd5500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6c1ddb50-5795-40c6-a2b6-8f58add9da62:5783:1870073693217920:0@lo:501: 00000100:00100000:1.0:1783441340.172572:0:5783:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff91a867cd5500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6c1ddb50-5795-40c6-a2b6-8f58add9da62:5783:1870073693218048:0@lo:503: 00000100:00100000:1.0:1783441340.172626:0:5783:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783441340.172653:0:5783:0:(client.c:2702:ptlrpc_set_wait()) set ffff91a843df46c0 going to sleep for 11 seconds 00000100:00100000:1.0:1783441340.172669:0:5780:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073693218048 00000100:00100000:1.0:1783441340.172675:0:5780:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073693218048 00000100:00100000:1.0:1783441340.172715:0:5780:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 54 00000100:00100000:1.0:1783441340.172723:0:5780:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a8655e7050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6c1ddb50-5795-40c6-a2b6-8f58add9da62+14:5783:x1870073693218048:12345-0@lo:503: 00000100:00100000:1.0:1783441340.174548:0:5780:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a8655e7050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6c1ddb50-5795-40c6-a2b6-8f58add9da62+14:5783:x1870073693218048:12345-0@lo:503: Request processed in 1816us (1913us total) trans 0 rc 0/0 00000100:00100000:1.0:1783441340.174560:0:5780:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 54 00000100:00100000:1.0:1783441340.174635:0:5783:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff91a867cd5500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6c1ddb50-5795-40c6-a2b6-8f58add9da62:5783:1870073693218048:0@lo:503: 00000100:00100000:1.0:1783441340.188096:0:6609:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff91a867cd5500 pname:cluuid:pid:xid:nid:opc:job llog_process_th:6c1ddb50-5795-40c6-a2b6-8f58add9da62:6609:1870073693218176:0@lo:502: 00000100:00100000:1.0:1783441340.188176:0:6609:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783441340.188213:0:5779:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073693218176 00000100:00100000:1.0:1783441340.188219:0:5779:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073693218176 00000100:00100000:1.0:1783441340.190421:0:5779:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 55 00000100:00100000:1.0:1783441340.190433:0:5779:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a8655e4050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6c1ddb50-5795-40c6-a2b6-8f58add9da62+14:6609:x1870073693218176:12345-0@lo:502: 00000100:00100000:1.0:1783441340.190715:0:5779:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a8655e4050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6c1ddb50-5795-40c6-a2b6-8f58add9da62+14:6609:x1870073693218176:12345-0@lo:502: Request processed in 282us (2538us total) trans 0 rc 0/0 00000100:00100000:1.0:1783441340.190723:0:5779:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 55 00000100:00100000:1.0:1783441340.204778:0:6609:0:(client.c:2702:ptlrpc_set_wait()) set ffff91a843df4900 going to sleep for 11 seconds 00000100:00100000:1.0:1783441340.204821:0:6609:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff91a867cd5500 pname:cluuid:pid:xid:nid:opc:job llog_process_th:6c1ddb50-5795-40c6-a2b6-8f58add9da62:6609:1870073693218176:0@lo:502: 00000020:01000000:1.0:1783441340.204857:0:6609:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:1.0:1783441340.204865:0:6609:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0000 (0) in 0 of lustre-mdt1/mdt1 00000020:00000080:1.0:1783441340.204871:0:6609:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1783441340.204873:0:6609:0:(obd_config.c:1561:class_process_config()) marker 12 (0x1) lustre-OST0000 add osc 00000020:00000080:1.0:1783441340.204890:0:6609:0:(obd_config.c:1470:class_process_config()) processing cmd: cf005 00000020:00000080:1.0:1783441340.204894:0:6609:0:(obd_config.c:1485:class_process_config()) adding mapping from uuid 192.168.201.113@tcp to nid 0x20000c0a8c971 (192.168.201.113@tcp) 00000020:01000000:1.0:1783441340.204918:0:6609:0:(obd_config.c:1975:class_config_llog_handler()) For 2.x interoperability, rename obd type from osc to osp (lustre-MDT0000) 00000020:00000080:1.0:1783441340.204920:0:6609:0:(obd_config.c:1470:class_process_config()) processing cmd: cf001 00000020:00000080:1.0:1783441340.204935:0:6609:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000-osc-MDT0000 (ffff91a850218000) 00000020:00000080:1.0:1783441340.204957:0:6609:0:(obd_config.c:720:class_attach_name()) OBD: dev 13 attached type osp with refcount 2 00000020:00000080:1.0:1783441340.204964:0:6609:0:(obd_config.c:1470:class_process_config()) processing cmd: cf003 00000004:00080000:1.0:1783441340.205056:0:6609:0:(osp_dev.c:1203:osp_init0()) lustre-OST0000-osc-MDT0000: connect to lustre-MDT0000-osd (lustre-OST0000-osc-MDT0000) 00080000:01000000:1.0:1783441340.205066:0:6609:0:(osd_handler.c:1569:osd_obd_connect()) connect #5 00000020:00000080:1.0:1783441340.205073:0:6609:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0xa2426164df2c75fa 00010000:00080000:1.0:1783441340.205103:0:6609:0:(ldlm_lib.c:102:import_set_conn()) imp ffff91a7466c7800@lustre-OST0000-osc-MDT0000: add connection 192.168.201.113@tcp at head 00010000:00010000:1.0:1783441340.210121:0:6609:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-lustre-OST0000-osc-MDT0000-3 is initialized 00000040:01000000:1.0:1783441340.259432:0:6609:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=0, read=32 00000040:01000000:1.0:1783441340.259462:0:6609:0:(llog_obd.c:197:llog_setup()) obd lustre-OST0000-osc-MDT0000 ctxt 2 is initialized 00000040:00080000:1.0:1783441340.260036:0:6609:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1783441340.260206:0:6609:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1783441340.260272:0:6609:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x2:0x0].1, 64 off8256 00000040:00080000:1.0:1783441340.260331:0:6609:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].1, 64 off8256 00000040:00080000:1.0:1783441340.261050:0:6610:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:1.0:1783441340.261056:0:6610:0:(llog_cat.c:841:llog_cat_process_common()) processing log [0x1:0x3:0x0] at index 1 of catalog [0x1:0x2:0x0] 00000020:00000080:1.0:1783441340.265316:0:6609:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:1.0:1783441340.265331:0:6609:0:(obd_config.c:1470:class_process_config()) processing cmd: cf00d 00000004:01000000:1.0:1783441340.265372:0:6609:0:(lod_lov.c:128:lod_add_device()) osp:lustre-OST0000_UUID idx:0 gen:1 00000020:00000080:1.0:1783441340.265394:0:6609:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0xa2426164df2c7601 00000100:00080000:1.0:1783441340.265406:0:6609:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:1.0:1783441340.265412:0:6609:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-MDT0000: import ffff91a7466c7800 using connection 192.168.201.113@tcp/0@lo 00000100:00100000:1.0:1783441340.265445:0:6609:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff91a867cd5500 x1870073693218304/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1783441340.265463:0:6609:0:(pinger.c:374:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID 00000020:01000000:1.0:1783441340.265524:0:6609:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1783441340.265529:0:6609:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1783441340.265531:0:6609:0:(obd_config.c:1561:class_process_config()) marker 12 (0x2) lustre-OST0000 add osc 00000020:01000000:1.0:1783441340.265533:0:6609:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1783441340.265538:0:6609:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1783441340.265539:0:6609:0:(obd_config.c:1561:class_process_config()) marker 16 (0x1) lustre sys.timeout 00000020:00000080:1.0:1783441340.265542:0:6609:0:(obd_config.c:1470:class_process_config()) processing cmd: cf009 00000020:00000080:1.0:1783441340.265543:0:6609:0:(obd_config.c:1535:class_process_config()) changing lustre timeout from 20 to 20 00000100:00100000:1.0:1783441340.265572:0:6609:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff91a867cd7480 pname:cluuid:pid:xid:nid:opc:job llog_process_th:6c1ddb50-5795-40c6-a2b6-8f58add9da62:6609:1870073693218432:0@lo:502: 00000100:00100000:1.0:1783441340.265656:0:6609:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783441340.265704:0:6609:0:(client.c:2702:ptlrpc_set_wait()) set ffff91a843df49c0 going to sleep for 11 seconds 00000100:00100000:1.0:1783441340.265964:0:5778:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073693218432 00000100:00100000:1.0:1783441340.265972:0:5778:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073693218432 00000100:00100000:1.0:1783441340.266010:0:5778:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 56 00000100:00100000:1.0:1783441340.266020:0:5778:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a8655e4450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6c1ddb50-5795-40c6-a2b6-8f58add9da62+14:6609:x1870073693218432:12345-0@lo:502: 00000100:00100000:1.0:1783441340.266316:0:5778:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a8655e4450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6c1ddb50-5795-40c6-a2b6-8f58add9da62+14:6609:x1870073693218432:12345-0@lo:502: Request processed in 297us (659us total) trans 0 rc 0/0 00000100:00100000:1.0:1783441340.266336:0:5778:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 56 00000100:00100000:1.0:1783441340.266382:0:3304:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff91a867cd5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3304:1870073693218560:0@lo:400: 00000100:00100000:1.0:1783441340.266410:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783441340.266444:0:3305:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff91a867cd6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3305:1870073693218688:0@lo:400: 00000100:00100000:1.0:1783441340.266468:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783441340.266512:0:6609:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff91a867cd7480 pname:cluuid:pid:xid:nid:opc:job llog_process_th:6c1ddb50-5795-40c6-a2b6-8f58add9da62:6609:1870073693218432:0@lo:502: 00000020:01000000:1.0:1783441340.266538:0:6609:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1783441340.266544:0:6609:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1783441340.266545:0:6609:0:(obd_config.c:1561:class_process_config()) marker 16 (0x2) lustre sys.timeout 00000040:00080000:1.0:1783441340.266550:0:6609:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 25 count 25 00000100:00100000:1.0:1783441340.266656:0:5787:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073693218560 00000100:00100000:1.0:1783441340.266660:0:5787:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073693218560 00000100:00100000:1.0:1783441340.266683:0:5787:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073693218688 00000100:00100000:1.0:1783441340.266686:0:5787:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073693218688 00000100:00100000:1.0:1783441340.266713:0:5787:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1783441340.266719:0:5787:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a867cd7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3304:x1870073693218560:12345-0@lo:400: 00000100:00100000:1.0:1783441340.266780:0:5787:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a867cd7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3304:x1870073693218560:12345-0@lo:400: Request processed in 60us (369us total) trans 0 rc 0/0 00000100:00100000:1.0:1783441340.266786:0:5787:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1783441340.267121:0:5787:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:1.0:1783441340.267129:0:5787:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a867cd5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3305:x1870073693218688:12345-0@lo:400: 00000100:00100000:1.0:1783441340.267202:0:5787:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a867cd5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3305:x1870073693218688:12345-0@lo:400: Request processed in 74us (733us total) trans 0 rc 0/0 00000100:00100000:1.0:1783441340.267208:0:5787:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000020:01000000:1.0:1783441340.267237:0:5783:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0000 gen 16-24 (rc=0) 10000000:01000000:1.0:1783441340.267251:0:5783:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.201.113@tcp: configuration from log 'lustre-MDT0000' succeeded (0). 00010000:00010000:1.0:1783441340.267259:0:5783:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.113@tcp lock: ffff91a841476e00/0xa2426164df2c75e5 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xa2426164df2c75ec expref: -99 pid: 5783 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783441340.267270:0:5783:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.113@tcp lock: ffff91a841476e00/0xa2426164df2c75e5 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xa2426164df2c75ec expref: -99 pid: 5783 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1783441340.267279:0:5783:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:1.0:1783441340.267282:0:5783:0:(mgc_request.c:1801:mgc_process_log()) Process log params-ffff91a84869e800 from 1 10000000:01000000:1.0:1783441340.267284:0:5783:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:1.0:1783441340.267307:0:5783:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.113@tcp lock: ffff91a841477800/0xa2426164df2c7608 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5783 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783441340.267314:0:5783:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.113@tcp lock: ffff91a841477800/0xa2426164df2c7608 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5783 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783441340.267323:0:5783:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.113@tcp lock: ffff91a841477800/0xa2426164df2c7608 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5783 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783441340.267335:0:5783:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff91a867cd7480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6c1ddb50-5795-40c6-a2b6-8f58add9da62:5783:1870073693218816:0@lo:101: 00000100:00100000:1.0:1783441340.267359:0:5783:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783441340.267379:0:5783:0:(client.c:2702:ptlrpc_set_wait()) set ffff91a843df49c0 going to sleep for 11 seconds 00000100:00080000:1.0:1783441340.267390:0:5781:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:1.0:1783441340.267411:0:3304:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@ffff91a867cd5880 x1870073693218560/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1783441356 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1783441340.267428:0:3304:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff91a867cd5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3304:1870073693218560:0@lo:400: 00000100:00100000:1.0:1783441340.267448:0:5780:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073693218816 00000100:00100000:1.0:1783441340.267451:0:5780:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073693218816 00000100:00100000:1.0:1783441340.267471:0:5780:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 57 00000100:00100000:1.0:1783441340.267476:0:5780:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a8655e7450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6c1ddb50-5795-40c6-a2b6-8f58add9da62+14:5783:x1870073693218816:12345-0@lo:101: 00010000:00010000:1.0:1783441340.267483:0:5780:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1783441340.267494:0:5780:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff91a841476800/0xa2426164df2c760f lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xa2426164df2c7608 expref: -99 pid: 5780 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783441340.267514:0:5780:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff91a841476800/0xa2426164df2c760f lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xa2426164df2c7608 expref: 15 pid: 5780 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783441340.267524:0:5780:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff91a841476800/0xa2426164df2c760f lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xa2426164df2c7608 expref: 15 pid: 5780 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783441340.267533:0:5780:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91a841476800, rc 0) 00000100:00100000:1.0:1783441340.267559:0:5780:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a8655e7450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6c1ddb50-5795-40c6-a2b6-8f58add9da62+15:5783:x1870073693218816:12345-0@lo:101: Request processed in 82us (199us total) trans 0 rc 0/0 00000100:00100000:1.0:1783441340.267564:0:5780:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 57 00000100:00100000:1.0:1783441340.267589:0:5783:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff91a867cd7480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6c1ddb50-5795-40c6-a2b6-8f58add9da62:5783:1870073693218816:0@lo:101: 00010000:00010000:1.0:1783441340.267599:0:5783:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.113@tcp lock: ffff91a841477800/0xa2426164df2c7608 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xa2426164df2c760f expref: -99 pid: 5783 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783441340.267606:0:5783:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.113@tcp lock: ffff91a841477800/0xa2426164df2c7608 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xa2426164df2c760f expref: -99 pid: 5783 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783441340.267640:0:5783:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff91a867cd7480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6c1ddb50-5795-40c6-a2b6-8f58add9da62:5783:1870073693218944:0@lo:501: 00000100:00100000:1.0:1783441340.267666:0:5783:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783441340.267678:0:5783:0:(client.c:2702:ptlrpc_set_wait()) set ffff91a843df49c0 going to sleep for 11 seconds 00000100:00100000:1.0:1783441340.267688:0:5779:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073693218944 00000100:00100000:1.0:1783441340.267692:0:5779:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073693218944 00000100:00100000:1.0:1783441340.267709:0:5779:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 58 00000100:00100000:1.0:1783441340.267715:0:5779:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a8655e5c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6c1ddb50-5795-40c6-a2b6-8f58add9da62+15:5783:x1870073693218944:12345-0@lo:501: 00000100:00100000:3.0:1783441340.268027:0:3302:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff91a867cd5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3302:1870073693218304:0@lo:8: 00000100:00100000:3.0:1783441340.268061:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783441340.269021:0:5779:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a8655e5c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6c1ddb50-5795-40c6-a2b6-8f58add9da62+15:5783:x1870073693218944:12345-0@lo:501: Request processed in 1302us (1350us total) trans 0 rc 0/0 00000100:00100000:1.0:1783441340.269030:0:5779:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 58 00000100:00100000:1.0:1783441340.269077:0:5783:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff91a867cd7480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6c1ddb50-5795-40c6-a2b6-8f58add9da62:5783:1870073693218944:0@lo:501: 00000100:00100000:1.0:1783441340.269109:0:5783:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff91a867cd7480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6c1ddb50-5795-40c6-a2b6-8f58add9da62:5783:1870073693219072:0@lo:503: 00000100:00100000:1.0:1783441340.269148:0:5783:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783441340.269172:0:5783:0:(client.c:2702:ptlrpc_set_wait()) set ffff91a848f25480 going to sleep for 11 seconds 00000100:00100000:1.0:1783441340.269186:0:5778:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073693219072 00000100:00100000:1.0:1783441340.269190:0:5778:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073693219072 00000100:00100000:1.0:1783441340.269215:0:5778:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 59 00000100:00100000:0.0:1783441340.269681:0:6581:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073693218304 00000100:00100000:0.0:1783441340.269687:0:6581:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073693218304 00000100:00100000:0.0:1783441340.269712:0:6581:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1783441340.269717:0:6581:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a875690380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:3302:x1870073693218304:12345-0@lo:8: 00000100:00100000:0.0:1783441340.269795:0:6581:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a875690380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:3302:x1870073693218304:12345-0@lo:8: Request processed in 77us (1732us total) trans 0 rc -11/-11 00000100:00100000:0.0:1783441340.269808:0:6581:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1783441340.269851:0:3302:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:0.0:1783441340.269857:0:3302:0:(import.c:65:import_set_state_nolock()) ffff91a7466c7800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1783441340.269862:0:3302:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 0@lo failed (-11) 00000100:00100000:0.0:1783441340.269865:0:3302:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff91a867cd5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3302:1870073693218304:0@lo:8: 00000100:00100000:1.0:1783441340.270155:0:5778:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a8655e5050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6c1ddb50-5795-40c6-a2b6-8f58add9da62+15:5783:x1870073693219072:12345-0@lo:503: 00000100:00100000:1.0:1783441340.273515:0:5778:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a8655e5050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6c1ddb50-5795-40c6-a2b6-8f58add9da62+15:5783:x1870073693219072:12345-0@lo:503: Request processed in 3354us (4356us total) trans 0 rc 0/0 00000100:00100000:1.0:1783441340.273531:0:5778:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 59 00000100:00100000:1.0:1783441340.273608:0:5783:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff91a867cd7480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6c1ddb50-5795-40c6-a2b6-8f58add9da62:5783:1870073693219072:0@lo:503: 00000100:00100000:1.0:1783441340.274162:0:6612:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff91a867cd7480 pname:cluuid:pid:xid:nid:opc:job llog_process_th:6c1ddb50-5795-40c6-a2b6-8f58add9da62:6612:1870073693219200:0@lo:502: 00000100:00100000:1.0:1783441340.274217:0:6612:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783441340.274634:0:6612:0:(client.c:2702:ptlrpc_set_wait()) set ffff91a843df49c0 going to sleep for 11 seconds 00010000:00080000:2.0:1783441340.274722:0:3305:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@ffff91a867cd6680 x1870073693218688/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1783441356 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1783441340.274760:0:3305:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff91a867cd6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3305:1870073693218688:0@lo:400: 00000100:00100000:0.0:1783441340.275090:0:5780:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073693219200 00000100:00100000:0.0:1783441340.275098:0:5780:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073693219200 00000100:00100000:0.0:1783441340.275142:0:5780:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 60 00000100:00100000:0.0:1783441340.275150:0:5780:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a8655e4c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6c1ddb50-5795-40c6-a2b6-8f58add9da62+15:6612:x1870073693219200:12345-0@lo:502: 00000100:00100000:0.0:1783441340.276032:0:5780:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a8655e4c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6c1ddb50-5795-40c6-a2b6-8f58add9da62+15:6612:x1870073693219200:12345-0@lo:502: Request processed in 879us (1811us total) trans 0 rc 0/0 00000100:00100000:0.0:1783441340.276042:0:5780:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 60 00000100:00100000:1.0:1783441340.276193:0:6612:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff91a867cd7480 pname:cluuid:pid:xid:nid:opc:job llog_process_th:6c1ddb50-5795-40c6-a2b6-8f58add9da62:6612:1870073693219200:0@lo:502: 00000020:01000000:1.0:1783441340.276302:0:6612:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1783441340.276313:0:6612:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1783441340.276315:0:6612:0:(obd_config.c:1561:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:1.0:1783441340.276322:0:6612:0:(obd_config.c:2005:class_config_llog_handler()) cmd ce032, instance name: general-ffff91a84869e800 00000020:00000080:1.0:1783441340.276325:0:6612:0:(obd_config.c:1470:class_process_config()) processing cmd: ce032 00000100:00100000:1.0:1783441340.276358:0:6612:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff91a867cd7480 pname:cluuid:pid:xid:nid:opc:job llog_process_th:6c1ddb50-5795-40c6-a2b6-8f58add9da62:6612:1870073693219328:0@lo:502: 00000100:00100000:1.0:1783441340.276396:0:6612:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783441340.276421:0:6612:0:(client.c:2702:ptlrpc_set_wait()) set ffff91a85fed43c0 going to sleep for 11 seconds 00000100:00100000:2.0:1783441340.276475:0:5778:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073693219328 00000100:00100000:2.0:1783441340.276481:0:5778:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073693219328 00000100:00100000:2.0:1783441340.276518:0:5778:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 61 00000100:00100000:2.0:1783441340.276526:0:5778:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a8655e4850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6c1ddb50-5795-40c6-a2b6-8f58add9da62+15:6612:x1870073693219328:12345-0@lo:502: 00000100:00100000:2.0:1783441340.276669:0:5778:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a8655e4850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6c1ddb50-5795-40c6-a2b6-8f58add9da62+15:6612:x1870073693219328:12345-0@lo:502: Request processed in 143us (273us total) trans 0 rc 0/0 00000100:00100000:2.0:1783441340.276676:0:5778:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 61 00000100:00100000:3.0:1783441340.276773:0:6612:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff91a867cd7480 pname:cluuid:pid:xid:nid:opc:job llog_process_th:6c1ddb50-5795-40c6-a2b6-8f58add9da62:6612:1870073693219328:0@lo:502: 00000020:01000000:3.0:1783441340.276793:0:6612:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1783441340.276797:0:6612:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1783441340.277199:0:6612:0:(obd_config.c:1561:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000040:00080000:3.0:1783441340.277203:0:6612:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 4 count 4 00000020:01000000:1.0:1783441340.277494:0:5783:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-3 (rc=0) 10000000:01000000:1.0:1783441340.277515:0:5783:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.201.113@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:1.0:1783441340.277526:0:5783:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.113@tcp lock: ffff91a841477800/0xa2426164df2c7608 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xa2426164df2c760f expref: -99 pid: 5783 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783441340.277536:0:5783:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.113@tcp lock: ffff91a841477800/0xa2426164df2c7608 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xa2426164df2c760f expref: -99 pid: 5783 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1783441340.277547:0:5783:0:(mgc_request.c:611:do_requeue()) updating log lustre-sptlrpc 10000000:01000000:1.0:1783441340.277549:0:5783:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-sptlrpc-ffff91a84767cd40 from 1 10000000:01000000:1.0:1783441340.277552:0:5783:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:1.0:1783441340.277580:0:5783:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.113@tcp lock: ffff91a841476400/0xa2426164df2c7616 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5783 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783441340.277588:0:5783:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.113@tcp lock: ffff91a841476400/0xa2426164df2c7616 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5783 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783441340.277597:0:5783:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.113@tcp lock: ffff91a841476400/0xa2426164df2c7616 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5783 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783441340.277612:0:5783:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff91a867cd5880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6c1ddb50-5795-40c6-a2b6-8f58add9da62:5783:1870073693219456:0@lo:101: 00000100:00100000:1.0:1783441340.277647:0:5783:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783441340.277687:0:5783:0:(client.c:2702:ptlrpc_set_wait()) set ffff91a843df49c0 going to sleep for 11 seconds 00000100:00100000:2.0:1783441340.277733:0:5780:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073693219456 00000100:00100000:2.0:1783441340.277783:0:5780:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073693219456 00000100:00100000:2.0:1783441340.277937:0:5780:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 62 00000100:00100000:2.0:1783441340.277945:0:5780:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a8655e6450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6c1ddb50-5795-40c6-a2b6-8f58add9da62+15:5783:x1870073693219456:12345-0@lo:101: 00010000:00010000:2.0:1783441340.277955:0:5780:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1783441340.277966:0:5780:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff91a85f83d600/0xa2426164df2c761d lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0xa2426164df2c7616 expref: -99 pid: 5780 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783441340.277986:0:5780:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff91a85f83d600/0xa2426164df2c761d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xa2426164df2c7616 expref: 16 pid: 5780 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783441340.277996:0:5780:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff91a85f83d600/0xa2426164df2c761d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xa2426164df2c7616 expref: 16 pid: 5780 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783441340.278004:0:5780:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91a85f83d600, rc 0) 00000100:00100000:2.0:1783441340.278041:0:5780:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a8655e6450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6c1ddb50-5795-40c6-a2b6-8f58add9da62+16:5783:x1870073693219456:12345-0@lo:101: Request processed in 98us (394us total) trans 0 rc 0/0 00000100:00100000:2.0:1783441340.278046:0:5780:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 62 00000100:00100000:2.0:1783441340.278927:0:5783:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff91a867cd5880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6c1ddb50-5795-40c6-a2b6-8f58add9da62:5783:1870073693219456:0@lo:101: 00010000:00010000:2.0:1783441340.278944:0:5783:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.113@tcp lock: ffff91a841476400/0xa2426164df2c7616 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xa2426164df2c761d expref: -99 pid: 5783 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783441340.278954:0:5783:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.113@tcp lock: ffff91a841476400/0xa2426164df2c7616 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0xa2426164df2c761d expref: -99 pid: 5783 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783441340.279013:0:5783:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff91a846f25180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6c1ddb50-5795-40c6-a2b6-8f58add9da62:5783:1870073693219584:0@lo:501: 00000100:00100000:2.0:1783441340.279049:0:5783:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783441340.279081:0:5783:0:(client.c:2702:ptlrpc_set_wait()) set ffff91a84867d480 going to sleep for 11 seconds 00000100:00100000:3.0:1783441340.279642:0:5779:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073693219584 00000100:00100000:3.0:1783441340.279649:0:5779:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073693219584 00000100:00100000:3.0:1783441340.279683:0:5779:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 63 00000100:00100000:3.0:1783441340.279691:0:5779:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a8655e6c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6c1ddb50-5795-40c6-a2b6-8f58add9da62+16:5783:x1870073693219584:12345-0@lo:501: 00000100:00100000:3.0:1783441340.279935:0:5779:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a8655e6c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6c1ddb50-5795-40c6-a2b6-8f58add9da62+16:5783:x1870073693219584:12345-0@lo:501: Request processed in 243us (883us total) trans 0 rc -2/-2 00000100:00100000:3.0:1783441340.279943:0:5779:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 63 00000100:00100000:3.0:1783441340.279983:0:5783:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff91a846f25180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6c1ddb50-5795-40c6-a2b6-8f58add9da62:5783:1870073693219584:0@lo:501: 10000000:01000000:3.0:1783441340.280011:0:5783:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.201.113@tcp: configuration from log 'lustre-sptlrpc' failed (-2). 00010000:00010000:3.0:1783441340.280018:0:5783:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.113@tcp lock: ffff91a841476400/0xa2426164df2c7616 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xa2426164df2c761d expref: -99 pid: 5783 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783441340.280027:0:5783:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.113@tcp lock: ffff91a841476400/0xa2426164df2c7616 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xa2426164df2c761d expref: -99 pid: 5783 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00080000:2.0:1783441340.282558:0:6577:0:(ofd_obd.c:539:ofd_postrecov()) lustre-OST0000: recovery is over 00100000:10000000:2.0:1783441340.282566:0:6577:0:(lfsck_lib.c:3085:lfsck_start()) lustre-OST0000-osd: start master thread 00000020:01000004:2.0:1783441340.282613:0:6577:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:2.0:1783441340.282670:0:6577:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.201.113@tcp: cl_mgc_mutex unlock 00000020:01000004:2.0:1783441340.282687:0:6577:0:(tgt_mount.c:2459:server_fill_super_common()) Server sb, dev=48 00000080:00000004:2.0:1783441340.282704:0:6577:0:(super25.c:187:lustre_fill_super()) lustre-ost1/ost1: Mount complete 00010000:00010000:0.0:1783441340.462039:0:5772:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783441341.485235:0:5773:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783441342.508930:0:5772:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783441343.536179:0:5773:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783441344.565152:0:5772:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1783441345.389639:0:3305:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00080000:1.0:1783441345.389651:0:446:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1783441345.389658:0:446:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery 00000100:00080000:1.0:1783441345.389662:0:446:0:(import.c:65:import_set_state_nolock()) ffff91a7466c7800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00100000:2.0:1783441345.389669:0:3305:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff91a867cd6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:6c1ddb50-5795-40c6-a2b6-8f58add9da62:3305:1870073693219712:0@lo:400: 00000100:00080000:1.0:1783441345.389678:0:446:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-MDT0000: import ffff91a7466c7800 using connection 192.168.201.113@tcp/0@lo 00000100:00100000:1.0:1783441345.389703:0:446:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff91a867cd7480 x1870073693220096/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1783441345.389738:0:3303:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff91a867cd4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3303:1870073693219840:0@lo:400: 00000100:00100000:1.0:1783441345.389787:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783441345.389861:0:3303:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1783441345.389872:0:3303:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff91a867cd5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3303:1870073693219968:0@lo:400: 00000100:00100000:1.0:1783441345.390083:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783441345.390287:0:5787:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073693219840 00000100:00100000:1.0:1783441345.390295:0:5787:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073693219840 00000100:00100000:1.0:1783441345.390344:0:5787:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073693219968 00000100:00100000:1.0:1783441345.390348:0:5787:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073693219968 00000100:00100000:1.0:1783441345.390378:0:5787:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:1.0:1783441345.390387:0:5787:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a867cd6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3303:x1870073693219840:12345-0@lo:400: 00000100:00100000:1.0:1783441345.390629:0:5787:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a867cd6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3303:x1870073693219840:12345-0@lo:400: Request processed in 243us (842us total) trans 0 rc 0/0 00000100:00100000:1.0:1783441345.390638:0:5787:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:1.0:1783441345.390656:0:5787:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:1.0:1783441345.390663:0:5787:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a867cd5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3303:x1870073693219968:12345-0@lo:400: 00000100:00100000:1.0:1783441345.390694:0:5787:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a867cd5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3303:x1870073693219968:12345-0@lo:400: Request processed in 32us (792us total) trans 0 rc 0/0 00000100:00100000:1.0:1783441345.390710:0:5787:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00080000:1.0:1783441345.390737:0:5781:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:1.0:1783441345.390800:0:3303:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff91a867cd5880 x1870073693219968/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1783441361 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1783441345.390814:0:3303:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff91a867cd5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3303:1870073693219968:0@lo:400: 00010000:00080000:1.0:1783441345.390829:0:3303:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff91a867cd4a80 x1870073693219840/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1783441361 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1783441345.390838:0:3303:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff91a867cd4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3303:1870073693219840:0@lo:400: 00000100:00100000:0.0:1783441345.393490:0:3302:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff91a867cd7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3302:1870073693220096:0@lo:8: 00000100:00100000:0.0:1783441345.393578:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783441345.393667:0:6583:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073693220096 00000100:00100000:0.0:1783441345.393682:0:6583:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073693220096 00000100:00100000:0.0:1783441345.393713:0:6583:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1783441345.393720:0:6583:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a8756a4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0+-99:3302:x1870073693220096:12345-0@lo:8: 00010000:00080000:0.0:1783441345.393766:0:6583:0:(ldlm_lib.c:1432:target_handle_connect()) lustre-OST0000: connection from lustre-MDT0000-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 183 last 0 00000020:00000080:0.0:1783441345.393808:0:6583:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0xa2426164df2c7624 00002000:00100000:0.0:1783441345.393856:0:6583:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli lustre-MDT0000-mdtlov_UUID/ffff91a74422d000 ocd_connect_flags: 0xa044401443000026 ocd_version: 2113669 ocd_grant: 0 ocd_index: 0 ocd_group 0 00002000:00080000:0.0:1783441345.393861:0:6583:0:(ofd_obd.c:139:ofd_parse_connect_data()) lustre-OST0000: Received MDS connection for group 0 00000001:00000004:0.0:1783441345.393865:0:6583:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 4294967296 00002000:00100000:0.0:1783441345.393991:0:6583:0:(ofd_obd.c:227:ofd_parse_connect_data()) lustre-OST0000: cli does not support OBD_CONNECT_CKSUM 00002000:00080000:0.0:1783441345.394134:0:6583:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:0.0:1783441345.394158:0:6583:0:(import.c:65:import_set_state_nolock()) ffff91a74422e800 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1783441345.394213:0:6583:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a8756a4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:3302:x1870073693220096:12345-0@lo:8: Request processed in 492us (634us total) trans 0 rc 0/0 00000100:00100000:0.0:1783441345.394220:0:6583:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:0.0:1783441345.394496:0:3302:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff91a867cd7480 x1870073693220096/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/416 e 0 to 0 dl 1783441355 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1783441345.394512:0:3302:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-OST0000-osc-MDT0000: connect to target with instance 1 00000100:00080000:0.0:1783441345.394520:0:3302:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-OST0000-osc-MDT0000: Resetting ns_connect_flags to server flags: 0xa040401443000026 00000100:00080000:0.0:1783441345.394525:0:3302:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-OST0000_UUID 00000100:00080000:0.0:1783441345.394527:0:3302:0:(import.c:65:import_set_state_nolock()) ffff91a7466c7800 lustre-OST0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:2.0:1783441345.394606:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783441345.394638:0:5778:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073693219712 00000100:00100000:2.0:1783441345.394642:0:5778:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073693219712 00000100:00100000:2.0:1783441345.394682:0:5778:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 64 00000100:00100000:2.0:1783441345.394797:0:5778:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a8484bbc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6c1ddb50-5795-40c6-a2b6-8f58add9da62+16:3305:x1870073693219712:12345-0@lo:400: 00000100:00100000:2.0:1783441345.394833:0:5778:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a8484bbc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6c1ddb50-5795-40c6-a2b6-8f58add9da62+16:3305:x1870073693219712:12345-0@lo:400: Request processed in 144us (5093us total) trans 0 rc 0/0 00000100:00100000:2.0:1783441345.394839:0:5778:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 64 00000100:00100000:2.0:1783441345.394905:0:3305:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff91a867cd6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:6c1ddb50-5795-40c6-a2b6-8f58add9da62:3305:1870073693219712:0@lo:400: 00000004:00080000:0.0:1783441345.400012:0:3302:0:(osp_dev.c:1648:osp_import_event()) got connected 00000100:00100000:0.0:1783441345.400033:0:3302:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff91a867cd7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3302:1870073693220096:0@lo:8: 00000004:00080000:1.0:1783441345.401718:0:6610:0:(osp_sync.c:1045:osp_sync_process_record()) processed all old entries 00000004:00080000:1.0:1783441345.402302:0:6610:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 183276559103ns, next at 0ns, rc = 0 00000004:00080000:1.0:1783441345.491043:0:6611:0:(osp_precreate.c:882:osp_precreate_cleanup_orphans()) lustre-OST0000-osc-MDT0000: going to cleanup orphans since [0x100000000:0x1:0x0] 00000100:00100000:1.0:1783441345.491071:0:6611:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff91a867cd5880 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:6611:1870073693220352:0@lo:7: 00000100:00100000:1.0:1783441345.491137:0:6611:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783441345.491181:0:6611:0:(client.c:2702:ptlrpc_set_wait()) set ffff91a844dbef00 going to sleep for 11 seconds 00000004:00080000:1.0:1783441345.491195:0:5807:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1 committed 00000100:00100000:1.0:1783441345.491217:0:3305:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff91a867cd4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3305:1870073693220224:0@lo:13: 00000100:00100000:1.0:1783441345.491239:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783441345.491278:0:6582:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073693220352 00000100:00100000:1.0:1783441345.491285:0:6582:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073693220352 00000100:00100000:1.0:1783441345.491332:0:6582:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1783441345.491340:0:6582:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a867cd4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:6611:x1870073693220352:12345-0@lo:7: 00000100:00100000:1.0:1783441345.494858:0:6584:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073693220224 00000100:00100000:1.0:1783441345.494871:0:6584:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073693220224 00000100:00100000:1.0:1783441345.495027:0:6584:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1783441345.495038:0:6584:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a867cd6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3305:x1870073693220224:12345-0@lo:13: 00002000:00000024:1.0:1783441345.495075:0:6584:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40960000 pending 0 free 3860856832 avail 3858759680 00000100:00100000:1.0:1783441345.495152:0:6584:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a867cd6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3305:x1870073693220224:12345-0@lo:13: Request processed in 116us (3911us total) trans 0 rc 0/0 00000100:00100000:1.0:1783441345.495160:0:6584:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00080000:1.0:1783441345.495218:0:5781:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00002000:00080000:2.0:1783441345.496905:0:6582:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0000: adding sequence 0x0 00002000:00080000:2.0:1783441345.496913:0:6582:0:(ofd_dev.c:1208:ofd_get_info_hdl()) lustre-OST0000: LAST FID is [0x100000000:0x0:0x0] 00000100:00100000:2.0:1783441345.497073:0:6582:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a867cd4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:6611:x1870073693220352:12345-0@lo:7: Request processed in 5729us (5931us total) trans 0 rc 0/0 00000100:00100000:2.0:1783441345.497085:0:6582:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00080000:1.0:1783441345.497225:0:3305:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff91a867cd4a80 x1870073693220224/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1783441361 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1783441345.497249:0:3305:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff91a867cd4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3305:1870073693220224:0@lo:13: 00010000:00080000:1.0:1783441345.497283:0:6611:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff91a867cd5880 x1870073693220352/t0(0) o7->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 264/240 e 0 to 0 dl 1783441361 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1783441345.497293:0:6611:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff91a867cd5880 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:6611:1870073693220352:0@lo:7: 00000004:00080000:1.0:1783441345.497306:0:6611:0:(osp_precreate.c:810:osp_get_lastfid_from_ost()) lustre-OST0000-osc-MDT0000: Got last_fid [0x100000000:0x0:0x0] 00000100:00100000:1.0:1783441345.497339:0:6611:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff91a867cd5880 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:6611:1870073693220480:0@lo:5: 00000100:00100000:1.0:1783441345.497370:0:6611:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783441345.497450:0:6611:0:(client.c:2702:ptlrpc_set_wait()) set ffff91a844dbef00 going to sleep for 11 seconds 00000100:00100000:2.0:1783441345.497485:0:6581:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073693220480 00000100:00100000:2.0:1783441345.497492:0:6581:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073693220480 00000100:00100000:2.0:1783441345.497567:0:6581:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1783441345.497577:0:6581:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a867cd4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:6611:x1870073693220480:12345-0@lo:5: 00002000:00080000:2.0:1783441345.497605:0:6581:0:(ofd_dev.c:1640:ofd_create_hdl()) ofd_last_id() = 0 -> diff = 1 00002000:00080000:2.0:1783441345.497609:0:6581:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0000: reserve 1 objects in group 0x0 at 1 00000100:00100000:2.0:1783441345.497940:0:6581:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a867cd4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+7:6611:x1870073693220480:12345-0@lo:5: Request processed in 364us (567us total) trans 4294967297 rc 0/0 00000100:00100000:2.0:1783441345.498034:0:6581:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00010000:00080000:1.0:1783441345.498102:0:6611:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff91a867cd5880 x1870073693220480/t0(0) o5->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 432/432 e 0 to 0 dl 1783441361 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1783441345.498114:0:6611:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff91a867cd5880 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:6611:1870073693220480:0@lo:5: 00000004:00080000:1.0:1783441345.498124:0:6611:0:(osp_precreate.c:960:osp_precreate_cleanup_orphans()) lustre-OST0000-osc-MDT0000: Got last_id [0x100000000:0x1:0x0] from OST, last_created [0x100000000:0x1:0x0]last_used is [0x100000000:0x1:0x0] 00000100:00100000:1.0:1783441345.498150:0:6611:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff91a867cd7800 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:6611:1870073693220608:0@lo:700: 00000100:00100000:1.0:1783441345.498174:0:6611:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783441345.498190:0:6611:0:(client.c:2702:ptlrpc_set_wait()) set ffff91a844dbef00 going to sleep for 11 seconds 00000100:00100000:1.0:1783441345.498220:0:6589:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073693220608 00000100:00100000:1.0:1783441345.498224:0:6589:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073693220608 00000100:00100000:1.0:1783441345.498260:0:6589:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1783441345.498266:0:6589:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a867cd7100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-mdtlov_UUID+7:6611:x1870073693220608:12345-0@lo:700: 00000100:00100000:1.0:1783441345.498294:0:6589:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff91a867cd5c00 pname:cluuid:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-lwp-OST0000_UUID:6589:1870073693220736:0@lo:700: 00000100:00100000:1.0:1783441345.498321:0:6589:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783441345.498344:0:6589:0:(client.c:2702:ptlrpc_set_wait()) set ffff91a844dbe180 going to sleep for 11 seconds 00000100:00100000:1.0:1783441345.498365:0:5792:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073693220736 00000100:00100000:1.0:1783441345.498368:0:5792:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073693220736 00000100:00100000:1.0:1783441345.498395:0:5792:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1783441345.498401:0:5792:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a867cd4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqs_0000:lustre-MDT0000-lwp-OST0000_UUID+5:6589:x1870073693220736:12345-0@lo:700: 40000000:02000000:2.0:1783441345.536208:0:5792:0:(fid_handler.c:119:__seq_server_alloc_super()) ctl-lustre-MDT0000: super-sequence allocation rc = 0 [0x0000000240000400-0x0000000280000400]:0:ost 00000100:00100000:2.0:1783441345.541482:0:5792:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a867cd4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqs_0000:lustre-MDT0000-lwp-OST0000_UUID+5:6589:x1870073693220736:12345-0@lo:700: Request processed in 43072us (43152us total) trans 0 rc 0/0 00000100:00100000:2.0:1783441345.541502:0:5792:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00080000:3.0:1783441345.541607:0:6589:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff91a867cd5c00 x1870073693220736/t0(0) o700->lustre-MDT0000-lwp-OST0000@0@lo:32/10 lens 264/248 e 0 to 0 dl 1783441361 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1783441345.541623:0:6589:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff91a867cd5c00 pname:cluuid:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-lwp-OST0000_UUID:6589:1870073693220736:0@lo:700: 40000000:02000000:3.0:1783441345.541636:0:6589:0:(fid_request.c:122:seq_client_rpc()) cli-lustre-OST0000-super: Allocated super-sequence [0x0000000240000400-0x0000000280000400]:0:ost] 00010000:00010000:1.0:1783441345.586359:0:5773:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:1.0:1783441345.659252:0:6613:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000001:00080000:1.0:1783441345.659270:0:6613:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967297 is committed 00000100:00100000:0.0:1783441345.659584:0:6589:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a867cd7100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-mdtlov_UUID+5:6611:x1870073693220608:12345-0@lo:700: Request processed in 161313us (161404us total) trans 0 rc 0/0 00000100:00100000:0.0:1783441345.659601:0:6589:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00080000:1.0:1783441345.659610:0:6611:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff91a867cd7800 x1870073693220608/t0(0) o700->lustre-OST0000-osc-MDT0000@0@lo:31/4 lens 264/248 e 0 to 0 dl 1783441361 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1783441345.659620:0:6611:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967297 gen 2 00000100:00100000:1.0:1783441345.659637:0:6611:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff91a867cd7800 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:6611:1870073693220608:0@lo:700: 00000004:02000040:1.0:1783441345.697356:0:6611:0:(osp_precreate.c:485:osp_precreate_rollover_new_seq()) lustre-OST0000-osc-MDT0000: update sequence from 0x100000000 to 0x240000400 00000100:00100000:1.0:1783441345.701850:0:6611:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff91a867cd7800 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:6611:1870073693220864:0@lo:5: 00000100:00100000:1.0:1783441345.701925:0:6611:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783441345.701979:0:6582:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073693220864 00000100:00100000:1.0:1783441345.701987:0:6582:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073693220864 00000100:00100000:1.0:1783441345.702038:0:6582:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:1.0:1783441345.702047:0:6582:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a867cd5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:6611:x1870073693220864:12345-0@lo:5: 00000100:00100000:2.0:1783441345.705441:0:6611:0:(client.c:2702:ptlrpc_set_wait()) set ffff91a842bd2e40 going to sleep for 11 seconds 00002000:00080000:0.0:1783441345.721959:0:6582:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0000: adding sequence 0x240000400 00002000:00080000:0.0:1783441345.721982:0:6582:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0000: reserve 32 objects in group 0x240000400 at 2 00000100:00100000:0.0:1783441345.729870:0:6582:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a867cd5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:6611:x1870073693220864:12345-0@lo:5: Request processed in 27812us (27934us total) trans 4294967298 rc 0/0 00000100:00100000:0.0:1783441345.729885:0:6582:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00010000:00080000:1.0:1783441345.734894:0:6611:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff91a867cd7800 x1870073693220864/t0(0) o5->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 432/432 e 0 to 0 dl 1783441361 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1783441345.734919:0:6611:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff91a867cd7800 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:6611:1870073693220864:0@lo:5: 00000004:00080000:1.0:1783441345.734944:0:6611:0:(osp_precreate.c:705:osp_precreate_send()) lustre-OST0000-osc-MDT0000: current precreated pool: [0x240000400:0x1:0x0]-[0x240000400:0x21:0x0] 00000001:02000400:0.0:1783441346.340467:0:6957:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg113-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00010000:00010000:2.0:1783441346.605539:0:5772:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783441347.630400:0:5773:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783441348.653214:0:5772:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783441349.689308:0:5773:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1783441350.509156:0:3306:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff91a867cd5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:6c1ddb50-5795-40c6-a2b6-8f58add9da62:3306:1870073693220992:0@lo:400: 00000100:00100000:1.0:1783441350.509255:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783441350.509319:0:3306:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1783441350.509326:0:3306:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff91a867cd7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3306:1870073693221376:0@lo:400: 00000100:00100000:1.0:1783441350.509371:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783441350.509409:0:3303:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff91a867cd6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3303:1870073693221120:0@lo:400: 00000100:00100000:1.0:1783441350.509460:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783441350.509482:0:3303:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1783441350.509488:0:3303:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff91a867cd5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3303:1870073693221248:0@lo:400: 00000100:00100000:1.0:1783441350.509523:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783441350.509559:0:5787:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073693221120 00000100:00100000:1.0:1783441350.509569:0:5787:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073693221120 00000100:00100000:1.0:1783441350.509622:0:5787:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073693221248 00000100:00100000:1.0:1783441350.509625:0:5787:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073693221248 00000100:00100000:2.0:1783441350.509794:0:6581:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073693221376 00000100:00100000:2.0:1783441350.509798:0:6581:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073693221376 00000100:00100000:2.0:1783441350.509840:0:6581:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1783441350.509850:0:6581:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a867cd6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3306:x1870073693221376:12345-0@lo:400: 00000100:00100000:2.0:1783441350.509898:0:6581:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a867cd6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3306:x1870073693221376:12345-0@lo:400: Request processed in 50us (541us total) trans 0 rc 0/0 00000100:00100000:2.0:1783441350.509906:0:6581:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00080000:2.0:1783441350.509927:0:5781:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1783441350.509938:0:3305:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1783441350.509944:0:3305:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff91a846f26d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3305:1870073693221504:0@lo:13: 00000100:00100000:2.0:1783441350.509973:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783441350.510013:0:6585:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073693221504 00000100:00100000:2.0:1783441350.510016:0:6585:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073693221504 00000100:00100000:2.0:1783441350.510041:0:6585:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1783441350.510046:0:6585:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a846f24a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3305:x1870073693221504:12345-0@lo:13: 00002000:00000024:2.0:1783441350.510075:0:6585:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1783441350.510110:0:6585:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a846f24a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3305:x1870073693221504:12345-0@lo:13: Request processed in 63us (135us total) trans 0 rc 0/0 00000100:00100000:2.0:1783441350.510125:0:6585:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:2.0:1783441350.510165:0:3305:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff91a846f26d80 x1870073693221504/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1783441366 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1783441350.510184:0:3305:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff91a846f26d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3305:1870073693221504:0@lo:13: 00010000:00080000:2.0:1783441350.510215:0:3306:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff91a867cd7480 x1870073693221376/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1783441366 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1783441350.510224:0:3306:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff91a867cd7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3306:1870073693221376:0@lo:400: 00000100:00100000:1.0:1783441350.510587:0:5787:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:1.0:1783441350.510596:0:5787:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a87d6a0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3303:x1870073693221120:12345-0@lo:400: 00000100:00100000:1.0:1783441350.510783:0:5787:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a87d6a0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3303:x1870073693221120:12345-0@lo:400: Request processed in 124us (1257us total) trans 0 rc 0/0 00000100:00100000:1.0:1783441350.510790:0:5787:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:1.0:1783441350.510803:0:5787:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:1.0:1783441350.510809:0:5787:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a87d6a2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3303:x1870073693221248:12345-0@lo:400: 00000100:00100000:1.0:1783441350.510837:0:5787:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a87d6a2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3303:x1870073693221248:12345-0@lo:400: Request processed in 29us (1324us total) trans 0 rc 0/0 00000100:00100000:1.0:1783441350.510842:0:5787:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00010000:00080000:1.0:1783441350.510878:0:3303:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff91a867cd5c00 x1870073693221248/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1783441366 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1783441350.510895:0:3303:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff91a867cd5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3303:1870073693221248:0@lo:400: 00010000:00080000:1.0:1783441350.510908:0:3303:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff91a867cd6a00 x1870073693221120/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1783441366 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1783441350.510915:0:3303:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff91a867cd6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3303:1870073693221120:0@lo:400: 00000100:00100000:3.0:1783441350.511039:0:5780:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073693220992 00000100:00100000:3.0:1783441350.511045:0:5780:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073693220992 00000100:00100000:3.0:1783441350.511074:0:5780:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 65 00000100:00100000:3.0:1783441350.511081:0:5780:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a8484ba050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6c1ddb50-5795-40c6-a2b6-8f58add9da62+16:3306:x1870073693220992:12345-0@lo:400: 00000100:00100000:3.0:1783441350.511133:0:5780:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a8484ba050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6c1ddb50-5795-40c6-a2b6-8f58add9da62+16:3306:x1870073693220992:12345-0@lo:400: Request processed in 52us (1878us total) trans 0 rc 0/0 00000100:00100000:3.0:1783441350.511145:0:5780:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 65 00000100:00080000:2.0:1783441350.511688:0:5781:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1783441350.511773:0:3306:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff91a867cd5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:6c1ddb50-5795-40c6-a2b6-8f58add9da62:3306:1870073693220992:0@lo:400: 00010000:00010000:2.0:1783441350.711370:0:5772:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:1.0:1783441351.124384:0:6613:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967298 is committed 00010000:00010000:2.0:1783441351.725443:0:5773:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783441352.748977:0:5772:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783441353.774489:0:5773:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783441354.802737:0:5772:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1783441355.629041:0:3303:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff91a87d6a3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:6c1ddb50-5795-40c6-a2b6-8f58add9da62:3303:1870073693221632:0@lo:400: 00000100:00100000:1.0:1783441355.629125:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783441355.629179:0:3303:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1783441355.629186:0:3303:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff91a87d6a1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3303:1870073693221760:0@lo:400: 00000100:00100000:1.0:1783441355.629213:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783441355.629247:0:5779:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073693221632 00000100:00100000:1.0:1783441355.629254:0:5779:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073693221632 00000100:00100000:1.0:1783441355.629299:0:5779:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 66 00000100:00100000:1.0:1783441355.629308:0:5779:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a8484bb850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6c1ddb50-5795-40c6-a2b6-8f58add9da62+16:3303:x1870073693221632:12345-0@lo:400: 00000100:00100000:1.0:1783441355.629354:0:5779:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a8484bb850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6c1ddb50-5795-40c6-a2b6-8f58add9da62+16:3303:x1870073693221632:12345-0@lo:400: Request processed in 47us (230us total) trans 0 rc 0/0 00000100:00100000:1.0:1783441355.629362:0:5779:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 66 00000100:00100000:1.0:1783441355.629392:0:5787:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073693221760 00000100:00100000:1.0:1783441355.629395:0:5787:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073693221760 00000100:00100000:1.0:1783441355.629421:0:5787:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:1.0:1783441355.629427:0:5787:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a87d6a3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3303:x1870073693221760:12345-0@lo:400: 00000100:00100000:1.0:1783441355.629455:0:5787:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a87d6a3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3303:x1870073693221760:12345-0@lo:400: Request processed in 29us (241us total) trans 0 rc 0/0 00000100:00100000:1.0:1783441355.629460:0:5787:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00010000:00080000:1.0:1783441355.629497:0:3303:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff91a87d6a1500 x1870073693221760/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1783441371 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1783441355.629539:0:3303:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff91a87d6a1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3303:1870073693221760:0@lo:400: 00000100:00100000:1.0:1783441355.629561:0:3303:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff91a87d6a3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:6c1ddb50-5795-40c6-a2b6-8f58add9da62:3303:1870073693221632:0@lo:400: 00000100:00100000:3.0:1783441355.630051:0:3305:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff91a87d6a0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3305:1870073693221888:0@lo:400: 00000100:00100000:3.0:1783441355.630085:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783441355.630115:0:3305:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1783441355.630121:0:3305:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff91a87d6a0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3305:1870073693222016:0@lo:400: 00000100:00100000:3.0:1783441355.630147:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783441355.630376:0:6605:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073693221888 00000100:00100000:2.0:1783441355.630380:0:6605:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073693221888 00000100:00100000:2.0:1783441355.630435:0:6605:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:2.0:1783441355.630444:0:6605:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a875692d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3305:x1870073693221888:12345-0@lo:400: 00000100:00100000:2.0:1783441355.630484:0:6605:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a875692d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3305:x1870073693221888:12345-0@lo:400: Request processed in 42us (398us total) trans 0 rc 0/0 00000100:00100000:2.0:1783441355.630490:0:6605:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00080000:3.0:1783441355.630773:0:5781:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:3.0:1783441355.630797:0:3305:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff91a87d6a0000 x1870073693221888/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1783441371 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1783441355.630808:0:3305:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff91a87d6a0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3305:1870073693221888:0@lo:400: 00000100:00100000:0.0:1783441355.631003:0:6582:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073693222016 00000100:00100000:0.0:1783441355.631008:0:6582:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073693222016 00000100:00100000:0.0:1783441355.631043:0:6582:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1783441355.631050:0:6582:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a875692a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3305:x1870073693222016:12345-0@lo:400: 00000100:00100000:0.0:1783441355.631087:0:6582:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a875692a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3305:x1870073693222016:12345-0@lo:400: Request processed in 39us (939us total) trans 0 rc 0/0 00000100:00100000:0.0:1783441355.631093:0:6582:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:0.0:1783441355.631127:0:3305:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff91a87d6a0380 x1870073693222016/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1783441371 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1783441355.631136:0:3305:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967298 gen 2 00000100:00100000:0.0:1783441355.631145:0:3305:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff91a87d6a0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3305:1870073693222016:0@lo:400: 00000100:00100000:1.0:1783441355.631244:0:3304:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1783441355.631253:0:3304:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff91a87d6a3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3304:1870073693222144:0@lo:13: 00000100:00100000:1.0:1783441355.631281:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783441355.631306:0:6585:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073693222144 00000100:00100000:1.0:1783441355.631310:0:6585:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073693222144 00000100:00100000:1.0:1783441355.631331:0:6585:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1783441355.631336:0:6585:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a87d6a1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3304:x1870073693222144:12345-0@lo:13: 00002000:00000024:1.0:1783441355.631360:0:6585:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1783441355.631389:0:6585:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a87d6a1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3304:x1870073693222144:12345-0@lo:13: Request processed in 53us (107us total) trans 0 rc 0/0 00000100:00100000:1.0:1783441355.631395:0:6585:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00080000:1.0:1783441355.631418:0:3304:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff91a87d6a3800 x1870073693222144/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1783441371 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1783441355.631430:0:3304:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff91a87d6a3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3304:1870073693222144:0@lo:13: 00000100:00080000:3.0:1783441355.631516:0:5781:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:3.0:1783441355.821105:0:5773:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783441356.847173:0:5772:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:2.0:1783441357.267330:0:7474:0:(obd_mount.c:923:lmd_print()) mount data: 00000020:01000004:2.0:1783441357.267335:0:7474:0:(obd_mount.c:926:lmd_print()) device: lustre-ost2/ost2 00000080:01200004:2.0:1783441357.267463:0:7474:0:(super25.c:130:lustre_fill_super()) VFS Op: sb ffff91a875566000 00000020:01000004:2.0:1783441357.267481:0:7474:0:(tgt_mount.c:2501:osd_start()) Attempting to start lustre-OST0001, type=osd-zfs, lsifl=200062, mountfl=0 00000020:01000004:2.0:1783441357.267494:0:7474:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-OST0001-osd (typ=osd-zfs) 00000020:00000080:2.0:1783441357.267507:0:7474:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001-osd (ffff91a84767b380) 00000020:00000080:2.0:1783441357.267894:0:7474:0:(obd_config.c:720:class_attach_name()) OBD: dev 14 attached type osd-zfs with refcount 2 00100000:10000000:3.0:1783441357.288492:0:7474:0:(scrub.c:229:scrub_file_store()) lustre-OST0001: store scrub file: rc = 0 00100000:10000000:3.0:1783441357.289135:0:7474:0:(scrub.c:229:scrub_file_store()) lustre-OST0001: store scrub file: rc = 0 00100000:10000000:3.0:1783441357.337908:0:7474:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0001: refresh OI map for scrub, op 1, force yes, [0x200000001:0x1017:0x0] => 0 (CONFIGS): rc = 1 00100000:10000000:3.0:1783441357.350066:0:7474:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0001: refresh OI map for scrub, op 1, force yes, [0x200000007:0x1:0x0] => 0 (ROOT): rc = 1 00100000:10000000:3.0:1783441357.350106:0:7474:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0001: refresh OI map for scrub, op 1, force yes, [0x200000001:0x3:0x0] => 0 (fld): rc = 1 00100000:10000000:3.0:1783441357.350178:0:7474:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0001: refresh OI map for scrub, op 1, force yes, [0x200000009:0x0:0x0] => 0 (update_log): rc = 1 00100000:10000000:3.0:1783441357.350209:0:7474:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0001: refresh OI map for scrub, op 1, force yes, [0x20000000a:0x0:0x0] => 0 (update_log_dir): rc = 1 00000020:00000080:3.0:1783441357.350965:0:7474:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001-osd (uuid lustre-OST0001-osd_UUID) 00080000:01000000:3.0:1783441357.350977:0:7474:0:(osd_handler.c:1569:osd_obd_connect()) connect #0 00000020:00000080:3.0:1783441357.350987:0:7474:0:(genops.c:1406:class_connect()) connect: client lustre-OST0001-osd_UUID, cookie 0xa2426164df2c7632 00000020:01000004:3.0:1783441357.350995:0:7474:0:(tgt_mount.c:2586:server_fill_super()) Found service lustre-OST0001 on device lustre-ost2/ost2 00000020:01000004:3.0:1783441357.351019:0:7474:0:(obd_mount.c:403:lustre_start_mgc()) MGC192.168.201.113@tcp:Set MGC reconnect 1 10000000:01000000:3.0:1783441357.351022:0:7474:0:(mgc_request.c:1071:mgc_set_info_async()) InitRecov MGC192.168.201.113@tcp 1/d0:i0:r0:or0:FULL 00000020:01000004:3.0:1783441357.351036:0:7474:0:(tgt_mount.c:1810:server_start_targets()) starting target lustre-OST0001 00000020:01000004:3.0:1783441357.351058:0:7474:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for lustre-ost2/ost2 10000000:01000000:3.0:1783441357.351062:0:7474:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.201.113@tcp: cl_mgc_mutex lustre-OST0001-osd for locked: rc = 0 00000040:01000000:1.0:1783441357.405554:0:7474:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.201.113@tcp ctxt 0 is initialized 00000020:01000004:1.0:1783441357.405606:0:7474:0:(tgt_mount.c:1418:server_register_target()) Registration lustre-OST0001, fs=lustre, 192.168.201.113@tcp, index=0001, flags=0x20062 00000020:01000004:1.0:1783441357.405611:0:7474:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:1.0:1783441357.405612:0:7474:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:1.0:1783441357.405614:0:7474:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1783441357.405615:0:7474:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1783441357.405617:0:7474:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1783441357.405618:0:7474:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1783441357.405619:0:7474:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:1.0:1783441357.405621:0:7474:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:1.0:1783441357.405623:0:7474:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:1.0:1783441357.405624:0:7474:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1783441357.405629:0:7474:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:1.0:1783441357.405633:0:7474:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0001 0x10020062 00000020:01000004:1.0:1783441357.405635:0:7474:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:1.0:1783441357.405637:0:7474:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:1.0:1783441357.405638:0:7474:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1783441357.405639:0:7474:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1783441357.405640:0:7474:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1783441357.405641:0:7474:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1783441357.405642:0:7474:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:1.0:1783441357.405643:0:7474:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:1.0:1783441357.405644:0:7474:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:1.0:1783441357.405645:0:7474:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1783441357.405646:0:7474:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:1.0:1783441357.405677:0:7474:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0001 00000100:00100000:1.0:1783441357.405694:0:7474:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff91a87d6a3800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6c1ddb50-5795-40c6-a2b6-8f58add9da62:7474:1870073693222272:0@lo:253: 00000100:00100000:1.0:1783441357.405799:0:7474:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783441357.405876:0:7474:0:(client.c:2702:ptlrpc_set_wait()) set ffff91a848f22540 going to sleep for 11 seconds 00000100:00100000:2.0:1783441357.406137:0:5778:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073693222272 00000100:00100000:2.0:1783441357.406166:0:5778:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073693222272 00000100:00100000:2.0:1783441357.406224:0:5778:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 67 00000100:00100000:2.0:1783441357.406233:0:5778:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a8484ba850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6c1ddb50-5795-40c6-a2b6-8f58add9da62+16:7474:x1870073693222272:12345-0@lo:253: 20000000:01000000:2.0:1783441357.406275:0:5778:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 1 is registered to MGS. 20000000:01000000:2.0:1783441357.406279:0:5778:0:(mgs_handler.c:599:mgs_target_reg()) updating lustre-OST0001, index=1 20000000:01000000:2.0:1783441357.406284:0:5778:0:(mgs_llog.c:869:mgs_set_index()) Set index for lustre-OST0001 to 1 20000000:01000000:2.0:1783441357.406287:0:5778:0:(mgs_llog.c:3858:mgs_write_log_ost()) writing new ost lustre-OST0001 00000040:00080000:3.0:1783441357.408911:0:5778:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1783441357.409678:0:5778:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].1, 224 off8416 20000000:01000000:3.0:1783441357.409699:0:5778:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0001 0xcf001 obdfilter lustre-OST0001_UUID (null) (null) 00000040:00080000:3.0:1783441357.409779:0:5778:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].2, 128 off8544 20000000:01000000:3.0:1783441357.409788:0:5778:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0001 0xcf003 dev type f (null) 00000040:00080000:3.0:1783441357.409823:0:5778:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].3, 112 off8656 00000040:00080000:3.0:1783441357.409879:0:5778:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].4, 224 off8880 00000040:00080000:3.0:1783441357.411402:0:5778:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].25, 224 off12648 20000000:01000000:3.0:1783441357.411434:0:5778:0:(mgs_llog.c:3811:mgs_write_log_osc_to_lov()) add nid 192.168.201.113@tcp 20000000:01000000:3.0:1783441357.411437:0:5778:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf005 192.168.201.113@tcp (null) (null) (null) 00000040:00080000:3.0:1783441357.411699:0:5778:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].26, 88 off12736 20000000:01000000:3.0:1783441357.411709:0:5778:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0001-osc-MDT0000 0xcf001 osc lustre-MDT0000-mdtlov_UUID (null) (null) 00000040:00080000:3.0:1783441357.412296:0:5778:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].27, 144 off12880 20000000:01000000:3.0:1783441357.412308:0:5778:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0001-osc-MDT0000 0xcf003 lustre-OST0001_UUID 192.168.201.113@tcp (null) (null) 00000040:00080000:3.0:1783441357.412349:0:5778:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].28, 152 off13032 20000000:01000000:3.0:1783441357.412359:0:5778:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0000-mdtlov 0xcf00d lustre-OST0001_UUID 1 1 (null) 00000040:00080000:3.0:1783441357.412391:0:5778:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].29, 136 off13168 00000040:00080000:3.0:1783441357.412482:0:5778:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].30, 224 off13392 00000040:00080000:3.0:1783441357.417070:0:5778:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].30, 224 off13416 20000000:01000000:3.0:1783441357.417106:0:5778:0:(mgs_llog.c:3811:mgs_write_log_osc_to_lov()) add nid 192.168.201.113@tcp 20000000:01000000:3.0:1783441357.417108:0:5778:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf005 192.168.201.113@tcp (null) (null) (null) 00000040:00080000:3.0:1783441357.417145:0:5778:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].31, 88 off13504 20000000:01000000:3.0:1783441357.418704:0:5778:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0001-osc 0xcf001 osc lustre-clilov_UUID (null) (null) 00000040:00080000:3.0:1783441357.419056:0:5778:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].32, 128 off13632 20000000:01000000:3.0:1783441357.419067:0:5778:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0001-osc 0xcf003 lustre-OST0001_UUID 192.168.201.113@tcp (null) (null) 00000040:00080000:3.0:1783441357.419095:0:5778:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].33, 144 off13776 20000000:01000000:3.0:1783441357.419585:0:5778:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-clilov 0xcf00d lustre-OST0001_UUID 1 1 (null) 00000040:00080000:3.0:1783441357.420323:0:5778:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].34, 128 off13904 00000040:00080000:3.0:1783441357.420394:0:5778:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].35, 224 off14128 20000000:01000000:3.0:1783441357.420423:0:5778:0:(mgs_llog.c:5248:mgs_write_log_target()) remaining string: ' sys.timeout=20 ', param: 'autodegrade=on' 20000000:01000000:3.0:1783441357.420426:0:5778:0:(mgs_llog.c:4744:mgs_write_log_param()) next param 'autodegrade=on' 20000000:01000000:3.0:1783441357.420434:0:5778:0:(mgs_llog.c:5248:mgs_write_log_target()) remaining string: ' ', param: 'sys.timeout=20' 20000000:01000000:3.0:1783441357.420435:0:5778:0:(mgs_llog.c:4744:mgs_write_log_param()) next param 'sys.timeout=20' 20000000:01000000:3.0:1783441357.420438:0:5778:0:(mgs_llog.c:4177:mgs_write_log_sys()) global 'sys.timeout=20' val=20 20000000:01000000:3.0:1783441357.420453:0:5778:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping . 20000000:01000000:3.0:1783441357.420466:0:5778:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping .. 20000000:01000000:3.0:1783441357.421358:0:5778:0:(mgs_llog.c:2546:mgs_write_log_direct_all()) Changing log lustre-OST0000 20000000:01000000:3.0:1783441357.421363:0:5778:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-OST0000/lustre/sys.timeout fl=4 20000000:01000000:0.0:1783441357.426019:0:7476:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 5 marker 14 1->4: lustre sys.timeout 20000000:01000000:0.0:1783441357.426136:0:7476:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 7 marker 14 2->4: lustre sys.timeout 00000040:00080000:0.0:1783441357.426173:0:7476:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 8 count 8 00000040:00080000:2.0:1783441357.426902:0:5778:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].8, 224 off9632 00000040:00080000:2.0:1783441357.426958:0:5778:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].9, 80 off9712 00000040:00080000:2.0:1783441357.427019:0:5778:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].10, 224 off9936 20000000:01000000:2.0:1783441357.427035:0:5778:0:(mgs_llog.c:2546:mgs_write_log_direct_all()) Changing log lustre-client 20000000:01000000:2.0:1783441357.427037:0:5778:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-client/lustre/sys.timeout fl=4 20000000:01000000:2.0:1783441357.428009:0:7477:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 27 marker 15 1->4: lustre sys.timeout 20000000:01000000:2.0:1783441357.428065:0:7477:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 29 marker 15 2->4: lustre sys.timeout 00000040:00080000:2.0:1783441357.428237:0:7477:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 36 count 36 00000040:00080000:1.0:1783441357.429061:0:5778:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].36, 224 off14352 00000040:00080000:0.0:1783441357.430274:0:5778:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].37, 80 off14432 00000040:00080000:0.0:1783441357.430348:0:5778:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].38, 224 off14656 20000000:01000000:0.0:1783441357.430370:0:5778:0:(mgs_llog.c:2546:mgs_write_log_direct_all()) Changing log lustre-MDT0000 20000000:01000000:0.0:1783441357.430373:0:5778:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-MDT0000/lustre/sys.timeout fl=4 20000000:01000000:3.0:1783441357.431385:0:7478:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 22 marker 16 1->4: lustre sys.timeout 20000000:01000000:3.0:1783441357.431449:0:7478:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 24 marker 16 2->4: lustre sys.timeout 00000040:00080000:3.0:1783441357.431511:0:7478:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 31 count 31 00000040:00080000:0.0:1783441357.432303:0:5778:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].31, 224 off13616 00000040:00080000:0.0:1783441357.432352:0:5778:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].32, 80 off13696 00000040:00080000:0.0:1783441357.432419:0:5778:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].33, 224 off13920 20000000:01000000:0.0:1783441357.432434:0:5778:0:(mgs_llog.c:2546:mgs_write_log_direct_all()) Changing log lustre-OST0001 20000000:01000000:0.0:1783441357.432446:0:5778:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-OST0001/lustre/sys.timeout fl=4 00000040:00080000:0.0:1783441357.434258:0:7479:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x9:0x0] index 5 count 5 00000040:00080000:1.0:1783441357.434809:0:5778:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].5, 224 off9104 00000040:00080000:1.0:1783441357.434859:0:5778:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].6, 80 off9184 00000040:00080000:1.0:1783441357.434966:0:5778:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].7, 224 off9408 10000000:01000000:1.0:1783441357.434993:0:5778:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x0 (lustre) 00010000:00010000:1.0:1783441357.435014:0:5778:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff91a841477600/0xa2426164df2c7639 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 5778 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783441357.435034:0:5778:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff91a85eb3dc00/0xa2426164df2c757c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xa2426164df2c7575 expref: 16 pid: 5779 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783441357.435042:0:5778:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff91a85f83d400/0xa2426164df2c75a6 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xa2426164df2c759f expref: 16 pid: 5779 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783441357.435049:0:5778:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff91a85f83cc00/0xa2426164df2c75d0 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xa2426164df2c75c9 expref: 16 pid: 5779 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783441357.435056:0:5778:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff91a85f83d000/0xa2426164df2c75ec lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xa2426164df2c75e5 expref: 16 pid: 5779 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783441357.435068:0:5778:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff91a85f83d600/0xa2426164df2c761d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xa2426164df2c7616 expref: 16 pid: 5780 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783441357.435075:0:5778:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff91a841477600/0xa2426164df2c7639 lrc: 8/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 5778 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783441357.435113:0:5778:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff91a85f83d600/0xa2426164df2c761d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xa2426164df2c7616 expref: 16 pid: 5780 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783441357.435129:0:5778:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff91a85f83d600/0xa2426164df2c761d lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xa2426164df2c7616 expref: 16 pid: 5780 timeout: 345 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783441357.435142:0:5778:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff91a87d6a1880 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0000:MGS:5778:1870073693222400:0@lo:104: 00000100:00100000:1.0:1783441357.435229:0:5778:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1783441357.435284:0:5778:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff91a85f83d000/0xa2426164df2c75ec lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xa2426164df2c75e5 expref: 16 pid: 5779 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783441357.435292:0:5778:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff91a85f83d000/0xa2426164df2c75ec lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xa2426164df2c75e5 expref: 16 pid: 5779 timeout: 345 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783441357.435300:0:5778:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff91a87d6a2680 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0000:MGS:5778:1870073693222528:0@lo:104: 00010000:00010000:1.0:1783441357.435324:0:5778:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff91a85f83cc00/0xa2426164df2c75d0 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xa2426164df2c75c9 expref: 16 pid: 5779 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783441357.435332:0:5778:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff91a85f83cc00/0xa2426164df2c75d0 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xa2426164df2c75c9 expref: 16 pid: 5779 timeout: 345 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783441357.435340:0:5778:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff91a87d6a3b80 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0000:MGS:5778:1870073693222656:0@lo:104: 00010000:00010000:1.0:1783441357.435363:0:5778:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff91a85f83d400/0xa2426164df2c75a6 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xa2426164df2c759f expref: 16 pid: 5779 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783441357.435378:0:5778:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff91a85f83d400/0xa2426164df2c75a6 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xa2426164df2c759f expref: 16 pid: 5779 timeout: 345 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783441357.435386:0:5778:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff91a87d6a1180 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0000:MGS:5778:1870073693222784:0@lo:104: 00010000:00010000:1.0:1783441357.435414:0:5778:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff91a85eb3dc00/0xa2426164df2c757c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xa2426164df2c7575 expref: 16 pid: 5779 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783441357.435422:0:5778:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff91a85eb3dc00/0xa2426164df2c757c lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xa2426164df2c7575 expref: 16 pid: 5779 timeout: 345 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783441357.435430:0:5778:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff91a87d6a2d80 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0000:MGS:5778:1870073693222912:0@lo:104: 00000100:00100000:1.0:1783441357.435446:0:5778:0:(client.c:2702:ptlrpc_set_wait()) set ffff91a848f226c0 going to sleep for 11 seconds 00000100:00100000:0.0:1783441357.435928:0:5767:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/2 left), rc = 0 00000100:00100000:0.0:1783441357.435951:0:5767:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783441357.435980:0:5767:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783441357.435990:0:5767:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783441357.435998:0:5767:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783441357.436009:0:5767:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073693222400 00000100:00100000:0.0:1783441357.436015:0:5767:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073693222400 00000100:00100000:0.0:1783441357.436052:0:5767:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073693222528 00000100:00100000:0.0:1783441357.436055:0:5767:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073693222528 00000100:00100000:0.0:1783441357.436065:0:5767:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073693222656 00000100:00100000:0.0:1783441357.436068:0:5767:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073693222656 00000100:00100000:0.0:1783441357.436076:0:5767:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073693222784 00000100:00100000:0.0:1783441357.436079:0:5767:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073693222784 00000100:00100000:0.0:1783441357.436086:0:5767:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073693222912 00000100:00100000:0.0:1783441357.436088:0:5767:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073693222912 00000100:00100000:0.0:1783441357.436100:0:5767:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:0.0:1783441357.436107:0:5767:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a842f6bc50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:6c1ddb50-5795-40c6-a2b6-8f58add9da62+7:5778:x1870073693222400:12345-0@lo:104: 00010000:00010000:0.0:1783441357.436120:0:5767:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.113@tcp lock: ffff91a841476400/0xa2426164df2c7616 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400000000000 nid: local remote: 0xa2426164df2c761d expref: -99 pid: 5783 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783441357.436193:0:5767:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:0.0:1783441357.436200:0:5767:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a842f6bc50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:6c1ddb50-5795-40c6-a2b6-8f58add9da62+7:5778:x1870073693222400:12345-0@lo:104: Request processed in 93us (971us total) trans 0 rc 0/0 00000100:00100000:0.0:1783441357.436206:0:5767:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:0.0:1783441357.436254:0:5767:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:0.0:1783441357.436260:0:5767:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a8756a5180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:6c1ddb50-5795-40c6-a2b6-8f58add9da62+6:5778:x1870073693222528:12345-0@lo:104: 00010000:00010000:0.0:1783441357.436268:0:5767:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.113@tcp lock: ffff91a841476e00/0xa2426164df2c75e5 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400000000000 nid: local remote: 0xa2426164df2c75ec expref: -99 pid: 5783 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783441357.436313:0:5767:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:0.0:1783441357.436318:0:5767:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a8756a5180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:6c1ddb50-5795-40c6-a2b6-8f58add9da62+6:5778:x1870073693222528:12345-0@lo:104: Request processed in 59us (368us total) trans 0 rc 0/0 00000100:00100000:0.0:1783441357.436324:0:5767:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:0.0:1783441357.436337:0:5767:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:0.0:1783441357.436342:0:5767:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a8756a5c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:6c1ddb50-5795-40c6-a2b6-8f58add9da62+5:5778:x1870073693222656:12345-0@lo:104: 00010000:00010000:0.0:1783441357.436349:0:5767:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.113@tcp lock: ffff91a85f83ce00/0xa2426164df2c75c9 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400000000000 nid: local remote: 0xa2426164df2c75d0 expref: -99 pid: 5783 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783441357.436373:0:5767:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to priority blp list, 3 blwis in pool 00000100:00100000:0.0:1783441357.436377:0:5767:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a8756a5c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:6c1ddb50-5795-40c6-a2b6-8f58add9da62+5:5778:x1870073693222656:12345-0@lo:104: Request processed in 36us (397us total) trans 0 rc 0/0 00000100:00100000:0.0:1783441357.436384:0:5767:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:0.0:1783441357.436395:0:5767:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:0.0:1783441357.436400:0:5767:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a8756a7100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:6c1ddb50-5795-40c6-a2b6-8f58add9da62+4:5778:x1870073693222784:12345-0@lo:104: 00010000:00010000:0.0:1783441357.436406:0:5767:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.113@tcp lock: ffff91a85eb3c600/0xa2426164df2c759f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400000000000 nid: local remote: 0xa2426164df2c75a6 expref: -99 pid: 6577 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783441357.436429:0:5767:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/4 locks to priority blp list, 4 blwis in pool 00000100:00100000:0.0:1783441357.436434:0:5767:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a8756a7100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:6c1ddb50-5795-40c6-a2b6-8f58add9da62+4:5778:x1870073693222784:12345-0@lo:104: Request processed in 35us (443us total) trans 0 rc 0/0 00000100:00100000:0.0:1783441357.436439:0:5767:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:0.0:1783441357.436451:0:5767:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:0.0:1783441357.436710:0:5767:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a8756a4e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:6c1ddb50-5795-40c6-a2b6-8f58add9da62+3:5778:x1870073693222912:12345-0@lo:104: 00010000:00010000:0.0:1783441357.436718:0:5767:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.113@tcp lock: ffff91a85f83c800/0xa2426164df2c7575 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400000000000 nid: local remote: 0xa2426164df2c757c expref: -99 pid: 6577 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783441357.436783:0:5767:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/5 locks to priority blp list, 5 blwis in pool 00000100:00100000:0.0:1783441357.436789:0:5767:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a8756a4e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:6c1ddb50-5795-40c6-a2b6-8f58add9da62+3:5778:x1870073693222912:12345-0@lo:104: Request processed in 332us (789us total) trans 0 rc 0/0 00000100:00100000:0.0:1783441357.436794:0:5767:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00010000:00010000:0.0:1783441357.436813:0:5773:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 4 total in blp. (4 blwis in pool) 00010000:00010000:0.0:1783441357.436819:0:5773:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.113@tcp lock: ffff91a841476400/0xa2426164df2c7616 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400000000000 nid: local remote: 0xa2426164df2c761d expref: -99 pid: 5783 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783441357.436826:0:5773:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91a841476400 already unused, calling callback (ffffffffc1b78c20) 10000000:00010000:0.0:1783441357.436830:0:5773:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.113@tcp lock: ffff91a841476400/0xa2426164df2c7616 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400400000000 nid: local remote: 0xa2426164df2c761d expref: -99 pid: 5783 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783441357.436838:0:5773:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.113@tcp lock: ffff91a841476400/0xa2426164df2c7616 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1408400000000 nid: local remote: 0xa2426164df2c761d expref: -99 pid: 5783 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1783441357.436845:0:5773:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.113@tcp lock: ffff91a841476400/0xa2426164df2c7616 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1409400000000 nid: local remote: 0xa2426164df2c761d expref: -99 pid: 5783 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1783441357.436851:0:5773:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:0.0:1783441357.436884:0:5773:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.113@tcp lock: ffff91a841476400/0xa2426164df2c7616 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0xa2426164df2c761d expref: -99 pid: 5783 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783441357.436891:0:5773:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1783441357.436911:0:5773:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.113@tcp lock: ffff91a841476400/0xa2426164df2c7616 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0xa2426164df2c761d expref: -99 pid: 5783 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783441357.436918:0:5773:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.113@tcp lock: ffff91a841476400/0xa2426164df2c7616 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0xa2426164df2c761d expref: -99 pid: 5783 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783441357.436943:0:5773:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 3 total in blp. (3 blwis in pool) 00010000:00010000:0.0:1783441357.436947:0:5773:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.113@tcp lock: ffff91a841476e00/0xa2426164df2c75e5 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0xa2426164df2c75ec expref: -99 pid: 5783 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783441357.436952:0:5773:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91a841476e00 already unused, calling callback (ffffffffc1b78c20) 10000000:00010000:0.0:1783441357.436954:0:5773:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.113@tcp lock: ffff91a841476e00/0xa2426164df2c75e5 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1400400000000 nid: local remote: 0xa2426164df2c75ec expref: -99 pid: 5783 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783441357.436961:0:5773:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.113@tcp lock: ffff91a841476e00/0xa2426164df2c75e5 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1408400000000 nid: local remote: 0xa2426164df2c75ec expref: -99 pid: 5783 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1783441357.436967:0:5773:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.113@tcp lock: ffff91a841476e00/0xa2426164df2c75e5 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1409400000000 nid: local remote: 0xa2426164df2c75ec expref: -99 pid: 5783 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1783441357.436971:0:5773:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:0.0:1783441357.436985:0:5773:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.113@tcp lock: ffff91a841476e00/0xa2426164df2c75e5 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0xa2426164df2c75ec expref: -99 pid: 5783 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783441357.436991:0:5773:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1783441357.437004:0:5773:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.113@tcp lock: ffff91a841476e00/0xa2426164df2c75e5 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0xa2426164df2c75ec expref: -99 pid: 5783 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783441357.437011:0:5773:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.113@tcp lock: ffff91a841476e00/0xa2426164df2c75e5 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0xa2426164df2c75ec expref: -99 pid: 5783 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783441357.437019:0:5773:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:0.0:1783441357.437022:0:5773:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.113@tcp lock: ffff91a85f83ce00/0xa2426164df2c75c9 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xa2426164df2c75d0 expref: -99 pid: 5783 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783441357.437038:0:5773:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91a85f83ce00 already unused, calling callback (ffffffffc1b78c20) 10000000:00010000:0.0:1783441357.437041:0:5773:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.113@tcp lock: ffff91a85f83ce00/0xa2426164df2c75c9 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0xa2426164df2c75d0 expref: -99 pid: 5783 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783441357.437048:0:5773:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.113@tcp lock: ffff91a85f83ce00/0xa2426164df2c75c9 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0xa2426164df2c75d0 expref: -99 pid: 5783 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1783441357.437054:0:5773:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.113@tcp lock: ffff91a85f83ce00/0xa2426164df2c75c9 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0xa2426164df2c75d0 expref: -99 pid: 5783 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1783441357.437058:0:5773:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:0.0:1783441357.437071:0:5773:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.113@tcp lock: ffff91a85f83ce00/0xa2426164df2c75c9 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xa2426164df2c75d0 expref: -99 pid: 5783 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783441357.437076:0:5773:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1783441357.437081:0:5773:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.113@tcp lock: ffff91a85f83ce00/0xa2426164df2c75c9 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xa2426164df2c75d0 expref: -99 pid: 5783 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783441357.437086:0:5773:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.113@tcp lock: ffff91a85f83ce00/0xa2426164df2c75c9 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xa2426164df2c75d0 expref: -99 pid: 5783 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783441357.437111:0:5773:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1783441357.437114:0:5773:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.113@tcp lock: ffff91a85eb3c600/0xa2426164df2c759f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xa2426164df2c75a6 expref: -99 pid: 6577 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783441357.437119:0:5773:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91a85eb3c600 already unused, calling callback (ffffffffc1b78c20) 10000000:00010000:0.0:1783441357.437122:0:5773:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.113@tcp lock: ffff91a85eb3c600/0xa2426164df2c759f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0xa2426164df2c75a6 expref: -99 pid: 6577 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783441357.437137:0:5773:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.113@tcp lock: ffff91a85eb3c600/0xa2426164df2c759f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0xa2426164df2c75a6 expref: -99 pid: 6577 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1783441357.437143:0:5773:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.113@tcp lock: ffff91a85eb3c600/0xa2426164df2c759f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0xa2426164df2c75a6 expref: -99 pid: 6577 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1783441357.437362:0:5773:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:0.0:1783441357.437414:0:5773:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.113@tcp lock: ffff91a85eb3c600/0xa2426164df2c759f lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xa2426164df2c75a6 expref: -99 pid: 6577 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783441357.437421:0:5773:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1783441357.437427:0:5773:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.113@tcp lock: ffff91a85eb3c600/0xa2426164df2c759f lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xa2426164df2c75a6 expref: -99 pid: 6577 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783441357.437434:0:5773:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.113@tcp lock: ffff91a85eb3c600/0xa2426164df2c759f lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xa2426164df2c75a6 expref: -99 pid: 6577 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783441357.437444:0:5773:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1783441357.437447:0:5773:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.113@tcp lock: ffff91a85f83c800/0xa2426164df2c7575 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xa2426164df2c757c expref: -99 pid: 6577 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783441357.437452:0:5773:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91a85f83c800 already unused, calling callback (ffffffffc1b78c20) 10000000:00010000:0.0:1783441357.437465:0:5773:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.113@tcp lock: ffff91a85f83c800/0xa2426164df2c7575 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xa2426164df2c757c expref: -99 pid: 6577 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783441357.437472:0:5773:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.113@tcp lock: ffff91a85f83c800/0xa2426164df2c7575 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xa2426164df2c757c expref: -99 pid: 6577 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1783441357.437478:0:5773:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.113@tcp lock: ffff91a85f83c800/0xa2426164df2c7575 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xa2426164df2c757c expref: -99 pid: 6577 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1783441357.437490:0:5773:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00000100:00100000:1.0:1783441357.437566:0:5778:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff91a87d6a1880 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0000:MGS:5778:1870073693222400:0@lo:104: 00000100:00100000:1.0:1783441357.437576:0:5778:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff91a87d6a2680 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0000:MGS:5778:1870073693222528:0@lo:104: 00000100:00100000:1.0:1783441357.437584:0:5778:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff91a87d6a3b80 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0000:MGS:5778:1870073693222656:0@lo:104: 00000100:00100000:1.0:1783441357.437611:0:5778:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff91a87d6a1180 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0000:MGS:5778:1870073693222784:0@lo:104: 00000100:00100000:1.0:1783441357.437619:0:5778:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff91a87d6a2d80 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0000:MGS:5778:1870073693222912:0@lo:104: 00010000:00010000:1.0:1783441357.437644:0:5778:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff91a841477600/0xa2426164df2c7639 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 5778 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783441357.438394:0:5773:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.113@tcp lock: ffff91a85f83c800/0xa2426164df2c7575 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xa2426164df2c757c expref: -99 pid: 6577 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783441357.438404:0:5773:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1783441357.438411:0:5773:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.113@tcp lock: ffff91a85f83c800/0xa2426164df2c7575 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xa2426164df2c757c expref: -99 pid: 6577 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783441357.438418:0:5773:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.113@tcp lock: ffff91a85f83c800/0xa2426164df2c7575 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xa2426164df2c757c expref: -99 pid: 6577 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783441357.438433:0:5773:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783441357.438435:0:5773:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783441357.438436:0:5773:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783441357.438444:0:5772:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1783441357.438470:0:3304:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff91a8756a6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:6c1ddb50-5795-40c6-a2b6-8f58add9da62:3304:1870073693223040:0@lo:103: 00000100:00100000:0.0:1783441357.438698:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783441357.438765:0:3304:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff91a8756a5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:6c1ddb50-5795-40c6-a2b6-8f58add9da62:3304:1870073693223552:0@lo:103: 00000100:00100000:0.0:1783441357.438789:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783441357.438813:0:3304:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1783441357.438818:0:3304:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff91a8756a4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:6c1ddb50-5795-40c6-a2b6-8f58add9da62:3304:1870073693223424:0@lo:103: 00000100:00100000:0.0:1783441357.438836:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783441357.438869:0:3305:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff91a8756a7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:6c1ddb50-5795-40c6-a2b6-8f58add9da62:3305:1870073693223168:0@lo:103: 00000100:00100000:0.0:1783441357.438888:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783441357.438899:0:3305:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1783441357.438904:0:3305:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff91a8756a5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:6c1ddb50-5795-40c6-a2b6-8f58add9da62:3305:1870073693223296:0@lo:103: 00000100:00100000:0.0:1783441357.438921:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783441357.439045:0:5769:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073693223040 00000100:00100000:0.0:1783441357.439052:0:5769:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073693223040 00010000:00010000:0.0:1783441357.439080:0:5769:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff91a85f83d600/0xa2426164df2c761d lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xa2426164df2c7616 expref: 17 pid: 5780 timeout: 345 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783441357.439099:0:5769:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073693223552 00000100:00100000:0.0:1783441357.439101:0:5769:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073693223552 00000100:00100000:2.0:1783441357.439272:0:5771:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073693223424 00000100:00100000:2.0:1783441357.439276:0:5771:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073693223424 00010000:00010000:2.0:1783441357.439293:0:5771:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff91a85f83d400/0xa2426164df2c75a6 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xa2426164df2c759f expref: 19 pid: 5779 timeout: 345 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783441357.439306:0:5771:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073693223168 00000100:00100000:2.0:1783441357.439309:0:5771:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073693223168 00010000:00010000:2.0:1783441357.439320:0:5771:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff91a85f83d000/0xa2426164df2c75ec lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xa2426164df2c75e5 expref: 20 pid: 5779 timeout: 345 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783441357.439330:0:5771:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073693223296 00000100:00100000:2.0:1783441357.439332:0:5771:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073693223296 00010000:00010000:2.0:1783441357.439341:0:5771:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff91a85f83cc00/0xa2426164df2c75d0 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xa2426164df2c75c9 expref: 21 pid: 5779 timeout: 345 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783441357.439354:0:5771:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:2.0:1783441357.439362:0:5771:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a8756a6a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:6c1ddb50-5795-40c6-a2b6-8f58add9da62+21:3304:x1870073693223040:12345-0@lo:103: 00010000:00010000:2.0:1783441357.439382:0:5771:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1783441357.439388:0:5771:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff91a85f83d600/0xa2426164df2c761d lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xa2426164df2c7616 expref: 21 pid: 5780 timeout: 345 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783441357.439400:0:5771:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff91a85f83d600/0xa2426164df2c761d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xa2426164df2c7616 expref: 21 pid: 5780 timeout: 345 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783441357.439414:0:5771:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff91a85f83d600/0xa2426164df2c761d lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xa2426164df2c7616 expref: 21 pid: 5780 timeout: 345 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783441357.439428:0:5771:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1783441357.439482:0:5771:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a8756a6a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:6c1ddb50-5795-40c6-a2b6-8f58add9da62+20:3304:x1870073693223040:12345-0@lo:103: Request processed in 120us (784us total) trans 0 rc 0/0 00000100:00100000:2.0:1783441357.439490:0:5771:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:2.0:1783441357.439509:0:5771:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:2.0:1783441357.439527:0:5771:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a8756a4700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:6c1ddb50-5795-40c6-a2b6-8f58add9da62+19:3304:x1870073693223424:12345-0@lo:103: 00010000:00010000:2.0:1783441357.439537:0:5771:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1783441357.439542:0:5771:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff91a85f83d400/0xa2426164df2c75a6 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xa2426164df2c759f expref: 19 pid: 5779 timeout: 345 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783441357.439551:0:5771:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff91a85f83d400/0xa2426164df2c75a6 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xa2426164df2c759f expref: 19 pid: 5779 timeout: 345 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783441357.439561:0:5771:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff91a85f83d400/0xa2426164df2c75a6 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xa2426164df2c759f expref: 19 pid: 5779 timeout: 345 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783441357.439570:0:5771:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1783441357.439807:0:5771:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a8756a4700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:6c1ddb50-5795-40c6-a2b6-8f58add9da62+18:3304:x1870073693223424:12345-0@lo:103: Request processed in 89us (766us total) trans 0 rc 0/0 00000100:00100000:2.0:1783441357.439816:0:5771:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:2.0:1783441357.439836:0:5771:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:2.0:1783441357.439841:0:5771:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a8756a6d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:6c1ddb50-5795-40c6-a2b6-8f58add9da62+17:3305:x1870073693223168:12345-0@lo:103: 00010000:00010000:2.0:1783441357.439849:0:5771:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1783441357.439853:0:5771:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff91a85f83d000/0xa2426164df2c75ec lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xa2426164df2c75e5 expref: 17 pid: 5779 timeout: 345 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783441357.439862:0:5771:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff91a85f83d000/0xa2426164df2c75ec lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xa2426164df2c75e5 expref: 17 pid: 5779 timeout: 345 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783441357.439872:0:5771:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff91a85f83d000/0xa2426164df2c75ec lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xa2426164df2c75e5 expref: 17 pid: 5779 timeout: 345 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783441357.439881:0:5771:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1783441357.439909:0:5771:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a8756a6d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:6c1ddb50-5795-40c6-a2b6-8f58add9da62+16:3305:x1870073693223168:12345-0@lo:103: Request processed in 68us (1020us total) trans 0 rc 0/0 00000100:00100000:2.0:1783441357.439914:0:5771:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:2.0:1783441357.439926:0:5771:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:2.0:1783441357.439931:0:5771:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a8756a7480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:6c1ddb50-5795-40c6-a2b6-8f58add9da62+15:3305:x1870073693223296:12345-0@lo:103: 00010000:00010000:2.0:1783441357.439951:0:5771:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1783441357.439956:0:5771:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff91a85f83cc00/0xa2426164df2c75d0 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xa2426164df2c75c9 expref: 15 pid: 5779 timeout: 345 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783441357.439963:0:5771:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff91a85f83cc00/0xa2426164df2c75d0 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xa2426164df2c75c9 expref: 15 pid: 5779 timeout: 345 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783441357.439972:0:5771:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff91a85f83cc00/0xa2426164df2c75d0 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xa2426164df2c75c9 expref: 15 pid: 5779 timeout: 345 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783441357.439981:0:5771:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1783441357.440001:0:5771:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a8756a7480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:6c1ddb50-5795-40c6-a2b6-8f58add9da62+14:3305:x1870073693223296:12345-0@lo:103: Request processed in 70us (1079us total) trans 0 rc 0/0 00000100:00100000:2.0:1783441357.440012:0:5771:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00010000:00010000:0.0:1783441357.440142:0:5769:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff91a85eb3dc00/0xa2426164df2c757c lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xa2426164df2c7575 expref: 13 pid: 5779 timeout: 345 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783441357.440268:0:5769:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:0.0:1783441357.440275:0:5769:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a8756a5f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:6c1ddb50-5795-40c6-a2b6-8f58add9da62+13:3304:x1870073693223552:12345-0@lo:103: 00010000:00010000:0.0:1783441357.440285:0:5769:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1783441357.440288:0:5769:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff91a85eb3dc00/0xa2426164df2c757c lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xa2426164df2c7575 expref: 13 pid: 5779 timeout: 345 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783441357.440297:0:5769:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff91a85eb3dc00/0xa2426164df2c757c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xa2426164df2c7575 expref: 13 pid: 5779 timeout: 345 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783441357.440306:0:5769:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff91a85eb3dc00/0xa2426164df2c757c lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xa2426164df2c7575 expref: 13 pid: 5779 timeout: 345 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783441357.440318:0:5769:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff91a841477600/0xa2426164df2c7639 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 5778 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783441357.440325:0:5769:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff91a841477600/0xa2426164df2c7639 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 5778 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783441357.440339:0:5769:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff91a841477600/0xa2426164df2c7639 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 5778 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783441357.440346:0:5769:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff91a841477600/0xa2426164df2c7639 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5778 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783441357.440359:0:5769:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff91a841477600/0xa2426164df2c7639 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5778 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783441357.440365:0:5769:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff91a841477600/0xa2426164df2c7639 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5778 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783441357.440370:0:5769:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91a841477600 already unused, calling callback (ffffffffc155ff90) 00010000:00010000:0.0:1783441357.440374:0:5769:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff91a841477600/0xa2426164df2c7639 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5778 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783441357.440382:0:5769:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff91a841477600/0xa2426164df2c7639 lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 5778 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783441357.446314:0:5778:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff91a841477600/0xa2426164df2c7639 lrc: 5/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5778 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783441357.446334:0:5778:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff91a841477600/0xa2426164df2c7639 lrc: 5/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5778 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:1.0:1783441357.446365:0:5778:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0001, index=1, rc=0 00010000:00010000:0.0:1783441357.447675:0:5769:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff91a841477600/0xa2426164df2c7639 lrc: 3/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5778 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783441357.447693:0:5769:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff91a841477600/0xa2426164df2c7639 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5778 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783441357.447718:0:5769:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1783441357.447843:0:5769:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a8756a5f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:6c1ddb50-5795-40c6-a2b6-8f58add9da62+12:3304:x1870073693223552:12345-0@lo:103: Request processed in 7565us (9050us total) trans 0 rc 0/0 00000100:00100000:0.0:1783441357.447853:0:5769:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:0.0:1783441357.447921:0:3305:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff91a8756a5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:6c1ddb50-5795-40c6-a2b6-8f58add9da62:3305:1870073693223296:0@lo:103: 00000100:00100000:0.0:1783441357.447931:0:3305:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff91a8756a7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:6c1ddb50-5795-40c6-a2b6-8f58add9da62:3305:1870073693223168:0@lo:103: 00000100:00100000:0.0:1783441357.447958:0:3304:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff91a8756a4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:6c1ddb50-5795-40c6-a2b6-8f58add9da62:3304:1870073693223424:0@lo:103: 00000100:00100000:0.0:1783441357.447966:0:3304:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff91a8756a6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:6c1ddb50-5795-40c6-a2b6-8f58add9da62:3304:1870073693223040:0@lo:103: 00000100:00100000:0.0:1783441357.447987:0:3304:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff91a8756a5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:6c1ddb50-5795-40c6-a2b6-8f58add9da62:3304:1870073693223552:0@lo:103: 00000100:00100000:3.0:1783441357.538281:0:5778:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a8484ba850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6c1ddb50-5795-40c6-a2b6-8f58add9da62+11:7474:x1870073693222272:12345-0@lo:253: Request processed in 132039us (132471us total) trans 0 rc 0/0 00000100:00100000:3.0:1783441357.538300:0:5778:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 67 00000100:00100000:1.0:1783441357.538406:0:7474:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff91a87d6a3800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6c1ddb50-5795-40c6-a2b6-8f58add9da62:7474:1870073693222272:0@lo:253: 10000000:01000000:1.0:1783441357.538423:0:7474:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0001 got index = 1 00000020:01000004:1.0:1783441357.538427:0:7474:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:1.0:1783441357.538429:0:7474:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:1.0:1783441357.538431:0:7474:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1783441357.538432:0:7474:0:(tgt_mount.c:1178:server_mti_print()) uuid: lustre-OST0001_UUID 00000020:01000004:1.0:1783441357.538433:0:7474:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1783441357.538435:0:7474:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1783441357.538436:0:7474:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:1.0:1783441357.538438:0:7474:0:(tgt_mount.c:1196:server_mti_print()) LDD_F_REWRITE_LDD 00000020:01000004:1.0:1783441357.538439:0:7474:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1783441357.538441:0:7474:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:1.0:1783441357.538464:0:7474:0:(tgt_mount.c:101:server_register_mount()) register mount ffff91a875566000 from lustre-OST0001 10000000:01000000:1.0:1783441357.538489:0:7474:0:(mgc_request.c:1943:mgc_process_config()) parse_log lustre-OST0001 from 0 10000000:01000000:1.0:1783441357.538493:0:7474:0:(mgc_request.c:329:config_log_add()) add config log lustre-OST0001-0000000000000000 10000000:01000000:1.0:1783441357.538500:0:7474:0:(mgc_request_server.c:874:mgc_get_local_copy()) Get log lustre-sptlrpc-ffff91a84767cd40 local copy 10000000:01000000:1.0:1783441357.538505:0:7474:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:2.0:1783441357.548314:0:7474:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.113@tcp lock: ffff91a85f83cc00/0xa2426164df2c7640 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 7474 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783441357.548334:0:7474:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x0 ns: MGC192.168.201.113@tcp lock: ffff91a85f83cc00/0xa2426164df2c7640 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 7474 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783441357.548347:0:7474:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.113@tcp lock: ffff91a85f83cc00/0xa2426164df2c7640 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 7474 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783441357.548377:0:7474:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff91a87d6a3800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6c1ddb50-5795-40c6-a2b6-8f58add9da62:7474:1870073693223680:0@lo:101: 00000100:00100000:2.0:1783441357.548457:0:7474:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783441357.551755:0:7474:0:(client.c:2702:ptlrpc_set_wait()) set ffff91a844b009c0 going to sleep for 11 seconds 00000100:00100000:1.0:1783441357.553687:0:5780:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073693223680 00000100:00100000:1.0:1783441357.553705:0:5780:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073693223680 00000100:00100000:0.0:1783441357.553953:0:5780:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 68 00000100:00100000:0.0:1783441357.553965:0:5780:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a848f75050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6c1ddb50-5795-40c6-a2b6-8f58add9da62+11:7474:x1870073693223680:12345-0@lo:101: 00010000:00010000:0.0:1783441357.553983:0:5780:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1783441357.554005:0:5780:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff91a840031000/0xa2426164df2c7647 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xa2426164df2c7640 expref: -99 pid: 5780 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783441357.554034:0:5780:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff91a840031000/0xa2426164df2c7647 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xa2426164df2c7640 expref: 12 pid: 5780 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783441357.554046:0:5780:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff91a840031000/0xa2426164df2c7647 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xa2426164df2c7640 expref: 12 pid: 5780 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783441357.554055:0:5780:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91a840031000, rc 0) 00000100:00100000:0.0:1783441357.554141:0:5780:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a848f75050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6c1ddb50-5795-40c6-a2b6-8f58add9da62+12:7474:x1870073693223680:12345-0@lo:101: Request processed in 177us (5684us total) trans 0 rc 0/0 00000100:00100000:0.0:1783441357.554148:0:5780:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 68 00000100:00100000:2.0:1783441357.555317:0:7474:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff91a87d6a3800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6c1ddb50-5795-40c6-a2b6-8f58add9da62:7474:1870073693223680:0@lo:101: 00010000:00010000:2.0:1783441357.555343:0:7474:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.113@tcp lock: ffff91a85f83cc00/0xa2426164df2c7640 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0xa2426164df2c7647 expref: -99 pid: 7474 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783441357.555355:0:7474:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.113@tcp lock: ffff91a85f83cc00/0xa2426164df2c7640 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0xa2426164df2c7647 expref: -99 pid: 7474 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783441357.555483:0:7474:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff91a846f26d80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6c1ddb50-5795-40c6-a2b6-8f58add9da62:7474:1870073693223808:0@lo:501: 00000100:00100000:2.0:1783441357.556235:0:7474:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783441357.556370:0:7474:0:(client.c:2702:ptlrpc_set_wait()) set ffff91a844b009c0 going to sleep for 11 seconds 00000100:00100000:3.0:1783441357.559278:0:5778:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073693223808 00000100:00100000:3.0:1783441357.559291:0:5778:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073693223808 00000100:00100000:3.0:1783441357.559410:0:5778:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 69 00000100:00100000:3.0:1783441357.559423:0:5778:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a848f74c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6c1ddb50-5795-40c6-a2b6-8f58add9da62+12:7474:x1870073693223808:12345-0@lo:501: 00000100:00100000:3.0:1783441357.560319:0:5778:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a848f74c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6c1ddb50-5795-40c6-a2b6-8f58add9da62+12:7474:x1870073693223808:12345-0@lo:501: Request processed in 891us (4079us total) trans 0 rc -2/-2 00000100:00100000:3.0:1783441357.560332:0:5778:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 69 00000100:00100000:2.0:1783441357.560422:0:7474:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff91a846f26d80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6c1ddb50-5795-40c6-a2b6-8f58add9da62:7474:1870073693223808:0@lo:501: 10000000:01000000:2.0:1783441357.560449:0:7474:0:(mgc_request_server.c:765:mgc_llog_local_copy()) MGC192.168.201.113@tcp: no remote llog for lustre-sptlrpc, check MGS config 10000000:01000000:2.0:1783441357.560487:0:7474:0:(mgc_request_server.c:897:mgc_get_local_copy()) MGC192.168.201.113@tcp: can't save local copy of 'lustre-sptlrpc': rc = -2. 00010000:00010000:2.0:1783441357.560495:0:7474:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.113@tcp lock: ffff91a85f83cc00/0xa2426164df2c7640 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0xa2426164df2c7647 expref: -99 pid: 7474 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783441357.560584:0:7474:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.113@tcp lock: ffff91a85f83cc00/0xa2426164df2c7640 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000400000000 nid: local remote: 0xa2426164df2c7647 expref: -99 pid: 7474 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783441357.560670:0:7474:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.201.113@tcp lock: ffff91a85f83cc00/0xa2426164df2c7640 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000400000000 nid: local remote: 0xa2426164df2c7647 expref: -99 pid: 7474 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783441357.561058:0:7474:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:2.0:1783441357.561088:0:7474:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff91a875566000 10000000:01000000:2.0:1783441357.561094:0:7474:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:2.0:1783441357.561100:0:7474:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-OST0001-0000000000000000 00010000:00010000:0.0:1783441357.561183:0:5773:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1783441357.561191:0:5773:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.113@tcp lock: ffff91a85f83cc00/0xa2426164df2c7640 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x400000000 nid: local remote: 0xa2426164df2c7647 expref: -99 pid: 7474 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783441357.561198:0:5773:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91a85f83cc00 already unused, calling callback (ffffffffc1b78c20) 10000000:00010000:0.0:1783441357.561202:0:5773:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.113@tcp lock: ffff91a85f83cc00/0xa2426164df2c7640 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x400000000 nid: local remote: 0xa2426164df2c7647 expref: -99 pid: 7474 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783441357.561211:0:5773:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.113@tcp lock: ffff91a85f83cc00/0xa2426164df2c7640 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x8400000000 nid: local remote: 0xa2426164df2c7647 expref: -99 pid: 7474 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1783441357.561230:0:5773:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.113@tcp lock: ffff91a85f83cc00/0xa2426164df2c7640 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x9400000000 nid: local remote: 0xa2426164df2c7647 expref: -99 pid: 7474 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1783441357.561236:0:5773:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:0.0:1783441357.561267:0:5773:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.113@tcp lock: ffff91a85f83cc00/0xa2426164df2c7640 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x4809400000020 nid: local remote: 0xa2426164df2c7647 expref: -99 pid: 7474 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783441357.561274:0:5773:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00000100:00100000:3.0:1783441357.561343:0:3305:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff91a8756a5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:6c1ddb50-5795-40c6-a2b6-8f58add9da62:3305:1870073693223936:0@lo:103: 00000100:00100000:3.0:1783441357.561396:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 10000000:01000000:2.0:1783441357.561495:0:7474:0:(mgc_request.c:68:mgc_name2resid()) log lustre-OST0001 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:2.0:1783441357.561501:0:7474:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-OST0001-0000000000000000 from 1 10000000:01000000:2.0:1783441357.561503:0:7474:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0001 (res 0x65727473756c) 00010000:00010000:2.0:1783441357.561538:0:7474:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.113@tcp lock: ffff91a85f83d000/0xa2426164df2c764e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 7474 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783441357.561547:0:7474:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.113@tcp lock: ffff91a85f83d000/0xa2426164df2c764e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 7474 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783441357.561555:0:7474:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.113@tcp lock: ffff91a85f83d000/0xa2426164df2c764e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 7474 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783441357.561569:0:7474:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff91a846f26d80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6c1ddb50-5795-40c6-a2b6-8f58add9da62:7474:1870073693224064:0@lo:101: 00000100:00100000:2.0:1783441357.561623:0:7474:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783441357.561651:0:7474:0:(client.c:2702:ptlrpc_set_wait()) set ffff91a844b00240 going to sleep for 11 seconds 00000100:00100000:1.0:1783441357.561840:0:5779:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073693224064 00000100:00100000:1.0:1783441357.561863:0:5779:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073693224064 00000100:00100000:1.0:1783441357.561910:0:5779:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 70 00000100:00100000:1.0:1783441357.561920:0:5779:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a848f74850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6c1ddb50-5795-40c6-a2b6-8f58add9da62+12:7474:x1870073693224064:12345-0@lo:101: 00010000:00010000:1.0:1783441357.561932:0:5779:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1783441357.561945:0:5779:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff91a841477400/0xa2426164df2c7655 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xa2426164df2c764e expref: -99 pid: 5779 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783441357.561967:0:5779:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff91a841477400/0xa2426164df2c7655 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xa2426164df2c764e expref: 13 pid: 5779 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783441357.561992:0:5779:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff91a841477400/0xa2426164df2c7655 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xa2426164df2c764e expref: 13 pid: 5779 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783441357.562001:0:5779:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91a841477400, rc 0) 00000100:00100000:1.0:1783441357.562036:0:5779:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a848f74850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6c1ddb50-5795-40c6-a2b6-8f58add9da62+13:7474:x1870073693224064:12345-0@lo:101: Request processed in 118us (412us total) trans 0 rc 0/0 00000100:00100000:1.0:1783441357.562043:0:5779:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 70 00000100:00100000:2.0:1783441357.562478:0:7474:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff91a846f26d80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6c1ddb50-5795-40c6-a2b6-8f58add9da62:7474:1870073693224064:0@lo:101: 00010000:00010000:2.0:1783441357.562493:0:7474:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.113@tcp lock: ffff91a85f83d000/0xa2426164df2c764e lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xa2426164df2c7655 expref: -99 pid: 7474 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783441357.562513:0:7474:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.113@tcp lock: ffff91a85f83d000/0xa2426164df2c764e lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xa2426164df2c7655 expref: -99 pid: 7474 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783441357.562693:0:7474:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff91a846f26d80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6c1ddb50-5795-40c6-a2b6-8f58add9da62:7474:1870073693224192:0@lo:501: 00000100:00100000:2.0:1783441357.562723:0:7474:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783441357.563023:0:7474:0:(client.c:2702:ptlrpc_set_wait()) set ffff91a844b00240 going to sleep for 11 seconds 00010000:00010000:0.0:1783441357.563218:0:5773:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.113@tcp lock: ffff91a85f83cc00/0xa2426164df2c7640 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x4809400000020 nid: local remote: 0xa2426164df2c7647 expref: -99 pid: 7474 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783441357.563228:0:5773:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.113@tcp lock: ffff91a85f83cc00/0xa2426164df2c7640 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x4809400000020 nid: local remote: 0xa2426164df2c7647 expref: -99 pid: 7474 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783441357.563243:0:5773:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783441357.563245:0:5773:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783441357.563247:0:5773:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1783441357.563301:0:5778:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073693224192 00000100:00100000:1.0:1783441357.563307:0:5778:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073693224192 00000100:00100000:1.0:1783441357.563348:0:5778:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 71 00000100:00100000:1.0:1783441357.563356:0:5778:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a848f76450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6c1ddb50-5795-40c6-a2b6-8f58add9da62+13:7474:x1870073693224192:12345-0@lo:501: 00000100:00100000:1.0:1783441357.564053:0:5778:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a848f76450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6c1ddb50-5795-40c6-a2b6-8f58add9da62+13:7474:x1870073693224192:12345-0@lo:501: Request processed in 695us (1326us total) trans 0 rc 0/0 00000100:00100000:1.0:1783441357.564061:0:5778:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 71 00000100:00100000:0.0:1783441357.564258:0:7474:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff91a846f26d80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6c1ddb50-5795-40c6-a2b6-8f58add9da62:7474:1870073693224192:0@lo:501: 00000100:00100000:0.0:1783441357.564300:0:7474:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff91a8756a6300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6c1ddb50-5795-40c6-a2b6-8f58add9da62:7474:1870073693224320:0@lo:503: 00000100:00100000:0.0:1783441357.564349:0:7474:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783441357.564381:0:7474:0:(client.c:2702:ptlrpc_set_wait()) set ffff91a84619ee40 going to sleep for 11 seconds 00000100:00100000:2.0:1783441357.564432:0:5780:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073693224320 00000100:00100000:2.0:1783441357.564437:0:5780:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073693224320 00000100:00100000:2.0:1783441357.564471:0:5780:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 72 00000100:00100000:2.0:1783441357.564479:0:5780:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a848f76c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6c1ddb50-5795-40c6-a2b6-8f58add9da62+13:7474:x1870073693224320:12345-0@lo:503: 00000100:00100000:2.0:1783441357.565007:0:5780:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a848f76c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6c1ddb50-5795-40c6-a2b6-8f58add9da62+13:7474:x1870073693224320:12345-0@lo:503: Request processed in 526us (655us total) trans 0 rc 0/0 00000100:00100000:2.0:1783441357.565014:0:5780:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 72 00000100:00100000:1.0:1783441357.565186:0:7474:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff91a8756a6300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6c1ddb50-5795-40c6-a2b6-8f58add9da62:7474:1870073693224320:0@lo:503: 00000040:00080000:1.0:1783441357.565463:0:7474:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:1.0:1783441357.565668:0:7474:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff91a87d6a2d80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6c1ddb50-5795-40c6-a2b6-8f58add9da62:7474:1870073693224448:0@lo:502: 00000100:00100000:1.0:1783441357.565715:0:7474:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783441357.565977:0:7474:0:(client.c:2702:ptlrpc_set_wait()) set ffff91a84766e000 going to sleep for 11 seconds 00000100:00100000:3.0:1783441357.566695:0:5770:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073693223936 00000100:00100000:3.0:1783441357.566704:0:5770:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073693223936 00000100:00100000:3.0:1783441357.566785:0:5770:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1783441357.566793:0:5770:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a875691f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:6c1ddb50-5795-40c6-a2b6-8f58add9da62+13:3305:x1870073693223936:12345-0@lo:103: 00010000:00010000:3.0:1783441357.566806:0:5770:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1783441357.566833:0:5770:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff91a840031000/0xa2426164df2c7647 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xa2426164df2c7640 expref: 13 pid: 5780 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783441357.567218:0:5770:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1783441357.567277:0:5770:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a875691f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:6c1ddb50-5795-40c6-a2b6-8f58add9da62+12:3305:x1870073693223936:12345-0@lo:103: Request processed in 484us (5880us total) trans 0 rc 0/0 00000100:00100000:3.0:1783441357.567285:0:5770:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1783441357.567325:0:3305:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff91a8756a5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:6c1ddb50-5795-40c6-a2b6-8f58add9da62:3305:1870073693223936:0@lo:103: 00000100:00100000:2.0:1783441357.570927:0:5778:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073693224448 00000100:00100000:2.0:1783441357.570941:0:5778:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073693224448 00000100:00100000:2.0:1783441357.571015:0:5778:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 73 00000100:00100000:2.0:1783441357.571026:0:5778:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a848f77c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6c1ddb50-5795-40c6-a2b6-8f58add9da62+12:7474:x1870073693224448:12345-0@lo:502: 00000100:00100000:2.0:1783441357.571526:0:5778:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a848f77c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6c1ddb50-5795-40c6-a2b6-8f58add9da62+12:7474:x1870073693224448:12345-0@lo:502: Request processed in 499us (5807us total) trans 0 rc 0/0 00000100:00100000:2.0:1783441357.571534:0:5778:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 73 00000100:00100000:1.0:1783441357.571660:0:7474:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff91a87d6a2d80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6c1ddb50-5795-40c6-a2b6-8f58add9da62:7474:1870073693224448:0@lo:502: 00000040:00080000:1.0:1783441357.572012:0:7474:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].1, 224 off8416 00000040:00080000:1.0:1783441357.572068:0:7474:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].2, 128 off8544 00000040:00080000:1.0:1783441357.572117:0:7474:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].3, 112 off8656 00000040:00080000:1.0:1783441357.572170:0:7474:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].4, 224 off8880 00000040:00080000:1.0:1783441357.572209:0:7474:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].5, 224 off9104 00000040:00080000:1.0:1783441357.572243:0:7474:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].6, 80 off9184 00000100:00100000:1.0:1783441357.572288:0:7474:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff91a87d6a2d80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6c1ddb50-5795-40c6-a2b6-8f58add9da62:7474:1870073693224576:0@lo:502: 00000100:00100000:1.0:1783441357.572338:0:7474:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783441357.572860:0:5779:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073693224576 00000100:00100000:0.0:1783441357.572868:0:5779:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073693224576 00000100:00100000:0.0:1783441357.572914:0:5779:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 74 00000100:00100000:0.0:1783441357.572923:0:5779:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a848f76050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6c1ddb50-5795-40c6-a2b6-8f58add9da62+12:7474:x1870073693224576:12345-0@lo:502: 00000100:00100000:0.0:1783441357.573093:0:5779:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a848f76050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6c1ddb50-5795-40c6-a2b6-8f58add9da62+12:7474:x1870073693224576:12345-0@lo:502: Request processed in 170us (753us total) trans 0 rc 0/0 00000100:00100000:0.0:1783441357.573247:0:5779:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 74 00000100:00100000:1.0:1783441357.573452:0:7474:0:(client.c:2702:ptlrpc_set_wait()) set ffff91a84766e000 going to sleep for 11 seconds 00000100:00100000:1.0:1783441357.573472:0:7474:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff91a87d6a2d80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6c1ddb50-5795-40c6-a2b6-8f58add9da62:7474:1870073693224576:0@lo:502: 00000040:00080000:0.0:1783441357.574175:0:7474:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].7, 224 off9408 00000040:00080000:0.0:1783441357.574193:0:7474:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x9:0x0] index 7 count 8 00000020:01000000:3.0:1783441357.574982:0:7482:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:3.0:1783441357.574991:0:7482:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0001 (1) in 0 of lustre-ost2/ost2 00000020:00000080:3.0:1783441357.574998:0:7482:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1783441357.575000:0:7482:0:(obd_config.c:1561:class_process_config()) marker 17 (0x1) lustre-OST0001 add ost 00000020:00000080:3.0:1783441357.575006:0:7482:0:(obd_config.c:1470:class_process_config()) processing cmd: cf001 00000020:00000080:3.0:1783441357.575020:0:7482:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001 (ffff91a877f7b380) 00000020:00000080:3.0:1783441357.575041:0:7482:0:(obd_config.c:720:class_attach_name()) OBD: dev 15 attached type obdfilter with refcount 2 00000020:00000080:3.0:1783441357.575047:0:7482:0:(obd_config.c:1470:class_process_config()) processing cmd: cf003 00000020:01000004:3.0:1783441357.575173:0:7482:0:(tgt_mount.c:153:server_get_mount()) get mount ffff91a875566000 from lustre-OST0001, refs=2 00080000:01000000:3.0:1783441357.575183:0:7482:0:(osd_handler.c:1569:osd_obd_connect()) connect #1 00000020:00000080:3.0:1783441357.575190:0:7482:0:(genops.c:1406:class_connect()) connect: client lustre-OST0001-osd_UUID, cookie 0xa2426164df2c7663 00010000:00010000:2.0:1783441357.583318:0:7482:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-filter-lustre-OST0001_UUID-3 is initialized 00000001:02000400:2.0:1783441357.584975:0:7482:0:(tgt_lastrcvd.c:1878:tgt_server_data_init()) lustre-OST0001: new disk, initializing 00000001:00000004:2.0:1783441357.588716:0:7482:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 0 40000000:02000000:2.0:1783441357.589439:0:7482:0:(fid_handler.c:560:seq_server_init()) srv-lustre-OST0001: No data found on store. Initialize space. 00080000:10000000:2.0:1783441357.596149:0:7482:0:(osd_index.c:2102:osd_index_try()) lustre-OST0001: index object [0x200000001:0x3:0x0] (8/8/3) registered 00080000:10000000:2.0:1783441357.596717:0:7482:0:(osd_index.c:2102:osd_index_try()) lustre-OST0001: index object [0x200000003:0x3:0x0] (8/8/4) registered 00000020:00000080:2.0:1783441357.599341:0:7482:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001 (uuid lustre-OST0001_UUID) 00000020:01000000:2.0:1783441357.599354:0:7482:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1783441357.599361:0:7482:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1783441357.599364:0:7482:0:(obd_config.c:1561:class_process_config()) marker 17 (0x2) lustre-OST0001 add ost 00000020:01000000:2.0:1783441357.599367:0:7482:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1783441357.599371:0:7482:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1783441357.599373:0:7482:0:(obd_config.c:1561:class_process_config()) marker 23 (0x1) lustre sys.timeout 00000020:00000080:2.0:1783441357.599376:0:7482:0:(obd_config.c:1470:class_process_config()) processing cmd: cf009 00000020:00000080:2.0:1783441357.599378:0:7482:0:(obd_config.c:1535:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:2.0:1783441357.599437:0:7482:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1783441357.599441:0:7482:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1783441357.599443:0:7482:0:(obd_config.c:1561:class_process_config()) marker 23 (0x2) lustre sys.timeout 00000040:00080000:2.0:1783441357.599446:0:7482:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 8 count 8 00000020:01000000:1.0:1783441357.611060:0:7474:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0001 gen 1-7 (rc=0) 10000000:01000000:1.0:1783441357.611187:0:7474:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.201.113@tcp: configuration from log 'lustre-OST0001' succeeded (0). 00010000:00010000:1.0:1783441357.611216:0:7474:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.113@tcp lock: ffff91a85f83d000/0xa2426164df2c764e lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xa2426164df2c7655 expref: -99 pid: 7474 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783441357.611231:0:7474:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.113@tcp lock: ffff91a85f83d000/0xa2426164df2c764e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xa2426164df2c7655 expref: -99 pid: 7474 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1783441357.611247:0:7474:0:(mgc_request.c:1801:mgc_process_log()) Process log params-ffff91a875566000 from 1 10000000:01000000:1.0:1783441357.611250:0:7474:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:1.0:1783441357.611305:0:7474:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.113@tcp lock: ffff91a841477600/0xa2426164df2c766a lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 7474 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783441357.611313:0:7474:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.113@tcp lock: ffff91a841477600/0xa2426164df2c766a lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 7474 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783441357.611326:0:7474:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.113@tcp lock: ffff91a841477600/0xa2426164df2c766a lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 7474 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783441357.611358:0:7474:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff91a87d6a2d80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6c1ddb50-5795-40c6-a2b6-8f58add9da62:7474:1870073693224704:0@lo:101: 00000100:00100000:1.0:1783441357.611437:0:7474:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783441357.611490:0:7474:0:(client.c:2702:ptlrpc_set_wait()) set ffff91a84766ea80 going to sleep for 11 seconds 00000100:00100000:2.0:1783441357.611723:0:5778:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073693224704 00000100:00100000:2.0:1783441357.611929:0:5778:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073693224704 00000100:00100000:2.0:1783441357.611978:0:5778:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 75 00000100:00100000:2.0:1783441357.611988:0:5778:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a848f77850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6c1ddb50-5795-40c6-a2b6-8f58add9da62+12:7474:x1870073693224704:12345-0@lo:101: 00010000:00010000:2.0:1783441357.612003:0:5778:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1783441357.612017:0:5778:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff91a85f83d400/0xa2426164df2c7671 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0xa2426164df2c766a expref: -99 pid: 5778 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783441357.612040:0:5778:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff91a85f83d400/0xa2426164df2c7671 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xa2426164df2c766a expref: 13 pid: 5778 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783441357.612051:0:5778:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff91a85f83d400/0xa2426164df2c7671 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xa2426164df2c766a expref: 13 pid: 5778 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783441357.612060:0:5778:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91a85f83d400, rc 0) 00000100:00100000:2.0:1783441357.612325:0:5778:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a848f77850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6c1ddb50-5795-40c6-a2b6-8f58add9da62+13:7474:x1870073693224704:12345-0@lo:101: Request processed in 337us (888us total) trans 0 rc 0/0 00000100:00100000:2.0:1783441357.612333:0:5778:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 75 00000100:00100000:3.0:1783441357.612873:0:7474:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff91a87d6a2d80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6c1ddb50-5795-40c6-a2b6-8f58add9da62:7474:1870073693224704:0@lo:101: 00010000:00010000:3.0:1783441357.612892:0:7474:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.113@tcp lock: ffff91a841477600/0xa2426164df2c766a lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xa2426164df2c7671 expref: -99 pid: 7474 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783441357.612902:0:7474:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.113@tcp lock: ffff91a841477600/0xa2426164df2c766a lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0xa2426164df2c7671 expref: -99 pid: 7474 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783441357.613035:0:7474:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff91a875690700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6c1ddb50-5795-40c6-a2b6-8f58add9da62:7474:1870073693224832:0@lo:501: 00000100:00100000:3.0:1783441357.613075:0:7474:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783441357.613236:0:7474:0:(client.c:2702:ptlrpc_set_wait()) set ffff91a85903bc00 going to sleep for 11 seconds 00000100:00100000:1.0:1783441357.613376:0:5780:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073693224832 00000100:00100000:1.0:1783441357.613382:0:5780:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073693224832 00000100:00100000:1.0:1783441357.613413:0:5780:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 76 00000100:00100000:1.0:1783441357.613421:0:5780:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a848f76850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6c1ddb50-5795-40c6-a2b6-8f58add9da62+13:7474:x1870073693224832:12345-0@lo:501: 00000100:00100000:1.0:1783441357.614010:0:5780:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a848f76850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6c1ddb50-5795-40c6-a2b6-8f58add9da62+13:7474:x1870073693224832:12345-0@lo:501: Request processed in 588us (933us total) trans 0 rc 0/0 00000100:00100000:1.0:1783441357.614018:0:5780:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 76 00000100:00100000:3.0:1783441357.614146:0:7474:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff91a875690700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6c1ddb50-5795-40c6-a2b6-8f58add9da62:7474:1870073693224832:0@lo:501: 00000100:00100000:3.0:1783441357.614183:0:7474:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff91a875690700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6c1ddb50-5795-40c6-a2b6-8f58add9da62:7474:1870073693224960:0@lo:503: 00000100:00100000:3.0:1783441357.614229:0:7474:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783441357.614261:0:7474:0:(client.c:2702:ptlrpc_set_wait()) set ffff91a85903bc00 going to sleep for 11 seconds 00000100:00100000:0.0:1783441357.614351:0:5778:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073693224960 00000100:00100000:0.0:1783441357.614357:0:5778:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073693224960 00000100:00100000:0.0:1783441357.614385:0:5778:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 77 00000100:00100000:0.0:1783441357.614392:0:5778:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a848f75450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6c1ddb50-5795-40c6-a2b6-8f58add9da62+13:7474:x1870073693224960:12345-0@lo:503: 00000100:00100000:0.0:1783441357.615018:0:5778:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a848f75450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6c1ddb50-5795-40c6-a2b6-8f58add9da62+13:7474:x1870073693224960:12345-0@lo:503: Request processed in 625us (787us total) trans 0 rc 0/0 00000100:00100000:0.0:1783441357.615026:0:5778:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 77 00000100:00100000:3.0:1783441357.615253:0:7474:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff91a875690700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6c1ddb50-5795-40c6-a2b6-8f58add9da62:7474:1870073693224960:0@lo:503: 00000040:00080000:3.0:1783441357.615697:0:7474:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:3.0:1783441357.616012:0:7474:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff91a875690700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6c1ddb50-5795-40c6-a2b6-8f58add9da62:7474:1870073693225088:0@lo:502: 00000100:00100000:3.0:1783441357.616074:0:7474:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783441357.617219:0:7474:0:(client.c:2702:ptlrpc_set_wait()) set ffff91a8582b6300 going to sleep for 11 seconds 00000100:00100000:1.0:1783441357.617299:0:5780:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073693225088 00000100:00100000:1.0:1783441357.617307:0:5780:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073693225088 00000100:00100000:1.0:1783441357.617364:0:5780:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 78 00000100:00100000:1.0:1783441357.617371:0:5780:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a848f75850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6c1ddb50-5795-40c6-a2b6-8f58add9da62+13:7474:x1870073693225088:12345-0@lo:502: 00000100:00100000:1.0:1783441357.618062:0:5780:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a848f75850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6c1ddb50-5795-40c6-a2b6-8f58add9da62+13:7474:x1870073693225088:12345-0@lo:502: Request processed in 688us (1985us total) trans 0 rc 0/0 00000100:00100000:1.0:1783441357.618071:0:5780:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 78 00000100:00100000:3.0:1783441357.618214:0:7474:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff91a875690700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6c1ddb50-5795-40c6-a2b6-8f58add9da62:7474:1870073693225088:0@lo:502: 00000040:00080000:3.0:1783441357.619435:0:7474:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].1, 224 off8416 00000040:00080000:3.0:1783441357.619573:0:7474:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].2, 112 off8528 00000100:00100000:3.0:1783441357.619675:0:7474:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff91a875690700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6c1ddb50-5795-40c6-a2b6-8f58add9da62:7474:1870073693225216:0@lo:502: 00000100:00100000:3.0:1783441357.621308:0:7474:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783441357.621355:0:7474:0:(client.c:2702:ptlrpc_set_wait()) set ffff91a8582b6300 going to sleep for 11 seconds 00000100:00100000:1.0:1783441357.621955:0:5779:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073693225216 00000100:00100000:1.0:1783441357.621967:0:5779:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073693225216 00000100:00100000:1.0:1783441357.622032:0:5779:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 79 00000100:00100000:1.0:1783441357.622043:0:5779:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a848f77050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6c1ddb50-5795-40c6-a2b6-8f58add9da62+13:7474:x1870073693225216:12345-0@lo:502: 00000100:00100000:1.0:1783441357.622268:0:5779:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a848f77050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6c1ddb50-5795-40c6-a2b6-8f58add9da62+13:7474:x1870073693225216:12345-0@lo:502: Request processed in 226us (966us total) trans 0 rc 0/0 00000100:00100000:1.0:1783441357.622275:0:5779:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 79 00000100:00100000:3.0:1783441357.622445:0:7474:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff91a875690700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6c1ddb50-5795-40c6-a2b6-8f58add9da62:7474:1870073693225216:0@lo:502: 00000040:00080000:3.0:1783441357.622611:0:7474:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].3, 224 off8752 00000040:00080000:3.0:1783441357.622625:0:7474:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 3 count 4 00000020:01000000:3.0:1783441357.625380:0:7486:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1783441357.625396:0:7486:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1783441357.625399:0:7486:0:(obd_config.c:1561:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:3.0:1783441357.625406:0:7486:0:(obd_config.c:2005:class_config_llog_handler()) cmd ce032, instance name: general-ffff91a875566000 00000020:00000080:3.0:1783441357.625408:0:7486:0:(obd_config.c:1470:class_process_config()) processing cmd: ce032 00000020:01000000:3.0:1783441357.625431:0:7486:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1783441357.625434:0:7486:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1783441357.625436:0:7486:0:(obd_config.c:1561:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000040:00080000:3.0:1783441357.625439:0:7486:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 4 count 4 00000020:01000000:1.0:1783441357.625823:0:7474:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-3 (rc=0) 10000000:01000000:1.0:1783441357.625867:0:7474:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.201.113@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:1.0:1783441357.625895:0:7474:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.113@tcp lock: ffff91a841477600/0xa2426164df2c766a lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xa2426164df2c7671 expref: -99 pid: 7474 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783441357.625908:0:7474:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.113@tcp lock: ffff91a841477600/0xa2426164df2c766a lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xa2426164df2c7671 expref: -99 pid: 7474 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1783441357.625952:0:7474:0:(mgc_request.c:1943:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:1.0:1783441357.625955:0:7474:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff91a875566000 10000000:01000000:1.0:1783441357.625958:0:7474:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff91a875566000 10000000:01000000:1.0:1783441357.625969:0:7474:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:1.0:1783441357.625975:0:7474:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-client-ffff91a875566000 from 1 10000000:01000000:1.0:1783441357.625977:0:7474:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:1.0:1783441357.626018:0:7474:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.113@tcp lock: ffff91a841476e00/0xa2426164df2c7678 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 7474 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783441357.626026:0:7474:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.113@tcp lock: ffff91a841476e00/0xa2426164df2c7678 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 7474 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783441357.626038:0:7474:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.113@tcp lock: ffff91a841476e00/0xa2426164df2c7678 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 7474 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783441357.626064:0:7474:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff91a87d6a1180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6c1ddb50-5795-40c6-a2b6-8f58add9da62:7474:1870073693225344:0@lo:101: 00000100:00100000:1.0:1783441357.626331:0:7474:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783441357.626373:0:7474:0:(client.c:2702:ptlrpc_set_wait()) set ffff91a84766e9c0 going to sleep for 11 seconds 00000100:00100000:3.0:1783441357.626593:0:5780:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073693225344 00000100:00100000:3.0:1783441357.626670:0:5780:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073693225344 00000100:00100000:3.0:1783441357.626904:0:5780:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 80 00000100:00100000:3.0:1783441357.626916:0:5780:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a848f74050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6c1ddb50-5795-40c6-a2b6-8f58add9da62+13:7474:x1870073693225344:12345-0@lo:101: 00010000:00010000:3.0:1783441357.626931:0:5780:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1783441357.626947:0:5780:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff91a85eb3d000/0xa2426164df2c767f lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xa2426164df2c7678 expref: -99 pid: 5780 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783441357.626973:0:5780:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff91a85eb3d000/0xa2426164df2c767f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xa2426164df2c7678 expref: 14 pid: 5780 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783441357.626984:0:5780:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff91a85eb3d000/0xa2426164df2c767f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xa2426164df2c7678 expref: 14 pid: 5780 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783441357.626994:0:5780:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91a85eb3d000, rc 0) 00000100:00100000:3.0:1783441357.627043:0:5780:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a848f74050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6c1ddb50-5795-40c6-a2b6-8f58add9da62+14:7474:x1870073693225344:12345-0@lo:101: Request processed in 129us (712us total) trans 0 rc 0/0 00000100:00100000:3.0:1783441357.627050:0:5780:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 80 00000100:00100000:1.0:1783441357.627154:0:7474:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff91a87d6a1180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6c1ddb50-5795-40c6-a2b6-8f58add9da62:7474:1870073693225344:0@lo:101: 00010000:00010000:1.0:1783441357.627172:0:7474:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.113@tcp lock: ffff91a841476e00/0xa2426164df2c7678 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xa2426164df2c767f expref: -99 pid: 7474 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783441357.627181:0:7474:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.113@tcp lock: ffff91a841476e00/0xa2426164df2c7678 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xa2426164df2c767f expref: -99 pid: 7474 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783441357.627295:0:7474:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff91a87d6a1180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6c1ddb50-5795-40c6-a2b6-8f58add9da62:7474:1870073693225472:0@lo:501: 00000100:00100000:1.0:1783441357.627324:0:7474:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783441357.627555:0:7474:0:(client.c:2702:ptlrpc_set_wait()) set ffff91a84766e9c0 going to sleep for 11 seconds 00000100:00100000:0.0:1783441357.627897:0:5779:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073693225472 00000100:00100000:0.0:1783441357.627903:0:5779:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073693225472 00000100:00100000:0.0:1783441357.627932:0:5779:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 81 00000100:00100000:0.0:1783441357.627939:0:5779:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a848f74450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6c1ddb50-5795-40c6-a2b6-8f58add9da62+14:7474:x1870073693225472:12345-0@lo:501: 00000100:00100000:0.0:1783441357.628341:0:5779:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a848f74450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6c1ddb50-5795-40c6-a2b6-8f58add9da62+14:7474:x1870073693225472:12345-0@lo:501: Request processed in 400us (1014us total) trans 0 rc 0/0 00000100:00100000:0.0:1783441357.628348:0:5779:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 81 00000100:00100000:1.0:1783441357.628580:0:7474:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff91a87d6a1180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6c1ddb50-5795-40c6-a2b6-8f58add9da62:7474:1870073693225472:0@lo:501: 00000100:00100000:0.0:1783441357.629014:0:7474:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff91a8756a4380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6c1ddb50-5795-40c6-a2b6-8f58add9da62:7474:1870073693225600:0@lo:503: 00000100:00100000:0.0:1783441357.629070:0:7474:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783441357.629223:0:7474:0:(client.c:2702:ptlrpc_set_wait()) set ffff91a84619e6c0 going to sleep for 11 seconds 00000100:00100000:1.0:1783441357.629265:0:5779:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073693225600 00000100:00100000:1.0:1783441357.629271:0:5779:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073693225600 00000100:00100000:1.0:1783441357.629339:0:5779:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 82 00000100:00100000:1.0:1783441357.629356:0:5779:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a848f77450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6c1ddb50-5795-40c6-a2b6-8f58add9da62+14:7474:x1870073693225600:12345-0@lo:503: 00000100:00100000:1.0:1783441357.629690:0:5779:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a848f77450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6c1ddb50-5795-40c6-a2b6-8f58add9da62+14:7474:x1870073693225600:12345-0@lo:503: Request processed in 336us (619us total) trans 0 rc 0/0 00000100:00100000:1.0:1783441357.629699:0:5779:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 82 00000100:00100000:3.0:1783441357.630222:0:7474:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff91a8756a4380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6c1ddb50-5795-40c6-a2b6-8f58add9da62:7474:1870073693225600:0@lo:503: 00000040:00080000:3.0:1783441357.630674:0:7474:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:3.0:1783441357.630941:0:7474:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff91a875690700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6c1ddb50-5795-40c6-a2b6-8f58add9da62:7474:1870073693225728:0@lo:502: 00000100:00100000:3.0:1783441357.631013:0:7474:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783441357.631095:0:7474:0:(client.c:2702:ptlrpc_set_wait()) set ffff91a8582b60c0 going to sleep for 11 seconds 00000100:00100000:1.0:1783441357.631248:0:5779:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073693225728 00000100:00100000:1.0:1783441357.631255:0:5779:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073693225728 00000100:00100000:1.0:1783441357.631305:0:5779:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 83 00000100:00100000:1.0:1783441357.631315:0:5779:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a848f75c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6c1ddb50-5795-40c6-a2b6-8f58add9da62+14:7474:x1870073693225728:12345-0@lo:502: 00000100:00100000:1.0:1783441357.631561:0:5779:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a848f75c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6c1ddb50-5795-40c6-a2b6-8f58add9da62+14:7474:x1870073693225728:12345-0@lo:502: Request processed in 247us (548us total) trans 0 rc 0/0 00000100:00100000:1.0:1783441357.631569:0:5779:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 83 00000100:00100000:3.0:1783441357.631959:0:7474:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff91a875690700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6c1ddb50-5795-40c6-a2b6-8f58add9da62:7474:1870073693225728:0@lo:502: 00000040:00080000:3.0:1783441357.632400:0:7474:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].1, 224 off8416 00000040:00080000:3.0:1783441357.632458:0:7474:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].2, 120 off8536 00000040:00080000:3.0:1783441357.632494:0:7474:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].3, 168 off8704 00000040:00080000:3.0:1783441357.632699:0:7474:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].4, 224 off8928 00000040:00080000:3.0:1783441357.632929:0:7474:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].5, 224 off9152 00000040:00080000:3.0:1783441357.632985:0:7474:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].6, 120 off9272 00000040:00080000:3.0:1783441357.633022:0:7474:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].7, 168 off9440 00000040:00080000:3.0:1783441357.633058:0:7474:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].8, 224 off9664 00000040:00080000:3.0:1783441357.633242:0:7474:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].9, 224 off9888 00000040:00080000:3.0:1783441357.633284:0:7474:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].10, 120 off10008 00000040:00080000:3.0:1783441357.633319:0:7474:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].11, 224 off10232 00000040:00080000:3.0:1783441357.633368:0:7474:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].12, 224 off10456 00000040:00080000:3.0:1783441357.633404:0:7474:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].13, 88 off10544 00000040:00080000:3.0:1783441357.633436:0:7474:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].14, 128 off10672 00000040:00080000:3.0:1783441357.633500:0:7474:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].15, 144 off10816 00000040:00080000:3.0:1783441357.635476:0:7474:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].16, 160 off10976 00000040:00080000:3.0:1783441357.635939:0:7474:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].17, 224 off11200 00000040:00080000:3.0:1783441357.636033:0:7474:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].18, 224 off11424 00000040:00080000:3.0:1783441357.636074:0:7474:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].19, 80 off11504 00000040:00080000:3.0:1783441357.636193:0:7474:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].20, 224 off11728 00000040:00080000:3.0:1783441357.636250:0:7474:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].21, 224 off11952 00000040:00080000:3.0:1783441357.636372:0:7474:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].22, 88 off12040 00000040:00080000:3.0:1783441357.636409:0:7474:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].23, 128 off12168 00000040:00080000:3.0:1783441357.636462:0:7474:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].24, 144 off12312 00000040:00080000:3.0:1783441357.636504:0:7474:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].25, 128 off12440 00000040:00080000:3.0:1783441357.636706:0:7474:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].26, 224 off12664 00000040:00080000:3.0:1783441357.636947:0:7474:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].27, 224 off12888 00000040:00080000:3.0:1783441357.636984:0:7474:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].28, 80 off12968 00000040:00080000:3.0:1783441357.637014:0:7474:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].29, 224 off13192 00000040:00080000:3.0:1783441357.637073:0:7474:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].30, 224 off13416 00000040:00080000:3.0:1783441357.637186:0:7474:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].31, 88 off13504 00000040:00080000:3.0:1783441357.637222:0:7474:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].32, 128 off13632 00000040:00080000:3.0:1783441357.637338:0:7474:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].33, 144 off13776 00000040:00080000:3.0:1783441357.637384:0:7474:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].34, 128 off13904 00000040:00080000:3.0:1783441357.637430:0:7474:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].35, 224 off14128 00000040:00080000:3.0:1783441357.637491:0:7474:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].36, 224 off14352 00000040:00080000:3.0:1783441357.637685:0:7474:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].37, 80 off14432 00000100:00100000:3.0:1783441357.637911:0:7474:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff91a875690700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6c1ddb50-5795-40c6-a2b6-8f58add9da62:7474:1870073693225856:0@lo:502: 00000100:00100000:3.0:1783441357.638001:0:7474:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783441357.638354:0:5779:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073693225856 00000100:00100000:1.0:1783441357.638363:0:5779:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073693225856 00000100:00100000:3.0:1783441357.638465:0:7474:0:(client.c:2702:ptlrpc_set_wait()) set ffff91a85903bc00 going to sleep for 11 seconds 00000100:00100000:1.0:1783441357.638528:0:5779:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 84 00000100:00100000:1.0:1783441357.638540:0:5779:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a848f71850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6c1ddb50-5795-40c6-a2b6-8f58add9da62+14:7474:x1870073693225856:12345-0@lo:502: 00000100:00100000:1.0:1783441357.639054:0:5779:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a848f71850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6c1ddb50-5795-40c6-a2b6-8f58add9da62+14:7474:x1870073693225856:12345-0@lo:502: Request processed in 515us (1051us total) trans 0 rc 0/0 00000100:00100000:1.0:1783441357.639063:0:5779:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 84 00000100:00100000:3.0:1783441357.639217:0:7474:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff91a875690700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6c1ddb50-5795-40c6-a2b6-8f58add9da62:7474:1870073693225856:0@lo:502: 00000040:00080000:3.0:1783441357.639328:0:7474:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].38, 224 off14656 00000040:00080000:3.0:1783441357.639342:0:7474:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 38 count 39 00000020:01000004:1.0:1783441357.640598:0:7487:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-OST0001 (typ=lwp) 00000020:00000080:1.0:1783441357.640673:0:7487:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-OST0001 (ffff91a85021cd40) 00000020:00000080:1.0:1783441357.640699:0:7487:0:(obd_config.c:720:class_attach_name()) OBD: dev 16 attached type lwp with refcount 2 00000020:01000004:1.0:1783441357.641192:0:7487:0:(tgt_mount.c:153:server_get_mount()) get mount ffff91a875566000 from lustre-OST0001, refs=3 00000020:01000004:1.0:1783441357.641197:0:7487:0:(tgt_mount.c:187:server_put_mount()) put mount ffff91a875566000 from lustre-OST0001, refs=3 00000020:01000004:1.0:1783441357.641199:0:7487:0:(obd_mount.c:710:lustre_put_lsi()) put ffff91a875566000 3 00010000:00080000:1.0:1783441357.641231:0:7487:0:(ldlm_lib.c:102:import_set_conn()) imp ffff91a745262800@lustre-MDT0000-lwp-OST0001: add connection 192.168.201.113@tcp at head 00010000:00010000:1.0:1783441357.646993:0:7487:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-OST0001-4 is initialized 00000020:00000080:1.0:1783441357.647249:0:7487:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-OST0001 (uuid lustre-MDT0000-lwp-OST0001_UUID) 00000010:01000000:3.0:1783441357.648023:0:7487:0:(lwp_dev.c:497:lwp_obd_connect()) connect #0 00000020:00000080:3.0:1783441357.648038:0:7487:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-lwp-OST0001, cookie 0xa2426164df2c768d 00000100:00080000:3.0:1783441357.648049:0:7487:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 0 00000100:00080000:3.0:1783441357.648056:0:7487:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff91a745262800 using connection 192.168.201.113@tcp/0@lo 00000100:00100000:3.0:1783441357.648339:0:7487:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff91a875690700 x1870073693225984/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1783441357.648413:0:3302:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff91a875690700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3302:1870073693225984:0@lo:38: 00000100:00100000:0.0:1783441357.648495:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:3.0:1783441357.648573:0:7487:0:(pinger.c:374:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID 00000100:00100000:3.0:1783441357.648681:0:3305:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1783441357.648694:0:3305:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff91a875691c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3305:1870073693226112:0@lo:400: 00000100:00100000:1.0:1783441357.648888:0:5787:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073693225984 00000100:00100000:1.0:1783441357.648922:0:5787:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073693225984 00000100:00100000:1.0:1783441357.648957:0:5787:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1783441357.648965:0:5787:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a8756a7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3302:x1870073693225984:12345-0@lo:38: 00010000:00080000:1.0:1783441357.648991:0:5787:0:(ldlm_lib.c:1432:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-OST0001_UUID@0@lo t0 exp 0000000000000000 cur 195 last 0 00000020:00000080:1.0:1783441357.649028:0:5787:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-lwp-OST0001_UUID, cookie 0xa2426164df2c7694 00000004:00100000:1.0:1783441357.649043:0:5787:0:(mdt_handler.c:7286:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:1.0:1783441357.649075:0:5787:0:(import.c:65:import_set_state_nolock()) ffff91a745264800 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1783441357.649380:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783441357.650778:0:5787:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a8756a7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3302:x1870073693225984:12345-0@lo:38: Request processed in 1805us (2275us total) trans 0 rc 0/0 00000100:00100000:1.0:1783441357.650791:0:5787:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1783441357.650824:0:5787:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073693226112 00000100:00100000:1.0:1783441357.650832:0:5787:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073693226112 00000100:00100000:2.0:1783441357.652071:0:3304:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff91a875690e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3304:1870073693226368:0@lo:400: 00000100:00100000:2.0:1783441357.652146:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783441357.652384:0:3304:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1783441357.652391:0:3304:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff91a875693100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3304:1870073693226240:0@lo:400: 00000100:00100000:2.0:1783441357.652416:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783441357.652463:0:6583:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073693226368 00000100:00100000:2.0:1783441357.652470:0:6583:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073693226368 00000100:00100000:2.0:1783441357.652529:0:6583:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1783441357.652537:0:6583:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a846f26a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3304:x1870073693226368:12345-0@lo:400: 00000100:00100000:2.0:1783441357.652604:0:6583:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a846f26a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3304:x1870073693226368:12345-0@lo:400: Request processed in 67us (458us total) trans 0 rc 0/0 00000100:00100000:2.0:1783441357.652612:0:6583:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1783441357.652639:0:5785:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073693226240 00000100:00100000:2.0:1783441357.652643:0:5785:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073693226240 00000100:00100000:2.0:1783441357.652670:0:5785:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:2.0:1783441357.652676:0:5785:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a846f25f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3304:x1870073693226240:12345-0@lo:400: 00000100:00100000:2.0:1783441357.652704:0:5785:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a846f25f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3304:x1870073693226240:12345-0@lo:400: Request processed in 29us (287us total) trans 0 rc 0/0 00000100:00100000:2.0:1783441357.652710:0:5785:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00080000:2.0:1783441357.652725:0:5781:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1783441357.652730:0:5781:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:2.0:1783441357.652778:0:3304:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff91a875693100 x1870073693226240/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1783441373 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1783441357.652791:0:3304:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff91a875693100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3304:1870073693226240:0@lo:400: 00010000:00080000:2.0:1783441357.652802:0:3304:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff91a875690e00 x1870073693226368/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1783441373 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1783441357.652810:0:3304:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff91a875690e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3304:1870073693226368:0@lo:400: 00000100:00100000:1.0:1783441357.653246:0:5787:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:1.0:1783441357.653264:0:5787:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a875692300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3305:x1870073693226112:12345-0@lo:400: 00000100:00100000:1.0:1783441357.653318:0:5787:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a875692300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3305:x1870073693226112:12345-0@lo:400: Request processed in 64us (3938us total) trans 0 rc 0/0 00000100:00100000:1.0:1783441357.653324:0:5787:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00010000:00080000:3.0:1783441357.653472:0:3305:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff91a875691c00 x1870073693226112/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1783441373 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1783441357.653484:0:3305:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff91a875691c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3305:1870073693226112:0@lo:400: 00000040:00080000:3.0:1783441357.656041:0:7487:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 39 count 39 00000020:01000000:2.0:1783441357.656656:0:7474:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-38 (rc=0) 10000000:01000000:2.0:1783441357.656686:0:7474:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.201.113@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:2.0:1783441357.656704:0:7474:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.113@tcp lock: ffff91a841476e00/0xa2426164df2c7678 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xa2426164df2c767f expref: -99 pid: 7474 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783441357.656715:0:7474:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.113@tcp lock: ffff91a841476e00/0xa2426164df2c7678 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xa2426164df2c767f expref: -99 pid: 7474 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:2.0:1783441357.656809:0:7474:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:2.0:1783441357.656812:0:7474:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:2.0:1783441357.656813:0:7474:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1783441357.656814:0:7474:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1783441357.656815:0:7474:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1783441357.656817:0:7474:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1783441357.656818:0:7474:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1783441357.656820:0:7474:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:2.0:1783441357.656821:0:7474:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:2.0:1783441357.656823:0:7474:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1783441357.656825:0:7474:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:2.0:1783441357.656830:0:7474:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0001 0x40020062 00000020:01000004:2.0:1783441357.656832:0:7474:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:2.0:1783441357.656834:0:7474:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:2.0:1783441357.656835:0:7474:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1783441357.656836:0:7474:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1783441357.656837:0:7474:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1783441357.656838:0:7474:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1783441357.656839:0:7474:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1783441357.656850:0:7474:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:2.0:1783441357.656851:0:7474:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:2.0:1783441357.656852:0:7474:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1783441357.656853:0:7474:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:2.0:1783441357.656882:0:7474:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0001 00000100:00100000:2.0:1783441357.656903:0:7474:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff91a846f24700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6c1ddb50-5795-40c6-a2b6-8f58add9da62:7474:1870073693226496:0@lo:253: 00000100:00100000:2.0:1783441357.656980:0:7474:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783441357.657029:0:7474:0:(client.c:2702:ptlrpc_set_wait()) set ffff91a844b009c0 going to sleep for 11 seconds 00010000:00080000:0.0:1783441357.657404:0:3302:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff91a875690700 x1870073693225984/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/416 e 0 to 0 dl 1783441367 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1783441357.657416:0:3302:0:(client.c:3112:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0001: committing for last_committed 0 gen 2 00000100:00080000:0.0:1783441357.657425:0:3302:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-OST0001: connect to target with instance 1 00000100:00080000:0.0:1783441357.657442:0:3302:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-OST0001: Resetting ns_connect_flags to server flags: 0x2041401043000020 00000100:00080000:0.0:1783441357.657447:0:3302:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:0.0:1783441357.657451:0:3302:0:(import.c:65:import_set_state_nolock()) ffff91a745262800 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:0.0:1783441357.657458:0:3302:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff91a875690700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3302:1870073693225984:0@lo:38: 00000100:00100000:0.0:1783441357.657490:0:5780:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073693226496 00000100:00100000:0.0:1783441357.657495:0:5780:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073693226496 00000100:00100000:0.0:1783441357.657545:0:5780:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 85 00000100:00100000:0.0:1783441357.657553:0:5780:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a848f73050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6c1ddb50-5795-40c6-a2b6-8f58add9da62+14:7474:x1870073693226496:12345-0@lo:253: 20000000:01000000:0.0:1783441357.657578:0:5780:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 1 is ready to reconnect. 20000000:01000000:0.0:1783441357.657607:0:5780:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 00000100:00100000:1.0:1783441357.662686:0:7489:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff91a87d6a3b80 pname:cluuid:pid:xid:nid:opc:job lwp_notify_lust:lustre-MDT0000-lwp-OST0001_UUID:7489:1870073693226624:0@lo:901: 00000100:00100000:1.0:1783441357.662795:0:7489:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783441357.662836:0:5796:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073693226624 00000100:00100000:1.0:1783441357.662852:0:5796:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073693226624 00000100:00100000:1.0:1783441357.662907:0:5796:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1783441357.662916:0:5796:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a87d6a2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:lustre-MDT0000-lwp-OST0001_UUID+5:7489:x1870073693226624:12345-0@lo:901: 00000100:00100000:1.0:1783441357.663286:0:5796:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a87d6a2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:lustre-MDT0000-lwp-OST0001_UUID+5:7489:x1870073693226624:12345-0@lo:901: Request processed in 369us (490us total) trans 0 rc 0/0 00000100:00100000:1.0:1783441357.663294:0:5796:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00080000:1.0:1783441357.663317:0:5781:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1783441357.663336:0:7489:0:(client.c:2702:ptlrpc_set_wait()) set ffff91a84766e240 going to sleep for 11 seconds 00010000:00080000:1.0:1783441357.663362:0:7489:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff91a87d6a3b80 x1870073693226624/t0(0) o901->lustre-MDT0000-lwp-OST0001@0@lo:29/10 lens 248/4320 e 0 to 0 dl 1783441373 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1783441357.663378:0:7489:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff91a87d6a3b80 pname:cluuid:pid:xid:nid:opc:job lwp_notify_lust:lustre-MDT0000-lwp-OST0001_UUID:7489:1870073693226624:0@lo:901: 20000000:01000000:0.0:1783441357.724022:0:5780:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:0.0:1783441357.724046:0:5780:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0001, index=1, rc=0 20000000:01000000:1.0:1783441357.724180:0:5801:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:1.0:1783441357.724186:0:5801:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:1.0:1783441357.724209:0:5801:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff91a841476000/0xa2426164df2c769b lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 5801 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783441357.724230:0:5801:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff91a85f83d800/0xa2426164df2c75de lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xa2426164df2c75d7 expref: 14 pid: 5778 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783441357.724238:0:5801:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff91a841476000/0xa2426164df2c769b lrc: 4/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 5801 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783441357.724353:0:5801:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff91a85f83d800/0xa2426164df2c75de lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xa2426164df2c75d7 expref: 14 pid: 5778 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783441357.724369:0:5801:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff91a85f83d800/0xa2426164df2c75de lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xa2426164df2c75d7 expref: 14 pid: 5778 timeout: 345 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783441357.724384:0:5801:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff91a87d6a3b80 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:5801:1870073693226752:0@lo:104: 00000100:00100000:1.0:1783441357.724452:0:5801:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783441357.724501:0:5801:0:(client.c:2702:ptlrpc_set_wait()) set ffff91a84766ed80 going to sleep for 11 seconds 00000100:00100000:3.0:1783441357.725411:0:5768:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073693226752 00000100:00100000:3.0:1783441357.725423:0:5768:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073693226752 00000100:00100000:3.0:1783441357.725471:0:5768:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:3.0:1783441357.725481:0:5768:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a87d6a1880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:6c1ddb50-5795-40c6-a2b6-8f58add9da62+3:5801:x1870073693226752:12345-0@lo:104: 00010000:00010000:3.0:1783441357.725495:0:5768:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.113@tcp lock: ffff91a85f83c400/0xa2426164df2c75d7 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xa2426164df2c75de expref: -99 pid: 5783 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783441357.725660:0:5768:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1783441357.725667:0:5768:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a87d6a1880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:6c1ddb50-5795-40c6-a2b6-8f58add9da62+3:5801:x1870073693226752:12345-0@lo:104: Request processed in 188us (1216us total) trans 0 rc 0/0 00000100:00100000:3.0:1783441357.725674:0:5768:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:3.0:1783441357.725719:0:5801:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff91a87d6a3b80 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:5801:1870073693226752:0@lo:104: 00010000:00010000:3.0:1783441357.725835:0:5801:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff91a841476000/0xa2426164df2c769b lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 5801 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783441357.726041:0:5772:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1783441357.726049:0:5772:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.113@tcp lock: ffff91a85f83c400/0xa2426164df2c75d7 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xa2426164df2c75de expref: -99 pid: 5783 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783441357.726057:0:5772:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91a85f83c400 already unused, calling callback (ffffffffc1b78c20) 10000000:00010000:0.0:1783441357.726061:0:5772:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.113@tcp lock: ffff91a85f83c400/0xa2426164df2c75d7 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xa2426164df2c75de expref: -99 pid: 5783 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783441357.726069:0:5772:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.113@tcp lock: ffff91a85f83c400/0xa2426164df2c75d7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xa2426164df2c75de expref: -99 pid: 5783 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1783441357.726076:0:5772:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.113@tcp lock: ffff91a85f83c400/0xa2426164df2c75d7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xa2426164df2c75de expref: -99 pid: 5783 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1783441357.726082:0:5772:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:0.0:1783441357.726339:0:5772:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.113@tcp lock: ffff91a85f83c400/0xa2426164df2c75d7 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xa2426164df2c75de expref: -99 pid: 5783 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783441357.726357:0:5772:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1783441357.726388:0:5772:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.113@tcp lock: ffff91a85f83c400/0xa2426164df2c75d7 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xa2426164df2c75de expref: -99 pid: 5783 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783441357.726395:0:5772:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.113@tcp lock: ffff91a85f83c400/0xa2426164df2c75d7 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xa2426164df2c75de expref: -99 pid: 5783 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783441357.726411:0:5772:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783441357.726413:0:5772:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783441357.726414:0:5772:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1783441357.726616:0:3305:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff91a8756a5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:6c1ddb50-5795-40c6-a2b6-8f58add9da62:3305:1870073693226880:0@lo:103: 00000100:00100000:3.0:1783441357.726665:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783441357.727832:0:5769:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073693226880 00000100:00100000:2.0:1783441357.728336:0:5769:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073693226880 00010000:00010000:2.0:1783441357.728374:0:5769:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff91a85f83d800/0xa2426164df2c75de lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xa2426164df2c75d7 expref: 15 pid: 5778 timeout: 345 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783441357.728415:0:5769:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:2.0:1783441357.728424:0:5769:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a84545a050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:6c1ddb50-5795-40c6-a2b6-8f58add9da62+15:3305:x1870073693226880:12345-0@lo:103: 00010000:00010000:2.0:1783441357.728436:0:5769:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1783441357.728441:0:5769:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff91a85f83d800/0xa2426164df2c75de lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xa2426164df2c75d7 expref: 15 pid: 5778 timeout: 345 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783441357.728453:0:5769:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff91a85f83d800/0xa2426164df2c75de lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xa2426164df2c75d7 expref: 15 pid: 5778 timeout: 345 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783441357.728471:0:5769:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff91a85f83d800/0xa2426164df2c75de lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xa2426164df2c75d7 expref: 15 pid: 5778 timeout: 345 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783441357.728487:0:5769:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff91a841476000/0xa2426164df2c769b lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 5801 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783441357.728496:0:5769:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff91a841476000/0xa2426164df2c769b lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 5801 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:2.0:1783441357.729572:0:5769:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.011001960s 00010000:00010000:2.0:1783441357.729595:0:5769:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff91a841476000/0xa2426164df2c769b lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 5801 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783441357.729809:0:5769:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff91a841476000/0xa2426164df2c769b lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5801 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783441357.729815:0:5769:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff91a841476000/0xa2426164df2c769b lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5801 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783441357.729838:0:5769:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff91a841476000/0xa2426164df2c769b lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5801 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783441357.730181:0:5769:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91a841476000 already unused, calling callback (ffffffffc155ff90) 00010000:00010000:2.0:1783441357.730186:0:5769:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff91a841476000/0xa2426164df2c769b lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5801 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783441357.730196:0:5769:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff91a841476000/0xa2426164df2c769b lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 5801 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783441357.730220:0:5769:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff91a841476000/0xa2426164df2c769b lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5801 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783441357.730234:0:5769:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1783441357.730350:0:5801:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff91a841476000/0xa2426164df2c769b lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5801 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783441357.730358:0:5801:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff91a841476000/0xa2426164df2c769b lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5801 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783441357.730364:0:5801:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff91a841476000/0xa2426164df2c769b lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5801 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783441357.731016:0:5769:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a84545a050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:6c1ddb50-5795-40c6-a2b6-8f58add9da62+14:3305:x1870073693226880:12345-0@lo:103: Request processed in 2589us (4346us total) trans 0 rc 0/0 00000100:00100000:2.0:1783441357.731028:0:5769:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:3.0:1783441357.731673:0:3305:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff91a8756a5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:6c1ddb50-5795-40c6-a2b6-8f58add9da62:3305:1870073693226880:0@lo:103: 00000100:00100000:1.0:1783441357.743116:0:5780:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a848f73050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6c1ddb50-5795-40c6-a2b6-8f58add9da62+13:7474:x1870073693226496:12345-0@lo:253: Request processed in 85546us (86118us total) trans 0 rc 0/0 00000100:00100000:1.0:1783441357.743132:0:5780:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 85 00000100:00100000:3.0:1783441357.743440:0:7474:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff91a846f24700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6c1ddb50-5795-40c6-a2b6-8f58add9da62:7474:1870073693226496:0@lo:253: 10000000:01000000:3.0:1783441357.743456:0:7474:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0001 got index = 1 00000020:01000004:3.0:1783441357.743460:0:7474:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:3.0:1783441357.743461:0:7474:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:3.0:1783441357.743462:0:7474:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1783441357.743463:0:7474:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1783441357.743464:0:7474:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1783441357.743466:0:7474:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1783441357.743482:0:7474:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:3.0:1783441357.743484:0:7474:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:3.0:1783441357.743485:0:7474:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:3.0:1783441357.743487:0:7474:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1783441357.743488:0:7474:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:3.0:1783441357.743502:0:7474:0:(tgt_mount.c:2690:server_calc_timeout()) lustre-OST0001: Imperative Recovery not enabled, recovery window 60-180 00080000:10000000:3.0:1783441357.751556:0:7474:0:(osd_index.c:2102:osd_index_try()) lustre-OST0001: index object [0x200000003:0x5:0x0] (8/8/4) registered 00080000:10000000:3.0:1783441357.751792:0:7474:0:(osd_index.c:2102:osd_index_try()) lustre-OST0001: index object [0x200000005:0x1:0x0] (8/8/1) registered 00080000:10000000:3.0:1783441357.752043:0:7474:0:(osd_index.c:2102:osd_index_try()) lustre-OST0001: index object [0x200000003:0x6:0x0] (8/8/4) registered 00080000:10000000:3.0:1783441357.752229:0:7474:0:(osd_index.c:2102:osd_index_try()) lustre-OST0001: index object [0x200000005:0x2:0x0] (8/8/1) registered 00080000:10000000:3.0:1783441357.752422:0:7474:0:(osd_index.c:2102:osd_index_try()) lustre-OST0001: index object [0x200000003:0x7:0x0] (8/8/4) registered 00080000:10000000:3.0:1783441357.752672:0:7474:0:(osd_index.c:2102:osd_index_try()) lustre-OST0001: index object [0x200000005:0x3:0x0] (8/8/1) registered 00000001:00000004:2.0:1783441357.756709:0:7474:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 4294967296 00010000:00010000:2.0:1783441357.883687:0:5773:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00080000:0.0:1783441358.187091:0:7474:0:(ofd_obd.c:539:ofd_postrecov()) lustre-OST0001: recovery is over 00100000:10000000:0.0:1783441358.187098:0:7474:0:(lfsck_lib.c:3085:lfsck_start()) lustre-OST0001-osd: start master thread 00000020:01000004:0.0:1783441358.187145:0:7474:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:0.0:1783441358.187230:0:7474:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.201.113@tcp: cl_mgc_mutex unlock 00000020:01000004:0.0:1783441358.187245:0:7474:0:(tgt_mount.c:2459:server_fill_super_common()) Server sb, dev=49 00000080:00000004:0.0:1783441358.187273:0:7474:0:(super25.c:187:lustre_fill_super()) lustre-ost2/ost2: Mount complete 00010000:00010000:0.0:1783441358.893023:0:5772:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783441359.917417:0:5773:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1783441360.749159:0:3305:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1783441360.749238:0:3305:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff91a87d6a0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3305:1870073693227008:0@lo:13: 00000100:00100000:0.0:1783441360.749303:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783441360.755228:0:6585:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073693227008 00000100:00100000:1.0:1783441360.755241:0:6585:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073693227008 00000100:00100000:1.0:1783441360.755319:0:6585:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1783441360.755343:0:6585:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a8756a4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3305:x1870073693227008:12345-0@lo:13: 00002000:00000024:1.0:1783441360.755384:0:6585:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1783441360.755466:0:6585:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a8756a4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3305:x1870073693227008:12345-0@lo:13: Request processed in 126us (6162us total) trans 0 rc 0/0 00000100:00100000:1.0:1783441360.755473:0:6585:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00010000:00080000:1.0:1783441360.755529:0:3305:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff91a87d6a0a80 x1870073693227008/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1783441376 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00080000:3.0:1783441360.757720:0:5781:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1783441360.757840:0:3305:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff91a87d6a0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3305:1870073693227008:0@lo:13: 00010000:00010000:0.0:1783441360.945720:0:5772:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783441361.976849:0:5773:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1783441362.797106:0:3304:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff91a875693800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3304:1870073693227264:0@lo:400: 00000100:00100000:3.0:1783441362.797179:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783441362.797243:0:3304:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:3.0:1783441362.797249:0:3304:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff91a875691c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:6c1ddb50-5795-40c6-a2b6-8f58add9da62:3304:1870073693227136:0@lo:400: 00000100:00100000:3.0:1783441362.797278:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783441362.797300:0:3304:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff91a875690e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3304:1870073693227648:0@lo:400: 00000100:00100000:3.0:1783441362.797326:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783441362.797352:0:3305:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff91a875691f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3305:1870073693227392:0@lo:400: 00000100:00100000:3.0:1783441362.797373:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783441362.797389:0:3305:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1783441362.797394:0:3305:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff91a875690700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3305:1870073693227520:0@lo:400: 00000100:00100000:3.0:1783441362.797415:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783441362.797446:0:6605:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073693227264 00000100:00100000:3.0:1783441362.797454:0:6605:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073693227264 00000100:00100000:3.0:1783441362.797495:0:6605:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073693227648 00000100:00100000:3.0:1783441362.797509:0:6605:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073693227648 00000100:00100000:3.0:1783441362.797530:0:6605:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073693227392 00000100:00100000:3.0:1783441362.797542:0:6605:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073693227392 00000100:00100000:3.0:1783441362.797562:0:6605:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:3.0:1783441362.797696:0:6605:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a875693100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3304:x1870073693227264:12345-0@lo:400: 00000100:00100000:3.0:1783441362.797868:0:6605:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a875693100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3304:x1870073693227264:12345-0@lo:400: Request processed in 298us (689us total) trans 0 rc 0/0 00000100:00100000:3.0:1783441362.797876:0:6605:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:3.0:1783441362.797895:0:6605:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:3.0:1783441362.797902:0:6605:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a875693480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3304:x1870073693227648:12345-0@lo:400: 00000100:00100000:3.0:1783441362.797941:0:6605:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a875693480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3304:x1870073693227648:12345-0@lo:400: Request processed in 39us (613us total) trans 0 rc 0/0 00000100:00100000:3.0:1783441362.797947:0:6605:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:3.0:1783441362.797957:0:6605:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:3.0:1783441362.797962:0:6605:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a875692680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3305:x1870073693227392:12345-0@lo:400: 00000100:00100000:3.0:1783441362.797989:0:6605:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a875692680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3305:x1870073693227392:12345-0@lo:400: Request processed in 27us (615us total) trans 0 rc 0/0 00000100:00100000:3.0:1783441362.797993:0:6605:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:3.0:1783441362.798010:0:5779:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073693227136 00000100:00100000:3.0:1783441362.798013:0:5779:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073693227136 00000100:00100000:3.0:1783441362.798039:0:5779:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 86 00000100:00100000:3.0:1783441362.798044:0:5779:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a848f70050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6c1ddb50-5795-40c6-a2b6-8f58add9da62+13:3304:x1870073693227136:12345-0@lo:400: 00000100:00100000:3.0:1783441362.798067:0:5779:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a848f70050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6c1ddb50-5795-40c6-a2b6-8f58add9da62+13:3304:x1870073693227136:12345-0@lo:400: Request processed in 23us (789us total) trans 0 rc 0/0 00000100:00100000:3.0:1783441362.798073:0:5779:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 86 00000100:00100000:3.0:1783441362.798107:0:6581:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073693227520 00000100:00100000:3.0:1783441362.798110:0:6581:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073693227520 00000100:00100000:3.0:1783441362.798137:0:6581:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1783441362.798143:0:6581:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a875691180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3305:x1870073693227520:12345-0@lo:400: 00000100:00100000:3.0:1783441362.798188:0:6581:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a875691180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3305:x1870073693227520:12345-0@lo:400: Request processed in 46us (772us total) trans 0 rc 0/0 00000100:00100000:3.0:1783441362.798194:0:6581:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00080000:3.0:1783441362.798213:0:5781:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1783441362.798218:0:5781:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:3.0:1783441362.798246:0:3305:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff91a875690700 x1870073693227520/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1783441378 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1783441362.798260:0:3305:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff91a875690700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3305:1870073693227520:0@lo:400: 00010000:00080000:3.0:1783441362.798272:0:3305:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff91a875691f80 x1870073693227392/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1783441378 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1783441362.798280:0:3305:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff91a875691f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3305:1870073693227392:0@lo:400: 00010000:00080000:1.0:1783441362.807801:0:3304:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff91a875693800 x1870073693227264/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1783441378 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1783441362.807824:0:3304:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff91a875693800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3304:1870073693227264:0@lo:400: 00000100:00100000:1.0:1783441362.808099:0:3304:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff91a875691c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:6c1ddb50-5795-40c6-a2b6-8f58add9da62:3304:1870073693227136:0@lo:400: 00010000:00080000:1.0:1783441362.808111:0:3304:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff91a875690e00 x1870073693227648/t0(0) o400->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1783441378 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1783441362.808120:0:3304:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff91a875690e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3304:1870073693227648:0@lo:400: 00010000:00010000:0.0:1783441362.996732:0:5772:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783441364.017027:0:5773:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:2.0:1783441364.333761:0:5783:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:2.0:1783441364.333769:0:5783:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-client-ffff91a867cf2000 from 30 10000000:01000000:2.0:1783441364.333774:0:5783:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:2.0:1783441364.333820:0:5783:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.113@tcp lock: ffff91a85f83da00/0xa2426164df2c76a2 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5783 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783441364.333832:0:5783:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.113@tcp lock: ffff91a85f83da00/0xa2426164df2c76a2 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5783 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783441364.333853:0:5783:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.113@tcp lock: ffff91a85f83da00/0xa2426164df2c76a2 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5783 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783441364.333877:0:5783:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff91a846f25c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6c1ddb50-5795-40c6-a2b6-8f58add9da62:5783:1870073693227776:0@lo:101: 00000100:00100000:2.0:1783441364.333945:0:5783:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783441364.334602:0:5783:0:(client.c:2702:ptlrpc_set_wait()) set ffff91a747979c00 going to sleep for 11 seconds 00000100:00100000:1.0:1783441364.342141:0:5780:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073693227776 00000100:00100000:1.0:1783441364.342158:0:5780:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073693227776 00000100:00100000:1.0:1783441364.342236:0:5780:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 87 00000100:00100000:1.0:1783441364.342247:0:5780:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a848f70450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6c1ddb50-5795-40c6-a2b6-8f58add9da62+13:5783:x1870073693227776:12345-0@lo:101: 00010000:00010000:1.0:1783441364.342268:0:5780:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1783441364.342289:0:5780:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff91a841476000/0xa2426164df2c76a9 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0xa2426164df2c76a2 expref: -99 pid: 5780 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783441364.342322:0:5780:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff91a841476000/0xa2426164df2c76a9 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xa2426164df2c76a2 expref: 14 pid: 5780 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783441364.342350:0:5780:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff91a841476000/0xa2426164df2c76a9 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xa2426164df2c76a2 expref: 14 pid: 5780 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783441364.342359:0:5780:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91a841476000, rc 0) 00000100:00100000:1.0:1783441364.342445:0:5780:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a848f70450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6c1ddb50-5795-40c6-a2b6-8f58add9da62+14:5783:x1870073693227776:12345-0@lo:101: Request processed in 199us (8499us total) trans 0 rc 0/0 00000100:00100000:1.0:1783441364.342451:0:5780:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 87 00000100:00100000:1.0:1783441364.342539:0:5783:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff91a846f25c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6c1ddb50-5795-40c6-a2b6-8f58add9da62:5783:1870073693227776:0@lo:101: 00010000:00010000:1.0:1783441364.342556:0:5783:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.113@tcp lock: ffff91a85f83da00/0xa2426164df2c76a2 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xa2426164df2c76a9 expref: -99 pid: 5783 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783441364.342566:0:5783:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.113@tcp lock: ffff91a85f83da00/0xa2426164df2c76a2 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0xa2426164df2c76a9 expref: -99 pid: 5783 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783441364.342638:0:5783:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff91a87d6a0a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6c1ddb50-5795-40c6-a2b6-8f58add9da62:5783:1870073693227904:0@lo:501: 00000100:00100000:1.0:1783441364.342683:0:5783:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783441364.342713:0:5783:0:(client.c:2702:ptlrpc_set_wait()) set ffff91a84766e900 going to sleep for 11 seconds 00000100:00100000:1.0:1783441364.342727:0:5778:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073693227904 00000100:00100000:1.0:1783441364.342730:0:5778:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073693227904 00000100:00100000:1.0:1783441364.342773:0:5778:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 88 00000100:00100000:1.0:1783441364.342780:0:5778:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a848f73450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6c1ddb50-5795-40c6-a2b6-8f58add9da62+14:5783:x1870073693227904:12345-0@lo:501: 00000100:00100000:1.0:1783441364.343110:0:5778:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a848f73450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6c1ddb50-5795-40c6-a2b6-8f58add9da62+14:5783:x1870073693227904:12345-0@lo:501: Request processed in 329us (426us total) trans 0 rc 0/0 00000100:00100000:1.0:1783441364.343116:0:5778:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 88 00000100:00100000:1.0:1783441364.343146:0:5783:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff91a87d6a0a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6c1ddb50-5795-40c6-a2b6-8f58add9da62:5783:1870073693227904:0@lo:501: 00000100:00100000:1.0:1783441364.343171:0:5783:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff91a87d6a0a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6c1ddb50-5795-40c6-a2b6-8f58add9da62:5783:1870073693228032:0@lo:503: 00000100:00100000:1.0:1783441364.343214:0:5783:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783441364.343226:0:5783:0:(client.c:2702:ptlrpc_set_wait()) set ffff91a84766e900 going to sleep for 11 seconds 00000100:00100000:1.0:1783441364.343237:0:5778:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073693228032 00000100:00100000:1.0:1783441364.343240:0:5778:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073693228032 00000100:00100000:1.0:1783441364.343254:0:5778:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 89 00000100:00100000:1.0:1783441364.343260:0:5778:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a848f71c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6c1ddb50-5795-40c6-a2b6-8f58add9da62+14:5783:x1870073693228032:12345-0@lo:503: 00000100:00100000:1.0:1783441364.343524:0:5778:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a848f71c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6c1ddb50-5795-40c6-a2b6-8f58add9da62+14:5783:x1870073693228032:12345-0@lo:503: Request processed in 263us (309us total) trans 0 rc 0/0 00000100:00100000:1.0:1783441364.343531:0:5778:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 89 00000100:00100000:1.0:1783441364.343564:0:5783:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff91a87d6a0a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6c1ddb50-5795-40c6-a2b6-8f58add9da62:5783:1870073693228032:0@lo:503: 00000100:00100000:1.0:1783441364.343728:0:7777:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff91a87d6a0a80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:6c1ddb50-5795-40c6-a2b6-8f58add9da62:7777:1870073693228160:0@lo:502: 00000100:00100000:1.0:1783441364.343783:0:7777:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783441364.343800:0:5778:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073693228160 00000100:00100000:1.0:1783441364.343804:0:5778:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073693228160 00000100:00100000:1.0:1783441364.343824:0:5778:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 90 00000100:00100000:1.0:1783441364.343830:0:5778:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a848f71050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6c1ddb50-5795-40c6-a2b6-8f58add9da62+14:7777:x1870073693228160:12345-0@lo:502: 00000100:00100000:1.0:1783441364.344020:0:5778:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a848f71050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6c1ddb50-5795-40c6-a2b6-8f58add9da62+14:7777:x1870073693228160:12345-0@lo:502: Request processed in 190us (237us total) trans 0 rc 0/0 00000100:00100000:1.0:1783441364.344027:0:5778:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 90 00000100:00100000:1.0:1783441364.344056:0:7777:0:(client.c:2702:ptlrpc_set_wait()) set ffff91a84766e000 going to sleep for 11 seconds 00000100:00100000:1.0:1783441364.344067:0:7777:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff91a87d6a0a80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:6c1ddb50-5795-40c6-a2b6-8f58add9da62:7777:1870073693228160:0@lo:502: 00000100:00100000:1.0:1783441364.344104:0:7777:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff91a87d6a0a80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:6c1ddb50-5795-40c6-a2b6-8f58add9da62:7777:1870073693228288:0@lo:502: 00000100:00100000:1.0:1783441364.344133:0:7777:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783441364.344150:0:5778:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073693228288 00000100:00100000:1.0:1783441364.344153:0:5778:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073693228288 00000100:00100000:1.0:1783441364.344172:0:5778:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 91 00000100:00100000:1.0:1783441364.344182:0:5778:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a848f70c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6c1ddb50-5795-40c6-a2b6-8f58add9da62+14:7777:x1870073693228288:12345-0@lo:502: 00000100:00100000:1.0:1783441364.344280:0:5778:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a848f70c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6c1ddb50-5795-40c6-a2b6-8f58add9da62+14:7777:x1870073693228288:12345-0@lo:502: Request processed in 97us (145us total) trans 0 rc 0/0 00000100:00100000:1.0:1783441364.344286:0:5778:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 91 00000100:00100000:1.0:1783441364.344307:0:7777:0:(client.c:2702:ptlrpc_set_wait()) set ffff91a84766e000 going to sleep for 11 seconds 00000100:00100000:1.0:1783441364.344317:0:7777:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff91a87d6a0a80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:6c1ddb50-5795-40c6-a2b6-8f58add9da62:7777:1870073693228288:0@lo:502: 00000040:00080000:1.0:1783441364.344332:0:7777:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 39 count 39 00000020:01000000:1.0:1783441364.344390:0:5783:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 30-38 (rc=0) 10000000:01000000:1.0:1783441364.344406:0:5783:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.201.113@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:1.0:1783441364.344414:0:5783:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.113@tcp lock: ffff91a85f83da00/0xa2426164df2c76a2 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xa2426164df2c76a9 expref: -99 pid: 5783 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783441364.344425:0:5783:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.113@tcp lock: ffff91a85f83da00/0xa2426164df2c76a2 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xa2426164df2c76a9 expref: -99 pid: 5783 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1783441364.344435:0:5783:0:(mgc_request.c:611:do_requeue()) updating log lustre-OST0000 10000000:01000000:1.0:1783441364.344438:0:5783:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-OST0000-0000000000000000 from 8 10000000:01000000:1.0:1783441364.344441:0:5783:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0000 (res 0x65727473756c) 00010000:00010000:1.0:1783441364.344461:0:5783:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.113@tcp lock: ffff91a841476400/0xa2426164df2c76b0 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5783 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783441364.344469:0:5783:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.113@tcp lock: ffff91a841476400/0xa2426164df2c76b0 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5783 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783441364.344489:0:5783:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.113@tcp lock: ffff91a841476400/0xa2426164df2c76b0 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5783 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783441364.344499:0:5783:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff91a87d6a0a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6c1ddb50-5795-40c6-a2b6-8f58add9da62:5783:1870073693228416:0@lo:101: 00000100:00100000:1.0:1783441364.344521:0:5783:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783441364.344536:0:5783:0:(client.c:2702:ptlrpc_set_wait()) set ffff91a84766e000 going to sleep for 11 seconds 00000100:00100000:1.0:1783441364.344545:0:5778:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073693228416 00000100:00100000:1.0:1783441364.344548:0:5778:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073693228416 00000100:00100000:1.0:1783441364.344564:0:5778:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 92 00000100:00100000:1.0:1783441364.344569:0:5778:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a848f70850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6c1ddb50-5795-40c6-a2b6-8f58add9da62+14:5783:x1870073693228416:12345-0@lo:101: 00010000:00010000:1.0:1783441364.344575:0:5778:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1783441364.344585:0:5778:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff91a841477c00/0xa2426164df2c76b7 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0xa2426164df2c76b0 expref: -99 pid: 5778 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783441364.344602:0:5778:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff91a841477c00/0xa2426164df2c76b7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xa2426164df2c76b0 expref: 15 pid: 5778 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783441364.344610:0:5778:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff91a841477c00/0xa2426164df2c76b7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xa2426164df2c76b0 expref: 15 pid: 5778 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783441364.344618:0:5778:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91a841477c00, rc 0) 00000100:00100000:1.0:1783441364.344639:0:5778:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a848f70850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6c1ddb50-5795-40c6-a2b6-8f58add9da62+15:5783:x1870073693228416:12345-0@lo:101: Request processed in 70us (118us total) trans 0 rc 0/0 00000100:00100000:1.0:1783441364.344644:0:5778:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 92 00000100:00100000:1.0:1783441364.344666:0:5783:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff91a87d6a0a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6c1ddb50-5795-40c6-a2b6-8f58add9da62:5783:1870073693228416:0@lo:101: 00010000:00010000:1.0:1783441364.344676:0:5783:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.113@tcp lock: ffff91a841476400/0xa2426164df2c76b0 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xa2426164df2c76b7 expref: -99 pid: 5783 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783441364.344683:0:5783:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.113@tcp lock: ffff91a841476400/0xa2426164df2c76b0 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0xa2426164df2c76b7 expref: -99 pid: 5783 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783441364.344712:0:5783:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff91a87d6a0a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6c1ddb50-5795-40c6-a2b6-8f58add9da62:5783:1870073693228544:0@lo:501: 00000100:00100000:1.0:1783441364.344730:0:5783:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783441364.344759:0:5783:0:(client.c:2702:ptlrpc_set_wait()) set ffff91a84766e000 going to sleep for 11 seconds 00000100:00100000:1.0:1783441364.344772:0:5778:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073693228544 00000100:00100000:1.0:1783441364.344775:0:5778:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073693228544 00000100:00100000:1.0:1783441364.344791:0:5778:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 93 00000100:00100000:1.0:1783441364.344795:0:5778:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a848f72450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6c1ddb50-5795-40c6-a2b6-8f58add9da62+15:5783:x1870073693228544:12345-0@lo:501: 00000100:00100000:1.0:1783441364.344956:0:5778:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a848f72450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6c1ddb50-5795-40c6-a2b6-8f58add9da62+15:5783:x1870073693228544:12345-0@lo:501: Request processed in 159us (224us total) trans 0 rc 0/0 00000100:00100000:1.0:1783441364.344962:0:5778:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 93 00000100:00100000:1.0:1783441364.344988:0:5783:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff91a87d6a0a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6c1ddb50-5795-40c6-a2b6-8f58add9da62:5783:1870073693228544:0@lo:501: 00000100:00100000:1.0:1783441364.345007:0:5783:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff91a87d6a0a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6c1ddb50-5795-40c6-a2b6-8f58add9da62:5783:1870073693228672:0@lo:503: 00000100:00100000:1.0:1783441364.345036:0:5783:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783441364.345048:0:5783:0:(client.c:2702:ptlrpc_set_wait()) set ffff91a84766e000 going to sleep for 11 seconds 00000100:00100000:1.0:1783441364.345058:0:5778:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073693228672 00000100:00100000:1.0:1783441364.345061:0:5778:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073693228672 00000100:00100000:1.0:1783441364.345079:0:5778:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 94 00000100:00100000:1.0:1783441364.345085:0:5778:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a848f72c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6c1ddb50-5795-40c6-a2b6-8f58add9da62+15:5783:x1870073693228672:12345-0@lo:503: 00000100:00100000:1.0:1783441364.345316:0:5778:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a848f72c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6c1ddb50-5795-40c6-a2b6-8f58add9da62+15:5783:x1870073693228672:12345-0@lo:503: Request processed in 230us (279us total) trans 0 rc 0/0 00000100:00100000:1.0:1783441364.345321:0:5778:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 94 00000100:00100000:1.0:1783441364.345352:0:5783:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff91a87d6a0a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6c1ddb50-5795-40c6-a2b6-8f58add9da62:5783:1870073693228672:0@lo:503: 00000100:00100000:1.0:1783441364.357003:0:7778:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff91a87d6a0a80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:6c1ddb50-5795-40c6-a2b6-8f58add9da62:7778:1870073693228800:0@lo:502: 00000100:00100000:1.0:1783441364.357089:0:7778:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783441364.357137:0:7778:0:(client.c:2702:ptlrpc_set_wait()) set ffff91a867cff600 going to sleep for 11 seconds 00000100:00100000:0.0:1783441364.357186:0:5778:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073693228800 00000100:00100000:0.0:1783441364.357204:0:5778:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073693228800 00000100:00100000:0.0:1783441364.357252:0:5778:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 95 00000100:00100000:0.0:1783441364.357261:0:5778:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a848f73c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6c1ddb50-5795-40c6-a2b6-8f58add9da62+15:7778:x1870073693228800:12345-0@lo:502: 00000100:00100000:0.0:1783441364.357683:0:5778:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a848f73c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6c1ddb50-5795-40c6-a2b6-8f58add9da62+15:7778:x1870073693228800:12345-0@lo:502: Request processed in 422us (593us total) trans 0 rc 0/0 00000100:00100000:0.0:1783441364.357700:0:5778:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 95 00000100:00100000:3.0:1783441364.357936:0:7778:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff91a87d6a0a80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:6c1ddb50-5795-40c6-a2b6-8f58add9da62:7778:1870073693228800:0@lo:502: 00000020:01000000:3.0:1783441364.357966:0:7778:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1783441364.357974:0:7778:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1783441364.357976:0:7778:0:(obd_config.c:1561:class_process_config()) marker 20 (0x1) lustre sys.timeout 00000020:00000080:3.0:1783441364.357981:0:7778:0:(obd_config.c:1470:class_process_config()) processing cmd: cf009 00000020:00000080:3.0:1783441364.357984:0:7778:0:(obd_config.c:1535:class_process_config()) changing lustre timeout from 20 to 20 00000100:00100000:3.0:1783441364.358005:0:7778:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff91a875691f80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:6c1ddb50-5795-40c6-a2b6-8f58add9da62:7778:1870073693228928:0@lo:502: 00000100:00100000:3.0:1783441364.358039:0:7778:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783441364.358070:0:7778:0:(client.c:2702:ptlrpc_set_wait()) set ffff91a844b00cc0 going to sleep for 11 seconds 00000100:00100000:1.0:1783441364.358147:0:5780:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073693228928 00000100:00100000:1.0:1783441364.358152:0:5780:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073693228928 00000100:00100000:1.0:1783441364.358179:0:5780:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 96 00000100:00100000:1.0:1783441364.358185:0:5780:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a848f72050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6c1ddb50-5795-40c6-a2b6-8f58add9da62+15:7778:x1870073693228928:12345-0@lo:502: 00000100:00100000:1.0:1783441364.358319:0:5780:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a848f72050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6c1ddb50-5795-40c6-a2b6-8f58add9da62+15:7778:x1870073693228928:12345-0@lo:502: Request processed in 133us (278us total) trans 0 rc 0/0 00000100:00100000:1.0:1783441364.358325:0:5780:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 96 00000100:00100000:3.0:1783441364.358403:0:7778:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff91a875691f80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:6c1ddb50-5795-40c6-a2b6-8f58add9da62:7778:1870073693228928:0@lo:502: 00000020:01000000:3.0:1783441364.358422:0:7778:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1783441364.358426:0:7778:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1783441364.358427:0:7778:0:(obd_config.c:1561:class_process_config()) marker 20 (0x2) lustre sys.timeout 00000040:00080000:3.0:1783441364.358430:0:7778:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 11 count 11 00000020:01000000:1.0:1783441364.358663:0:5783:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0000 gen 8-10 (rc=0) 10000000:01000000:1.0:1783441364.358686:0:5783:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.201.113@tcp: configuration from log 'lustre-OST0000' succeeded (0). 00010000:00010000:1.0:1783441364.358696:0:5783:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.113@tcp lock: ffff91a841476400/0xa2426164df2c76b0 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xa2426164df2c76b7 expref: -99 pid: 5783 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783441364.358707:0:5783:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.113@tcp lock: ffff91a841476400/0xa2426164df2c76b0 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xa2426164df2c76b7 expref: -99 pid: 5783 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1783441364.358717:0:5783:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:1.0:1783441364.358719:0:5783:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-client-ffff91a84869e800 from 30 10000000:01000000:1.0:1783441364.358722:0:5783:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:1.0:1783441364.358772:0:5783:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.113@tcp lock: ffff91a841477200/0xa2426164df2c76be lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5783 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783441364.358782:0:5783:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.113@tcp lock: ffff91a841477200/0xa2426164df2c76be lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5783 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783441364.358791:0:5783:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.113@tcp lock: ffff91a841477200/0xa2426164df2c76be lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5783 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783441364.358803:0:5783:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff91a87d6a2a00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6c1ddb50-5795-40c6-a2b6-8f58add9da62:5783:1870073693229056:0@lo:101: 00000100:00100000:1.0:1783441364.358834:0:5783:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783441364.358853:0:5783:0:(client.c:2702:ptlrpc_set_wait()) set ffff91a867cff600 going to sleep for 11 seconds 00000100:00100000:3.0:1783441364.359105:0:5780:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073693229056 00000100:00100000:3.0:1783441364.359118:0:5780:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073693229056 00000100:00100000:3.0:1783441364.359154:0:5780:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 97 00000100:00100000:3.0:1783441364.359161:0:5780:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a848f73850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6c1ddb50-5795-40c6-a2b6-8f58add9da62+15:5783:x1870073693229056:12345-0@lo:101: 00010000:00010000:3.0:1783441364.359169:0:5780:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1783441364.359180:0:5780:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff91a85eb3d600/0xa2426164df2c76c5 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0xa2426164df2c76be expref: -99 pid: 5780 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783441364.359200:0:5780:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff91a85eb3d600/0xa2426164df2c76c5 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xa2426164df2c76be expref: 16 pid: 5780 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783441364.359209:0:5780:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff91a85eb3d600/0xa2426164df2c76c5 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xa2426164df2c76be expref: 16 pid: 5780 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783441364.359217:0:5780:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91a85eb3d600, rc 0) 00000100:00100000:3.0:1783441364.359248:0:5780:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a848f73850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6c1ddb50-5795-40c6-a2b6-8f58add9da62+16:5783:x1870073693229056:12345-0@lo:101: Request processed in 88us (413us total) trans 0 rc 0/0 00000100:00100000:3.0:1783441364.359254:0:5780:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 97 00000100:00100000:1.0:1783441364.359312:0:5783:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff91a87d6a2a00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6c1ddb50-5795-40c6-a2b6-8f58add9da62:5783:1870073693229056:0@lo:101: 00010000:00010000:1.0:1783441364.359325:0:5783:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.113@tcp lock: ffff91a841477200/0xa2426164df2c76be lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xa2426164df2c76c5 expref: -99 pid: 5783 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783441364.359343:0:5783:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.113@tcp lock: ffff91a841477200/0xa2426164df2c76be lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0xa2426164df2c76c5 expref: -99 pid: 5783 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783441364.359387:0:5783:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff91a87d6a2a00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6c1ddb50-5795-40c6-a2b6-8f58add9da62:5783:1870073693229184:0@lo:501: 00000100:00100000:1.0:1783441364.359412:0:5783:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783441364.359436:0:5783:0:(client.c:2702:ptlrpc_set_wait()) set ffff91a867cff600 going to sleep for 11 seconds 00000100:00100000:1.0:1783441364.359448:0:5778:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073693229184 00000100:00100000:1.0:1783441364.359451:0:5778:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073693229184 00000100:00100000:1.0:1783441364.359468:0:5778:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 98 00000100:00100000:1.0:1783441364.359483:0:5778:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a848f72850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6c1ddb50-5795-40c6-a2b6-8f58add9da62+16:5783:x1870073693229184:12345-0@lo:501: 00000100:00100000:1.0:1783441364.359859:0:5778:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a848f72850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6c1ddb50-5795-40c6-a2b6-8f58add9da62+16:5783:x1870073693229184:12345-0@lo:501: Request processed in 384us (444us total) trans 0 rc 0/0 00000100:00100000:1.0:1783441364.359867:0:5778:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 98 00000100:00100000:1.0:1783441364.359896:0:5783:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff91a87d6a2a00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6c1ddb50-5795-40c6-a2b6-8f58add9da62:5783:1870073693229184:0@lo:501: 00000100:00100000:1.0:1783441364.359920:0:5783:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff91a87d6a2a00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6c1ddb50-5795-40c6-a2b6-8f58add9da62:5783:1870073693229312:0@lo:503: 00000100:00100000:1.0:1783441364.359955:0:5783:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783441364.359968:0:5783:0:(client.c:2702:ptlrpc_set_wait()) set ffff91a867cff600 going to sleep for 11 seconds 00000100:00100000:1.0:1783441364.359979:0:5778:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073693229312 00000100:00100000:1.0:1783441364.359982:0:5778:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073693229312 00000100:00100000:1.0:1783441364.359998:0:5778:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 99 00000100:00100000:1.0:1783441364.360003:0:5778:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a848f71450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6c1ddb50-5795-40c6-a2b6-8f58add9da62+16:5783:x1870073693229312:12345-0@lo:503: 00000100:00100000:1.0:1783441364.360126:0:5778:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a848f71450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6c1ddb50-5795-40c6-a2b6-8f58add9da62+16:5783:x1870073693229312:12345-0@lo:503: Request processed in 121us (169us total) trans 0 rc 0/0 00000100:00100000:1.0:1783441364.360132:0:5778:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 99 00000100:00100000:1.0:1783441364.360163:0:5783:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff91a87d6a2a00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6c1ddb50-5795-40c6-a2b6-8f58add9da62:5783:1870073693229312:0@lo:503: 00000100:00100000:1.0:1783441364.360338:0:7780:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff91a87d6a2a00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:6c1ddb50-5795-40c6-a2b6-8f58add9da62:7780:1870073693229440:0@lo:502: 00000100:00100000:1.0:1783441364.360369:0:7780:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783441364.360387:0:5778:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073693229440 00000100:00100000:1.0:1783441364.360390:0:5778:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073693229440 00000100:00100000:1.0:1783441364.360406:0:5778:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 100 00000100:00100000:1.0:1783441364.360411:0:5778:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a848f34850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6c1ddb50-5795-40c6-a2b6-8f58add9da62+16:7780:x1870073693229440:12345-0@lo:502: 00000100:00100000:0.0:1783441364.361725:0:7780:0:(client.c:2702:ptlrpc_set_wait()) set ffff91a867cff600 going to sleep for 11 seconds 00000100:00100000:1.0:1783441364.363030:0:5778:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a848f34850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6c1ddb50-5795-40c6-a2b6-8f58add9da62+16:7780:x1870073693229440:12345-0@lo:502: Request processed in 2609us (2650us total) trans 0 rc 0/0 00000100:00100000:1.0:1783441364.363044:0:5778:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 100 00000100:00100000:0.0:1783441364.363189:0:7780:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff91a87d6a2a00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:6c1ddb50-5795-40c6-a2b6-8f58add9da62:7780:1870073693229440:0@lo:502: 00000100:00100000:0.0:1783441364.363263:0:7780:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff91a8756a5500 pname:cluuid:pid:xid:nid:opc:job llog_process_th:6c1ddb50-5795-40c6-a2b6-8f58add9da62:7780:1870073693229568:0@lo:502: 00000100:00100000:0.0:1783441364.363314:0:7780:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783441364.363350:0:7780:0:(client.c:2702:ptlrpc_set_wait()) set ffff91a84540ba80 going to sleep for 11 seconds 00000100:00100000:1.0:1783441364.363579:0:5779:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073693229568 00000100:00100000:1.0:1783441364.363586:0:5779:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073693229568 00000100:00100000:1.0:1783441364.364631:0:5779:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 101 00000100:00100000:1.0:1783441364.364645:0:5779:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a848f36450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6c1ddb50-5795-40c6-a2b6-8f58add9da62+16:7780:x1870073693229568:12345-0@lo:502: 00000100:00100000:1.0:1783441364.364919:0:5779:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a848f36450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6c1ddb50-5795-40c6-a2b6-8f58add9da62+16:7780:x1870073693229568:12345-0@lo:502: Request processed in 277us (1603us total) trans 0 rc 0/0 00000100:00100000:1.0:1783441364.364926:0:5779:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 101 00000100:00100000:0.0:1783441364.365119:0:7780:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff91a8756a5500 pname:cluuid:pid:xid:nid:opc:job llog_process_th:6c1ddb50-5795-40c6-a2b6-8f58add9da62:7780:1870073693229568:0@lo:502: 00000040:00080000:0.0:1783441364.365148:0:7780:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 39 count 39 00000020:01000000:0.0:1783441364.366693:0:5783:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 30-38 (rc=0) 10000000:01000000:0.0:1783441364.366733:0:5783:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.201.113@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:0.0:1783441364.366773:0:5783:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.113@tcp lock: ffff91a841477200/0xa2426164df2c76be lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xa2426164df2c76c5 expref: -99 pid: 5783 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783441364.366786:0:5783:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.113@tcp lock: ffff91a841477200/0xa2426164df2c76be lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xa2426164df2c76c5 expref: -99 pid: 5783 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1783441364.366796:0:5783:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:0.0:1783441364.366798:0:5783:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-mdtir-ffff91a84869e800 from 5 10000000:01000000:0.0:1783441364.366801:0:5783:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:0.0:1783441364.366837:0:5783:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.113@tcp lock: ffff91a840031400/0xa2426164df2c76cc lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5783 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783441364.366845:0:5783:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.113@tcp lock: ffff91a840031400/0xa2426164df2c76cc lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5783 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783441364.366855:0:5783:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.113@tcp lock: ffff91a840031400/0xa2426164df2c76cc lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5783 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783441364.366889:0:5783:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff91a8756a5500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6c1ddb50-5795-40c6-a2b6-8f58add9da62:5783:1870073693229696:0@lo:101: 00000100:00100000:0.0:1783441364.366948:0:5783:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783441364.379711:0:5783:0:(client.c:2702:ptlrpc_set_wait()) set ffff91a84540ba80 going to sleep for 11 seconds 00000100:00100000:3.0:1783441364.390865:0:5780:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073693229696 00000100:00100000:3.0:1783441364.390880:0:5780:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073693229696 00000100:00100000:3.0:1783441364.390967:0:5780:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 102 00000100:00100000:3.0:1783441364.390977:0:5780:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a848f36c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6c1ddb50-5795-40c6-a2b6-8f58add9da62+16:5783:x1870073693229696:12345-0@lo:101: 00010000:00010000:3.0:1783441364.390995:0:5780:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1783441364.391016:0:5780:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff91a85eb3c800/0xa2426164df2c76d3 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xa2426164df2c76cc expref: -99 pid: 5780 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783441364.391044:0:5780:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff91a85eb3c800/0xa2426164df2c76d3 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xa2426164df2c76cc expref: 17 pid: 5780 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783441364.391055:0:5780:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff91a85eb3c800/0xa2426164df2c76d3 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xa2426164df2c76cc expref: 17 pid: 5780 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783441364.391083:0:5780:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91a85eb3c800, rc 0) 00000100:00100000:3.0:1783441364.391164:0:5780:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a848f36c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6c1ddb50-5795-40c6-a2b6-8f58add9da62+17:5783:x1870073693229696:12345-0@lo:101: Request processed in 189us (24216us total) trans 0 rc 0/0 00000100:00100000:3.0:1783441364.391172:0:5780:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 102 00000100:00100000:2.0:1783441364.391806:0:5783:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff91a8756a5500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6c1ddb50-5795-40c6-a2b6-8f58add9da62:5783:1870073693229696:0@lo:101: 00010000:00010000:2.0:1783441364.391827:0:5783:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.113@tcp lock: ffff91a840031400/0xa2426164df2c76cc lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xa2426164df2c76d3 expref: -99 pid: 5783 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783441364.391837:0:5783:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.113@tcp lock: ffff91a840031400/0xa2426164df2c76cc lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xa2426164df2c76d3 expref: -99 pid: 5783 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783441364.391900:0:5783:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff91a846f27100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6c1ddb50-5795-40c6-a2b6-8f58add9da62:5783:1870073693229824:0@lo:256: 00000100:00100000:2.0:1783441364.391941:0:5783:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783441364.391976:0:5783:0:(client.c:2702:ptlrpc_set_wait()) set ffff91a747979e40 going to sleep for 11 seconds 00000100:00100000:2.0:1783441364.391992:0:5780:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073693229824 00000100:00100000:2.0:1783441364.391996:0:5780:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073693229824 00000100:00100000:2.0:1783441364.392018:0:5780:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 103 00000100:00100000:2.0:1783441364.392024:0:5780:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a848f37c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6c1ddb50-5795-40c6-a2b6-8f58add9da62+17:5783:x1870073693229824:12345-0@lo:256: 20000000:01000000:2.0:1783441364.392039:0:5780:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:2.0:1783441364.392054:0:5780:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:2.0:1783441364.392057:0:5780:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 5 00000100:00100000:2.0:1783441364.392134:0:5780:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a848f37c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6c1ddb50-5795-40c6-a2b6-8f58add9da62+17:5783:x1870073693229824:12345-0@lo:256: Request processed in 109us (192us total) trans 0 rc 0/0 00000100:00100000:2.0:1783441364.392142:0:5780:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 103 00000100:00100000:2.0:1783441364.392179:0:5783:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff91a846f27100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6c1ddb50-5795-40c6-a2b6-8f58add9da62:5783:1870073693229824:0@lo:256: 10000000:01000000:2.0:1783441364.392222:0:5783:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.201.113@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:2.0:1783441364.392229:0:5783:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.113@tcp lock: ffff91a840031400/0xa2426164df2c76cc lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xa2426164df2c76d3 expref: -99 pid: 5783 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783441364.392237:0:5783:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.113@tcp lock: ffff91a840031400/0xa2426164df2c76cc lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xa2426164df2c76d3 expref: -99 pid: 5783 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1783441364.392245:0:5783:0:(mgc_request.c:611:do_requeue()) updating log lustre-MDT0000 10000000:01000000:2.0:1783441364.392248:0:5783:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-MDT0000-0000000000000000 from 25 10000000:01000000:2.0:1783441364.392251:0:5783:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0000 (res 0x65727473756c) 00010000:00010000:2.0:1783441364.392272:0:5783:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.113@tcp lock: ffff91a85f83ca00/0xa2426164df2c76da lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5783 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783441364.392280:0:5783:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.113@tcp lock: ffff91a85f83ca00/0xa2426164df2c76da lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5783 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783441364.392288:0:5783:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.113@tcp lock: ffff91a85f83ca00/0xa2426164df2c76da lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5783 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783441364.392300:0:5783:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff91a846f27100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6c1ddb50-5795-40c6-a2b6-8f58add9da62:5783:1870073693229952:0@lo:101: 00000100:00100000:2.0:1783441364.392327:0:5783:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783441364.392340:0:5783:0:(client.c:2702:ptlrpc_set_wait()) set ffff91a747979e40 going to sleep for 11 seconds 00000100:00100000:2.0:1783441364.392351:0:5780:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073693229952 00000100:00100000:2.0:1783441364.392354:0:5780:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073693229952 00000100:00100000:2.0:1783441364.392370:0:5780:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 104 00000100:00100000:2.0:1783441364.392375:0:5780:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a848f36050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6c1ddb50-5795-40c6-a2b6-8f58add9da62+17:5783:x1870073693229952:12345-0@lo:101: 00010000:00010000:2.0:1783441364.392383:0:5780:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1783441364.392392:0:5780:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff91a85f83c200/0xa2426164df2c76e1 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0xa2426164df2c76da expref: -99 pid: 5780 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783441364.392412:0:5780:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff91a85f83c200/0xa2426164df2c76e1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xa2426164df2c76da expref: 18 pid: 5780 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783441364.392420:0:5780:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff91a85f83c200/0xa2426164df2c76e1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xa2426164df2c76da expref: 18 pid: 5780 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783441364.392427:0:5780:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91a85f83c200, rc 0) 00000100:00100000:2.0:1783441364.392452:0:5780:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a848f36050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6c1ddb50-5795-40c6-a2b6-8f58add9da62+18:5783:x1870073693229952:12345-0@lo:101: Request processed in 76us (125us total) trans 0 rc 0/0 00000100:00100000:2.0:1783441364.392458:0:5780:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 104 00000100:00100000:2.0:1783441364.392497:0:5783:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff91a846f27100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6c1ddb50-5795-40c6-a2b6-8f58add9da62:5783:1870073693229952:0@lo:101: 00010000:00010000:2.0:1783441364.392506:0:5783:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.113@tcp lock: ffff91a85f83ca00/0xa2426164df2c76da lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0xa2426164df2c76e1 expref: -99 pid: 5783 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783441364.392514:0:5783:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.113@tcp lock: ffff91a85f83ca00/0xa2426164df2c76da lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0xa2426164df2c76e1 expref: -99 pid: 5783 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783441364.392554:0:5783:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff91a846f27100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6c1ddb50-5795-40c6-a2b6-8f58add9da62:5783:1870073693230080:0@lo:501: 00000100:00100000:2.0:1783441364.392579:0:5783:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783441364.392592:0:5783:0:(client.c:2702:ptlrpc_set_wait()) set ffff91a747979e40 going to sleep for 11 seconds 00000100:00100000:2.0:1783441364.392606:0:5780:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073693230080 00000100:00100000:2.0:1783441364.392611:0:5780:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073693230080 00000100:00100000:2.0:1783441364.392628:0:5780:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 105 00000100:00100000:2.0:1783441364.392634:0:5780:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a848f37850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6c1ddb50-5795-40c6-a2b6-8f58add9da62+18:5783:x1870073693230080:12345-0@lo:501: 00000100:00100000:2.0:1783441364.392917:0:5780:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a848f37850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6c1ddb50-5795-40c6-a2b6-8f58add9da62+18:5783:x1870073693230080:12345-0@lo:501: Request processed in 283us (337us total) trans 0 rc 0/0 00000100:00100000:2.0:1783441364.392925:0:5780:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 105 00000100:00100000:2.0:1783441364.392959:0:5783:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff91a846f27100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6c1ddb50-5795-40c6-a2b6-8f58add9da62:5783:1870073693230080:0@lo:501: 00000100:00100000:2.0:1783441364.392983:0:5783:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff91a846f27100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6c1ddb50-5795-40c6-a2b6-8f58add9da62:5783:1870073693230208:0@lo:503: 00000100:00100000:2.0:1783441364.393017:0:5783:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783441364.393036:0:5783:0:(client.c:2702:ptlrpc_set_wait()) set ffff91a747979e40 going to sleep for 11 seconds 00000100:00100000:2.0:1783441364.393046:0:5780:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073693230208 00000100:00100000:2.0:1783441364.393050:0:5780:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073693230208 00000100:00100000:2.0:1783441364.393066:0:5780:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 106 00000100:00100000:2.0:1783441364.393072:0:5780:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a848f36850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6c1ddb50-5795-40c6-a2b6-8f58add9da62+18:5783:x1870073693230208:12345-0@lo:503: 00000100:00100000:2.0:1783441364.393343:0:5780:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a848f36850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6c1ddb50-5795-40c6-a2b6-8f58add9da62+18:5783:x1870073693230208:12345-0@lo:503: Request processed in 270us (324us total) trans 0 rc 0/0 00000100:00100000:2.0:1783441364.393349:0:5780:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 106 00000100:00100000:2.0:1783441364.393383:0:5783:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff91a846f27100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6c1ddb50-5795-40c6-a2b6-8f58add9da62:5783:1870073693230208:0@lo:503: 00000100:00100000:1.0:1783441364.397459:0:7785:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff91a87d6a1f80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:6c1ddb50-5795-40c6-a2b6-8f58add9da62:7785:1870073693230336:0@lo:502: 00000100:00100000:1.0:1783441364.397560:0:7785:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783441364.397603:0:7785:0:(client.c:2702:ptlrpc_set_wait()) set ffff91a8591db3c0 going to sleep for 11 seconds 00000100:00100000:2.0:1783441364.397654:0:5780:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073693230336 00000100:00100000:2.0:1783441364.397671:0:5780:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073693230336 00000100:00100000:2.0:1783441364.397716:0:5780:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 107 00000100:00100000:2.0:1783441364.397726:0:5780:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a848f35450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6c1ddb50-5795-40c6-a2b6-8f58add9da62+18:7785:x1870073693230336:12345-0@lo:502: 00000100:00100000:2.0:1783441364.398060:0:5780:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a848f35450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6c1ddb50-5795-40c6-a2b6-8f58add9da62+18:7785:x1870073693230336:12345-0@lo:502: Request processed in 334us (499us total) trans 0 rc 0/0 00000100:00100000:2.0:1783441364.398068:0:5780:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 107 00000100:00100000:1.0:1783441364.398582:0:7785:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff91a87d6a1f80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:6c1ddb50-5795-40c6-a2b6-8f58add9da62:7785:1870073693230336:0@lo:502: 00000020:01000000:1.0:1783441364.398617:0:7785:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:1.0:1783441364.398625:0:7785:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0001 (1) in 0 of lustre-mdt1/mdt1 00000020:00000080:1.0:1783441364.398632:0:7785:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1783441364.398635:0:7785:0:(obd_config.c:1561:class_process_config()) marker 18 (0x1) lustre-OST0001 add osc 00000020:00000080:1.0:1783441364.398640:0:7785:0:(obd_config.c:1470:class_process_config()) processing cmd: cf005 00000020:00000080:1.0:1783441364.398645:0:7785:0:(obd_config.c:1485:class_process_config()) adding mapping from uuid 192.168.201.113@tcp to nid 0x20000c0a8c971 (192.168.201.113@tcp) 00000020:01000000:1.0:1783441364.398677:0:7785:0:(obd_config.c:1975:class_config_llog_handler()) For 2.x interoperability, rename obd type from osc to osp (lustre-MDT0000) 00000020:00000080:1.0:1783441364.398688:0:7785:0:(obd_config.c:1470:class_process_config()) processing cmd: cf001 00000020:00000080:1.0:1783441364.398714:0:7785:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001-osc-MDT0000 (ffff91a74438b380) 00000020:00000080:1.0:1783441364.398757:0:7785:0:(obd_config.c:720:class_attach_name()) OBD: dev 17 attached type osp with refcount 2 00000020:00000080:1.0:1783441364.398764:0:7785:0:(obd_config.c:1470:class_process_config()) processing cmd: cf003 00000004:00080000:1.0:1783441364.398837:0:7785:0:(osp_dev.c:1203:osp_init0()) lustre-OST0001-osc-MDT0000: connect to lustre-MDT0000-osd (lustre-OST0001-osc-MDT0000) 00080000:01000000:1.0:1783441364.398843:0:7785:0:(osd_handler.c:1569:osd_obd_connect()) connect #6 00000020:00000080:1.0:1783441364.398854:0:7785:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0xa2426164df2c76ef 00010000:00080000:1.0:1783441364.398885:0:7785:0:(ldlm_lib.c:102:import_set_conn()) imp ffff91a8748ed000@lustre-OST0001-osc-MDT0000: add connection 192.168.201.113@tcp at head 00010000:00010000:1.0:1783441364.399129:0:7785:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-lustre-OST0001-osc-MDT0000-5 is initialized 00000040:01000000:1.0:1783441364.399427:0:7785:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=32, read=32 00000040:01000000:1.0:1783441364.399438:0:7785:0:(llog_obd.c:197:llog_setup()) obd lustre-OST0001-osc-MDT0000 ctxt 2 is initialized 00000040:00080000:1.0:1783441364.399947:0:7785:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1783441364.400138:0:7785:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1783441364.400185:0:7785:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x5:0x0].1, 64 off8256 00000040:00080000:1.0:1783441364.400242:0:7785:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].1, 64 off8256 00000040:00080000:3.0:1783441364.404023:0:7786:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:3.0:1783441364.404032:0:7786:0:(llog_cat.c:841:llog_cat_process_common()) processing log [0x1:0x6:0x0] at index 1 of catalog [0x1:0x5:0x0] 00000020:00000080:3.0:1783441364.412403:0:7785:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:3.0:1783441364.412419:0:7785:0:(obd_config.c:1470:class_process_config()) processing cmd: cf00d 00000004:01000000:3.0:1783441364.412460:0:7785:0:(lod_lov.c:128:lod_add_device()) osp:lustre-OST0001_UUID idx:1 gen:1 00000020:00000080:3.0:1783441364.412497:0:7785:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0xa2426164df2c76f6 00000100:00080000:3.0:1783441364.412508:0:7785:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:3.0:1783441364.412514:0:7785:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff91a8748ed000 using connection 192.168.201.113@tcp/0@lo 00000100:00100000:3.0:1783441364.412548:0:7785:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff91a875691f80 x1870073693230464/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1783441364.412576:0:7785:0:(pinger.c:374:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID 00000100:00100000:3.0:1783441364.412656:0:3305:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff91a875691880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3305:1870073693230720:0@lo:400: 00000100:00100000:3.0:1783441364.412719:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783441364.412784:0:3305:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1783441364.412790:0:3305:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff91a875693b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3305:1870073693230848:0@lo:400: 00000100:00100000:3.0:1783441364.412817:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783441364.412849:0:6605:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073693230720 00000100:00100000:3.0:1783441364.412855:0:6605:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073693230720 00000100:00100000:3.0:1783441364.412902:0:6605:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:3.0:1783441364.412911:0:6605:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a875691500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3305:x1870073693230720:12345-0@lo:400: 00000100:00100000:3.0:1783441364.412963:0:6605:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a875691500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3305:x1870073693230720:12345-0@lo:400: Request processed in 53us (243us total) trans 0 rc 0/0 00000100:00100000:3.0:1783441364.412982:0:6605:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00080000:3.0:1783441364.413001:0:5781:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:3.0:1783441364.413029:0:3305:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff91a875691880 x1870073693230720/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1783441380 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1783441364.413041:0:3305:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff91a875691880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3305:1870073693230720:0@lo:400: 00000020:01000000:3.0:1783441364.413088:0:7785:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1783441364.413093:0:7785:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1783441364.413095:0:7785:0:(obd_config.c:1561:class_process_config()) marker 18 (0x2) lustre-OST0001 add osc 00000020:01000000:3.0:1783441364.413098:0:7785:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1783441364.413102:0:7785:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1783441364.413103:0:7785:0:(obd_config.c:1561:class_process_config()) marker 22 (0x1) lustre sys.timeout 00000020:00000080:3.0:1783441364.413106:0:7785:0:(obd_config.c:1470:class_process_config()) processing cmd: cf009 00000020:00000080:3.0:1783441364.413107:0:7785:0:(obd_config.c:1535:class_process_config()) changing lustre timeout from 20 to 20 00000100:00100000:3.0:1783441364.413129:0:7785:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff91a875691880 pname:cluuid:pid:xid:nid:opc:job llog_process_th:6c1ddb50-5795-40c6-a2b6-8f58add9da62:7785:1870073693231104:0@lo:502: 00000100:00100000:3.0:1783441364.413174:0:7785:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783441364.413196:0:7785:0:(client.c:2702:ptlrpc_set_wait()) set ffff91a844b00900 going to sleep for 11 seconds 00000100:00100000:0.0:1783441364.413272:0:6582:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073693230848 00000100:00100000:0.0:1783441364.413276:0:6582:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073693230848 00000100:00100000:0.0:1783441364.413316:0:6582:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:0.0:1783441364.413324:0:6582:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a875690e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3305:x1870073693230848:12345-0@lo:400: 00000100:00100000:0.0:1783441364.413364:0:6582:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a875690e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3305:x1870073693230848:12345-0@lo:400: Request processed in 41us (545us total) trans 0 rc 0/0 00000100:00100000:0.0:1783441364.413370:0:6582:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00010000:00080000:0.0:1783441364.413397:0:3305:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff91a875693b80 x1870073693230848/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1783441380 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1783441364.413406:0:3305:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff91a875693b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3305:1870073693230848:0@lo:400: 00000100:00080000:3.0:1783441364.414970:0:5781:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1783441364.417640:0:3302:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff91a875691f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3302:1870073693230464:0@lo:8: 00000100:00100000:1.0:1783441364.417736:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783441364.417821:0:3304:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff91a875690700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3304:1870073693230592:0@lo:400: 00000100:00100000:1.0:1783441364.417851:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783441364.417872:0:3304:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1783441364.417879:0:3304:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff91a875690000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3304:1870073693230976:0@lo:400: 00000100:00100000:1.0:1783441364.417901:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783441364.417934:0:6583:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073693230464 00000100:00100000:1.0:1783441364.417942:0:6583:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073693230464 00000100:00100000:1.0:1783441364.417980:0:6583:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:1.0:1783441364.417987:0:6583:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a87d6a1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0+-99:3302:x1870073693230464:12345-0@lo:8: 00010000:00080000:1.0:1783441364.418030:0:6583:0:(ldlm_lib.c:1432:target_handle_connect()) lustre-OST0001: connection from lustre-MDT0000-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 202 last 0 00000020:00000080:1.0:1783441364.418058:0:6583:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0xa2426164df2c76fd 00002000:00100000:1.0:1783441364.418071:0:6583:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli lustre-MDT0000-mdtlov_UUID/ffff91a8748ec800 ocd_connect_flags: 0xa044401443000026 ocd_version: 2113669 ocd_grant: 0 ocd_index: 1 ocd_group 0 00002000:00080000:1.0:1783441364.418081:0:6583:0:(ofd_obd.c:139:ofd_parse_connect_data()) lustre-OST0001: Received MDS connection for group 0 00000001:00000004:1.0:1783441364.418085:0:6583:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 4294967296 00002000:00100000:1.0:1783441364.418204:0:6583:0:(ofd_obd.c:227:ofd_parse_connect_data()) lustre-OST0001: cli does not support OBD_CONNECT_CKSUM 00002000:00080000:1.0:1783441364.418350:0:6583:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:1.0:1783441364.418374:0:6583:0:(import.c:65:import_set_state_nolock()) ffff91a8748ed800 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1783441364.418423:0:6583:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a87d6a1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:3302:x1870073693230464:12345-0@lo:8: Request processed in 434us (687us total) trans 0 rc 0/0 00000100:00100000:1.0:1783441364.418430:0:6583:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:1.0:1783441364.418455:0:5786:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073693230592 00000100:00100000:1.0:1783441364.418459:0:5786:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073693230592 00000100:00100000:1.0:1783441364.418497:0:5786:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073693230976 00000100:00100000:1.0:1783441364.418500:0:5786:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073693230976 00000100:00100000:1.0:1783441364.418528:0:5786:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:1.0:1783441364.418534:0:5786:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a87d6a0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3304:x1870073693230592:12345-0@lo:400: 00000100:00100000:1.0:1783441364.418570:0:5786:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a87d6a0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3304:x1870073693230592:12345-0@lo:400: Request processed in 36us (718us total) trans 0 rc 0/0 00000100:00100000:1.0:1783441364.418576:0:5786:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:1.0:1783441364.418589:0:5786:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:1.0:1783441364.418595:0:5786:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a87d6a1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3304:x1870073693230976:12345-0@lo:400: 00000100:00100000:1.0:1783441364.418620:0:5786:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a87d6a1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3304:x1870073693230976:12345-0@lo:400: Request processed in 26us (719us total) trans 0 rc 0/0 00000100:00100000:1.0:1783441364.418626:0:5786:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00010000:00080000:1.0:1783441364.418660:0:3302:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff91a875691f80 x1870073693230464/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/416 e 0 to 0 dl 1783441374 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1783441364.418669:0:3302:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:1.0:1783441364.418677:0:3302:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-OST0001-osc-MDT0000: connect to target with instance 1 00000100:00080000:1.0:1783441364.418685:0:3302:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-OST0001-osc-MDT0000: Resetting ns_connect_flags to server flags: 0xa040401443000026 00000100:00080000:1.0:1783441364.418696:0:3302:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-OST0001_UUID 00000100:00080000:1.0:1783441364.418698:0:3302:0:(import.c:65:import_set_state_nolock()) ffff91a8748ed000 lustre-OST0001_UUID: changing import state from CONNECTING to FULL 00000004:00080000:1.0:1783441364.418709:0:3302:0:(osp_dev.c:1648:osp_import_event()) got connected 00000100:00100000:1.0:1783441364.418713:0:3302:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff91a875691f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3302:1870073693230464:0@lo:8: 00000100:00080000:1.0:1783441364.418737:0:5781:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:1.0:1783441364.418779:0:3304:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff91a875690000 x1870073693230976/t0(0) o400->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1783441380 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1783441364.418788:0:3304:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff91a875690000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3304:1870073693230976:0@lo:400: 00010000:00080000:1.0:1783441364.418797:0:3304:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff91a875690700 x1870073693230592/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1783441380 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1783441364.418804:0:3304:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff91a875690700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3304:1870073693230592:0@lo:400: 00000004:00080000:1.0:1783441364.418824:0:7786:0:(osp_sync.c:1045:osp_sync_process_record()) processed all old entries 00000004:00080000:1.0:1783441364.418926:0:7786:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 202293183656ns, next at 0ns, rc = 0 00000100:00100000:2.0:1783441364.421066:0:5780:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073693231104 00000100:00100000:2.0:1783441364.421078:0:5780:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073693231104 00000100:00100000:2.0:1783441364.421124:0:5780:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 108 00000100:00100000:2.0:1783441364.421133:0:5780:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a848f35850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6c1ddb50-5795-40c6-a2b6-8f58add9da62+18:7785:x1870073693231104:12345-0@lo:502: 00000100:00100000:2.0:1783441364.424509:0:5780:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a848f35850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6c1ddb50-5795-40c6-a2b6-8f58add9da62+18:7785:x1870073693231104:12345-0@lo:502: Request processed in 3369us (11325us total) trans 0 rc 0/0 00000100:00100000:2.0:1783441364.424522:0:5780:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 108 00000100:00100000:0.0:1783441364.427682:0:7785:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff91a875691880 pname:cluuid:pid:xid:nid:opc:job llog_process_th:6c1ddb50-5795-40c6-a2b6-8f58add9da62:7785:1870073693231104:0@lo:502: 00000020:01000000:0.0:1783441364.427729:0:7785:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1783441364.427736:0:7785:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1783441364.427754:0:7785:0:(obd_config.c:1561:class_process_config()) marker 22 (0x2) lustre sys.timeout 00000040:00080000:0.0:1783441364.427760:0:7785:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 34 count 34 00000020:01000000:2.0:1783441364.431010:0:5783:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0000 gen 25-33 (rc=0) 10000000:01000000:2.0:1783441364.431046:0:5783:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.201.113@tcp: configuration from log 'lustre-MDT0000' succeeded (0). 00010000:00010000:2.0:1783441364.431058:0:5783:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.113@tcp lock: ffff91a85f83ca00/0xa2426164df2c76da lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0xa2426164df2c76e1 expref: -99 pid: 5783 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783441364.431071:0:5783:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.113@tcp lock: ffff91a85f83ca00/0xa2426164df2c76da lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0xa2426164df2c76e1 expref: -99 pid: 5783 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1783441364.431080:0:5783:0:(mgc_request.c:611:do_requeue()) updating log lustre-sptlrpc 10000000:01000000:2.0:1783441364.431083:0:5783:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-sptlrpc-ffff91a84767cd40 from 1 10000000:01000000:2.0:1783441364.431086:0:5783:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:2.0:1783441364.431128:0:5783:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.113@tcp lock: ffff91a85f83c600/0xa2426164df2c7704 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5783 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783441364.431136:0:5783:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.113@tcp lock: ffff91a85f83c600/0xa2426164df2c7704 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5783 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783441364.431147:0:5783:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.113@tcp lock: ffff91a85f83c600/0xa2426164df2c7704 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5783 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783441364.431169:0:5783:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff91a846f27100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6c1ddb50-5795-40c6-a2b6-8f58add9da62:5783:1870073693231232:0@lo:101: 00000100:00100000:2.0:1783441364.431231:0:5783:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783441364.431267:0:5783:0:(client.c:2702:ptlrpc_set_wait()) set ffff91a865507840 going to sleep for 11 seconds 00000100:00100000:0.0:1783441364.434194:0:5778:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073693231232 00000100:00100000:0.0:1783441364.434207:0:5778:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073693231232 00000100:00100000:0.0:1783441364.434262:0:5778:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 109 00000100:00100000:0.0:1783441364.434273:0:5778:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a848f37050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6c1ddb50-5795-40c6-a2b6-8f58add9da62+18:5783:x1870073693231232:12345-0@lo:101: 00010000:00010000:0.0:1783441364.434291:0:5778:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1783441364.434308:0:5778:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff91a840031000/0xa2426164df2c770b lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: local remote: 0xa2426164df2c7704 expref: -99 pid: 5778 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783441364.434345:0:5778:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff91a840031000/0xa2426164df2c770b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xa2426164df2c7704 expref: 19 pid: 5778 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783441364.434355:0:5778:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff91a840031000/0xa2426164df2c770b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xa2426164df2c7704 expref: 19 pid: 5778 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783441364.434364:0:5778:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91a840031000, rc 0) 00000100:00100000:0.0:1783441364.434436:0:5778:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a848f37050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6c1ddb50-5795-40c6-a2b6-8f58add9da62+19:5783:x1870073693231232:12345-0@lo:101: Request processed in 164us (3205us total) trans 0 rc 0/0 00000100:00100000:0.0:1783441364.434443:0:5778:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 109 00000100:00100000:0.0:1783441364.434506:0:5783:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff91a846f27100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6c1ddb50-5795-40c6-a2b6-8f58add9da62:5783:1870073693231232:0@lo:101: 00010000:00010000:0.0:1783441364.434525:0:5783:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.113@tcp lock: ffff91a85f83c600/0xa2426164df2c7704 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0xa2426164df2c770b expref: -99 pid: 5783 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783441364.434533:0:5783:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.113@tcp lock: ffff91a85f83c600/0xa2426164df2c7704 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0xa2426164df2c770b expref: -99 pid: 5783 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783441364.434599:0:5783:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff91a8756a6a00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6c1ddb50-5795-40c6-a2b6-8f58add9da62:5783:1870073693231360:0@lo:501: 00000100:00100000:0.0:1783441364.434632:0:5783:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783441364.434659:0:5783:0:(client.c:2702:ptlrpc_set_wait()) set ffff91a84540b3c0 going to sleep for 11 seconds 00000100:00100000:0.0:1783441364.434672:0:5779:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073693231360 00000100:00100000:0.0:1783441364.434675:0:5779:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073693231360 00000100:00100000:0.0:1783441364.434697:0:5779:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 110 00000100:00100000:0.0:1783441364.434703:0:5779:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a848f34050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6c1ddb50-5795-40c6-a2b6-8f58add9da62+19:5783:x1870073693231360:12345-0@lo:501: 00000100:00100000:0.0:1783441364.434955:0:5779:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a848f34050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6c1ddb50-5795-40c6-a2b6-8f58add9da62+19:5783:x1870073693231360:12345-0@lo:501: Request processed in 252us (322us total) trans 0 rc -2/-2 00000100:00100000:0.0:1783441364.434963:0:5779:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 110 00000100:00100000:0.0:1783441364.434997:0:5783:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff91a8756a6a00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6c1ddb50-5795-40c6-a2b6-8f58add9da62:5783:1870073693231360:0@lo:501: 10000000:01000000:0.0:1783441364.435027:0:5783:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.201.113@tcp: configuration from log 'lustre-sptlrpc' failed (-2). 00010000:00010000:0.0:1783441364.435033:0:5783:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.113@tcp lock: ffff91a85f83c600/0xa2426164df2c7704 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0xa2426164df2c770b expref: -99 pid: 5783 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783441364.435041:0:5783:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.113@tcp lock: ffff91a85f83c600/0xa2426164df2c7704 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0xa2426164df2c770b expref: -99 pid: 5783 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:2.0:1783441364.489017:0:5807:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1 committed 00000004:00080000:1.0:1783441364.541725:0:7787:0:(osp_precreate.c:882:osp_precreate_cleanup_orphans()) lustre-OST0001-osc-MDT0000: going to cleanup orphans since [0x100010000:0x1:0x0] 00000100:00100000:1.0:1783441364.541771:0:7787:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff91a87d6a2a00 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:7787:1870073693231616:0@lo:7: 00000100:00100000:1.0:1783441364.541834:0:7787:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783441364.541876:0:7787:0:(client.c:2702:ptlrpc_set_wait()) set ffff91a86f38bd80 going to sleep for 11 seconds 00000100:00100000:1.0:1783441364.541909:0:3304:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff91a87d6a3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3304:1870073693231488:0@lo:13: 00000100:00100000:1.0:1783441364.541933:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783441364.541973:0:6581:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073693231616 00000100:00100000:1.0:1783441364.541980:0:6581:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073693231616 00000100:00100000:1.0:1783441364.542030:0:6581:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:1.0:1783441364.542039:0:6581:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a87d6a0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:7787:x1870073693231616:12345-0@lo:7: 00000100:00100000:0.0:1783441364.549938:0:6585:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073693231488 00000100:00100000:0.0:1783441364.549953:0:6585:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073693231488 00000100:00100000:0.0:1783441364.550073:0:6585:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:0.0:1783441364.550084:0:6585:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a87d6a3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3304:x1870073693231488:12345-0@lo:13: 00002000:00000024:0.0:1783441364.550118:0:6585:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40960000 pending 0 free 3860856832 avail 3858759680 00000100:00100000:0.0:1783441364.550200:0:6585:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a87d6a3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3304:x1870073693231488:12345-0@lo:13: Request processed in 118us (8264us total) trans 0 rc 0/0 00000100:00100000:0.0:1783441364.550207:0:6585:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00002000:00080000:1.0:1783441364.552951:0:6581:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0001: adding sequence 0x0 00002000:00080000:1.0:1783441364.552962:0:6581:0:(ofd_dev.c:1208:ofd_get_info_hdl()) lustre-OST0001: LAST FID is [0x100010000:0x0:0x0] 00000100:00100000:1.0:1783441364.553066:0:6581:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a87d6a0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:7787:x1870073693231616:12345-0@lo:7: Request processed in 11022us (11225us total) trans 0 rc 0/0 00000100:00100000:1.0:1783441364.553083:0:6581:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00080000:1.0:1783441364.553126:0:5781:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00080000:1.0:1783441364.553176:0:3304:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff91a87d6a3100 x1870073693231488/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1783441380 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1783441364.553199:0:3304:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff91a87d6a3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3304:1870073693231488:0@lo:13: 00010000:00080000:1.0:1783441364.553256:0:7787:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff91a87d6a2a00 x1870073693231616/t0(0) o7->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 264/240 e 0 to 0 dl 1783441380 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1783441364.553266:0:7787:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff91a87d6a2a00 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:7787:1870073693231616:0@lo:7: 00000004:00080000:1.0:1783441364.553276:0:7787:0:(osp_precreate.c:810:osp_get_lastfid_from_ost()) lustre-OST0001-osc-MDT0000: Got last_fid [0x100010000:0x0:0x0] 00000100:00100000:1.0:1783441364.553314:0:7787:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff91a87d6a2a00 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:7787:1870073693231744:0@lo:5: 00000100:00100000:1.0:1783441364.553346:0:7787:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783441364.553380:0:7787:0:(client.c:2702:ptlrpc_set_wait()) set ffff91a86f38bd80 going to sleep for 11 seconds 00000100:00100000:1.0:1783441364.553397:0:6582:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073693231744 00000100:00100000:1.0:1783441364.553403:0:6582:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073693231744 00000100:00100000:1.0:1783441364.553436:0:6582:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:1.0:1783441364.553445:0:6582:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a87d6a3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:7787:x1870073693231744:12345-0@lo:5: 00002000:00080000:1.0:1783441364.557477:0:6582:0:(ofd_dev.c:1640:ofd_create_hdl()) ofd_last_id() = 0 -> diff = 1 00002000:00080000:1.0:1783441364.557487:0:6582:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0001: reserve 1 objects in group 0x0 at 1 00000100:00100000:1.0:1783441364.557899:0:6582:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a87d6a3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+7:7787:x1870073693231744:12345-0@lo:5: Request processed in 4450us (4547us total) trans 4294967297 rc 0/0 00000100:00100000:1.0:1783441364.557909:0:6582:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00010000:00080000:0.0:1783441364.558027:0:7787:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff91a87d6a2a00 x1870073693231744/t0(0) o5->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 432/432 e 0 to 0 dl 1783441380 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1783441364.558045:0:7787:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff91a87d6a2a00 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:7787:1870073693231744:0@lo:5: 00000004:00080000:0.0:1783441364.558058:0:7787:0:(osp_precreate.c:960:osp_precreate_cleanup_orphans()) lustre-OST0001-osc-MDT0000: Got last_id [0x100010000:0x1:0x0] from OST, last_created [0x100010000:0x1:0x0]last_used is [0x100010000:0x1:0x0] 00000100:00100000:0.0:1783441364.558094:0:7787:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff91a8756a6a00 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:7787:1870073693231872:0@lo:700: 00000100:00100000:0.0:1783441364.558129:0:7787:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783441364.558168:0:7787:0:(client.c:2702:ptlrpc_set_wait()) set ffff91a8431f7840 going to sleep for 11 seconds 00000100:00100000:1.0:1783441364.560185:0:6589:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073693231872 00000100:00100000:1.0:1783441364.560203:0:6589:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073693231872 00000100:00100000:1.0:1783441364.560277:0:6589:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1783441364.560289:0:6589:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a8756a4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-mdtlov_UUID+7:7787:x1870073693231872:12345-0@lo:700: 00000100:00100000:1.0:1783441364.560347:0:6589:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff91a87d6a1180 pname:cluuid:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-lwp-OST0001_UUID:6589:1870073693232000:0@lo:700: 00000100:00100000:1.0:1783441364.560497:0:6589:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783441364.560532:0:6589:0:(client.c:2702:ptlrpc_set_wait()) set ffff91a86f38b780 going to sleep for 11 seconds 00000100:00100000:1.0:1783441364.560552:0:5792:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073693232000 00000100:00100000:1.0:1783441364.560555:0:5792:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073693232000 00000100:00100000:1.0:1783441364.560582:0:5792:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1783441364.560588:0:5792:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a87d6a2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqs_0000:lustre-MDT0000-lwp-OST0001_UUID+5:6589:x1870073693232000:12345-0@lo:700: 40000000:02000000:1.0:1783441364.612503:0:5792:0:(fid_handler.c:119:__seq_server_alloc_super()) ctl-lustre-MDT0000: super-sequence allocation rc = 0 [0x0000000280000400-0x00000002c0000400]:1:ost 00000100:00100000:1.0:1783441364.617652:0:5792:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a87d6a2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqs_0000:lustre-MDT0000-lwp-OST0001_UUID+5:6589:x1870073693232000:12345-0@lo:700: Request processed in 57055us (57146us total) trans 0 rc 0/0 00000100:00100000:1.0:1783441364.617667:0:5792:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:3.0:1783441364.620092:0:6589:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff91a87d6a1180 x1870073693232000/t0(0) o700->lustre-MDT0000-lwp-OST0001@0@lo:32/10 lens 264/248 e 0 to 0 dl 1783441380 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1783441364.620110:0:6589:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff91a87d6a1180 pname:cluuid:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-lwp-OST0001_UUID:6589:1870073693232000:0@lo:700: 40000000:02000000:3.0:1783441364.620123:0:6589:0:(fid_request.c:122:seq_client_rpc()) cli-lustre-OST0001-super: Allocated super-sequence [0x0000000280000400-0x00000002c0000400]:1:ost] 00000100:00100000:3.0:1783441364.702944:0:6589:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a8756a4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-mdtlov_UUID+7:7787:x1870073693231872:12345-0@lo:700: Request processed in 142646us (144803us total) trans 0 rc 0/0 00000100:00100000:3.0:1783441364.702985:0:6589:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000001:00080000:3.0:1783441364.703022:0:7492:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967297 is committed 00000001:00100000:3.0:1783441364.703034:0:7492:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00010000:00080000:1.0:1783441364.703825:0:7787:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff91a8756a6a00 x1870073693231872/t0(0) o700->lustre-OST0001-osc-MDT0000@0@lo:31/4 lens 264/248 e 0 to 0 dl 1783441380 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1783441364.703842:0:7787:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff91a8756a6a00 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:7787:1870073693231872:0@lo:700: 00000004:02000040:1.0:1783441364.743902:0:7787:0:(osp_precreate.c:485:osp_precreate_rollover_new_seq()) lustre-OST0001-osc-MDT0000: update sequence from 0x100010000 to 0x280000400 00000100:00100000:0.0:1783441364.749124:0:7787:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff91a8756a6d80 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:7787:1870073693232128:0@lo:5: 00000100:00100000:0.0:1783441364.749190:0:7787:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783441364.749272:0:7787:0:(client.c:2702:ptlrpc_set_wait()) set ffff91a843df43c0 going to sleep for 11 seconds 00000100:00100000:1.0:1783441364.749319:0:6583:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073693232128 00000100:00100000:1.0:1783441364.749327:0:6583:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073693232128 00000100:00100000:1.0:1783441364.749517:0:6583:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:1.0:1783441364.749526:0:6583:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a8756a7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:7787:x1870073693232128:12345-0@lo:5: 00002000:00080000:1.0:1783441364.756834:0:6583:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0001: adding sequence 0x280000400 00002000:00080000:1.0:1783441364.756854:0:6583:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0001: reserve 32 objects in group 0x280000400 at 2 00000100:00100000:0.0:1783441364.763138:0:6583:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a8756a7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:7787:x1870073693232128:12345-0@lo:5: Request processed in 13606us (13941us total) trans 4294967298 rc 0/0 00000100:00100000:0.0:1783441364.763151:0:6583:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00010000:00080000:1.0:1783441364.763234:0:7787:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff91a8756a6d80 x1870073693232128/t0(0) o5->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 432/432 e 0 to 0 dl 1783441380 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1783441364.763249:0:7787:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967297 gen 2 00000100:00100000:1.0:1783441364.763269:0:7787:0:(client.c:3156:ptlrpc_free_committed()) @@@ stopping search req@ffff91a8756a6d80 x1870073693232128/t4294967298(4294967298) o5->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 432/432 e 0 to 0 dl 1783441380 ref 3 fl Rpc:RQU/204/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1783441364.763281:0:7787:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff91a8756a6d80 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:7787:1870073693232128:0@lo:5: 00000004:00080000:1.0:1783441364.763307:0:7787:0:(osp_precreate.c:705:osp_precreate_send()) lustre-OST0001-osc-MDT0000: current precreated pool: [0x280000400:0x1:0x0]-[0x280000400:0x21:0x0] 00000001:02000400:0.0:1783441364.946507:0:7840:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg113-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00010000:00010000:1.0:1783441365.041901:0:5772:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1783441365.870130:0:3306:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1783441365.870162:0:3306:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff91a875691c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3306:1870073693232256:0@lo:13: 00000100:00100000:1.0:1783441365.870234:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783441365.870335:0:6584:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073693232256 00000100:00100000:3.0:1783441365.870349:0:6584:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073693232256 00000100:00100000:3.0:1783441365.870412:0:6584:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:3.0:1783441365.870421:0:6584:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a87d6a2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3306:x1870073693232256:12345-0@lo:13: 00002000:00000024:3.0:1783441365.870469:0:6584:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1783441365.870526:0:6584:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a87d6a2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3306:x1870073693232256:12345-0@lo:13: Request processed in 105us (292us total) trans 0 rc 0/0 00000100:00100000:3.0:1783441365.870532:0:6584:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00010000:00080000:3.0:1783441365.870571:0:3306:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff91a875691c00 x1870073693232256/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1783441381 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1783441365.870588:0:3306:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff91a875691c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3306:1870073693232256:0@lo:13: 00010000:00010000:2.0:1783441366.064001:0:5773:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783441367.085220:0:5772:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783441368.108999:0:5773:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783441369.132974:0:5772:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1783441369.453212:0:3306:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff91a875691c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:6c1ddb50-5795-40c6-a2b6-8f58add9da62:3306:1870073693232384:0@lo:400: 00000100:00100000:1.0:1783441369.453287:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783441369.453575:0:3305:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff91a875690700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3305:1870073693232768:0@lo:400: 00000100:00100000:2.0:1783441369.453609:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783441369.453683:0:5779:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073693232384 00000100:00100000:0.0:1783441369.453693:0:5779:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073693232384 00000100:00100000:0.0:1783441369.453765:0:5779:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 111 00000100:00100000:0.0:1783441369.453773:0:5779:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a848f34450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6c1ddb50-5795-40c6-a2b6-8f58add9da62+19:3306:x1870073693232384:12345-0@lo:400: 00000100:00100000:2.0:1783441369.457689:0:3305:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1783441369.457715:0:3305:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff91a875690000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3305:1870073693232896:0@lo:400: 00000100:00100000:2.0:1783441369.457804:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783441369.458104:0:5786:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073693232896 00000100:00100000:3.0:1783441369.458114:0:5786:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073693232896 00000100:00100000:3.0:1783441369.458184:0:5786:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:3.0:1783441369.458195:0:5786:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a846f25c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3305:x1870073693232896:12345-0@lo:400: 00000100:00100000:3.0:1783441369.458258:0:5786:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a846f25c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3305:x1870073693232896:12345-0@lo:400: Request processed in 64us (453us total) trans 0 rc 0/0 00000100:00100000:3.0:1783441369.458266:0:5786:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00010000:00080000:3.0:1783441369.458310:0:3305:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff91a875690000 x1870073693232896/t0(0) o400->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1783441385 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1783441369.458337:0:3305:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff91a875690000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3305:1870073693232896:0@lo:400: 00000100:00080000:2.0:1783441369.458930:0:5781:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1783441369.459540:0:5779:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a848f34450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6c1ddb50-5795-40c6-a2b6-8f58add9da62+19:3306:x1870073693232384:12345-0@lo:400: Request processed in 5761us (6246us total) trans 0 rc 0/0 00000100:00100000:0.0:1783441369.459553:0:5779:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 111 00000100:00100000:0.0:1783441369.459637:0:3304:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff91a875691880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3304:1870073693232640:0@lo:400: 00000100:00100000:0.0:1783441369.459684:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783441369.459780:0:3304:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:0.0:1783441369.459788:0:3304:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff91a875693800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3304:1870073693232512:0@lo:400: 00000100:00100000:0.0:1783441369.459810:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783441369.459857:0:3306:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff91a875691c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:6c1ddb50-5795-40c6-a2b6-8f58add9da62:3306:1870073693232384:0@lo:400: 00000100:00100000:1.0:1783441369.459895:0:6582:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073693232768 00000100:00100000:1.0:1783441369.459901:0:6582:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073693232768 00000100:00100000:1.0:1783441369.459965:0:6582:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:1.0:1783441369.459976:0:6582:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a846f27100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3305:x1870073693232768:12345-0@lo:400: 00000100:00100000:1.0:1783441369.460027:0:6582:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a846f27100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3305:x1870073693232768:12345-0@lo:400: Request processed in 54us (6417us total) trans 0 rc 0/0 00000100:00100000:1.0:1783441369.460034:0:6582:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00010000:00080000:1.0:1783441369.460065:0:3305:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff91a875690700 x1870073693232768/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1783441385 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1783441369.460077:0:3305:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff91a875690700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3305:1870073693232768:0@lo:400: 00000100:00080000:2.0:1783441369.460307:0:5781:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1783441369.460660:0:3304:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff91a875691f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3304:1870073693233024:0@lo:400: 00000100:00100000:0.0:1783441369.460690:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783441369.460875:0:6583:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073693233024 00000100:00100000:2.0:1783441369.460890:0:6583:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073693233024 00000100:00100000:2.0:1783441369.460938:0:6583:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:2.0:1783441369.460945:0:6583:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a8756a5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:3304:x1870073693233024:12345-0@lo:400: 00000100:00100000:2.0:1783441369.460998:0:6583:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a8756a5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:3304:x1870073693233024:12345-0@lo:400: Request processed in 54us (307us total) trans 0 rc 0/0 00000100:00100000:2.0:1783441369.461004:0:6583:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00080000:0.0:1783441369.461153:0:5781:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00080000:0.0:1783441369.461176:0:3304:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff91a875691f80 x1870073693233024/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1783441385 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1783441369.461188:0:3304:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff91a875691f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3304:1870073693233024:0@lo:400: 00000100:00100000:3.0:1783441369.461238:0:6605:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073693232640 00000100:00100000:3.0:1783441369.461242:0:6605:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073693232640 00000100:00100000:3.0:1783441369.461329:0:6605:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073693232512 00000100:00100000:3.0:1783441369.461333:0:6605:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073693232512 00000100:00100000:3.0:1783441369.461354:0:6605:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:3.0:1783441369.461362:0:6605:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a8756a5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3304:x1870073693232640:12345-0@lo:400: 00000100:00100000:3.0:1783441369.461422:0:6605:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a8756a5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3304:x1870073693232640:12345-0@lo:400: Request processed in 61us (1737us total) trans 0 rc 0/0 00000100:00100000:3.0:1783441369.461443:0:6605:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00100000:3.0:1783441369.461457:0:6605:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:3.0:1783441369.461463:0:6605:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a8756a4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3304:x1870073693232512:12345-0@lo:400: 00000100:00100000:3.0:1783441369.461492:0:6605:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a8756a4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3304:x1870073693232512:12345-0@lo:400: Request processed in 30us (1681us total) trans 0 rc 0/0 00000100:00100000:3.0:1783441369.461499:0:6605:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00010000:00080000:3.0:1783441369.461527:0:3304:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff91a875693800 x1870073693232512/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1783441385 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1783441369.461537:0:3304:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff91a875693800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3304:1870073693232512:0@lo:400: 00010000:00080000:3.0:1783441369.461548:0:3304:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff91a875691880 x1870073693232640/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1783441385 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1783441369.461556:0:3304:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff91a875691880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3304:1870073693232640:0@lo:400: 00000100:00080000:0.0:1783441369.461811:0:5781:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1783441369.981087:0:3303:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1783441369.981114:0:3303:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff91a87d6a3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3303:1870073693233152:0@lo:13: 00000100:00100000:1.0:1783441369.981188:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783441369.996463:0:6584:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073693233152 00000100:00100000:3.0:1783441369.996480:0:6584:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073693233152 00000100:00100000:3.0:1783441369.996544:0:6584:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:3.0:1783441369.996554:0:6584:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a87d6a0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3303:x1870073693233152:12345-0@lo:13: 00002000:00000024:3.0:1783441369.996590:0:6584:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1783441369.997966:0:6584:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a87d6a0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3303:x1870073693233152:12345-0@lo:13: Request processed in 1407us (16771us total) trans 0 rc 0/0 00000100:00100000:3.0:1783441369.997979:0:6584:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00010000:00080000:3.0:1783441369.998045:0:3303:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff91a87d6a3800 x1870073693233152/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1783441385 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1783441369.998084:0:3303:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff91a87d6a3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3303:1870073693233152:0@lo:13: 00000001:00080000:2.0:1783441370.074429:0:7492:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967298 is committed 00010000:00010000:0.0:1783441370.158357:0:5773:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1783441370.755582:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.13@tcp (source: 12345-192.168.201.13@tcp) 00000100:00100000:2.0:1783441370.755674:0:5778:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073673285760 00000100:00100000:2.0:1783441370.755685:0:5778:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073673285760 00000100:00100000:2.0:1783441370.755738:0:5778:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.13@tcp, seq: 112 00000100:00100000:2.0:1783441370.755780:0:5778:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a848f37450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0+-99:2351:x1870073673285760:12345-192.168.201.13@tcp:250: 00010000:00080000:2.0:1783441370.755812:0:5778:0:(ldlm_lib.c:1432:target_handle_connect()) MGS: connection from 51c2a82e-e792-4f56-84e8-12cc033e9e70@192.168.201.13@tcp t0 exp 0000000000000000 cur 208 last 0 00000020:00000080:2.0:1783441370.755841:0:5778:0:(genops.c:1406:class_connect()) connect: client 51c2a82e-e792-4f56-84e8-12cc033e9e70, cookie 0xa2426164df2c7712 00000100:00080000:2.0:1783441370.755993:0:5778:0:(import.c:65:import_set_state_nolock()) ffff91a744385000 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1783441370.756066:0:5778:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a848f37450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:51c2a82e-e792-4f56-84e8-12cc033e9e70+5:2351:x1870073673285760:12345-192.168.201.13@tcp:250: Request processed in 285us (494us total) trans 0 rc 0/0 00000100:00100000:2.0:1783441370.756074:0:5778:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.13@tcp, seq: 112 00000100:00100000:3.0:1783441370.763242:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.13@tcp (source: 12345-192.168.201.13@tcp) 00000100:00100000:0.0:1783441370.763528:0:5779:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073673285888 00000100:00100000:0.0:1783441370.763543:0:5779:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073673285888 00000100:00100000:0.0:1783441370.763600:0:5779:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.13@tcp, seq: 113 00000100:00100000:0.0:1783441370.763610:0:5779:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a848f35c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:51c2a82e-e792-4f56-84e8-12cc033e9e70+5:5557:x1870073673285888:12345-192.168.201.13@tcp:101: 00010000:00010000:0.0:1783441370.763627:0:5779:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1783441370.763646:0:5779:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff91a840031800/0xa2426164df2c7719 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: local remote: 0x633a354aa4df4c32 expref: -99 pid: 5779 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783441370.763673:0:5779:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff91a840031800/0xa2426164df2c7719 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50000000000000 nid: 192.168.201.13@tcp remote: 0x633a354aa4df4c32 expref: 6 pid: 5779 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783441370.763685:0:5779:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff91a840031800/0xa2426164df2c7719 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: 192.168.201.13@tcp remote: 0x633a354aa4df4c32 expref: 6 pid: 5779 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783441370.763695:0:5779:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91a840031800, rc 0) 00000100:00100000:0.0:1783441370.763776:0:5779:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a848f35c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:51c2a82e-e792-4f56-84e8-12cc033e9e70+6:5557:x1870073673285888:12345-192.168.201.13@tcp:101: Request processed in 167us (545us total) trans 0 rc 0/0 00000100:00100000:0.0:1783441370.763783:0:5779:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.13@tcp, seq: 113 00000100:00100000:2.0:1783441370.767634:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.13@tcp (source: 12345-192.168.201.13@tcp) 00000100:00100000:3.0:1783441370.767821:0:5780:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073673286016 00000100:00100000:3.0:1783441370.767833:0:5780:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073673286016 00000100:00100000:3.0:1783441370.767900:0:5780:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.13@tcp, seq: 114 00000100:00100000:3.0:1783441370.767910:0:5780:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a848f35050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:51c2a82e-e792-4f56-84e8-12cc033e9e70+6:5557:x1870073673286016:12345-192.168.201.13@tcp:501: 00000100:00100000:3.0:1783441370.768333:0:5780:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a848f35050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:51c2a82e-e792-4f56-84e8-12cc033e9e70+6:5557:x1870073673286016:12345-192.168.201.13@tcp:501: Request processed in 423us (708us total) trans 0 rc -2/-2 00000100:00100000:3.0:1783441370.768342:0:5780:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.13@tcp, seq: 114 00000100:00100000:1.0:1783441370.772266:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.13@tcp (source: 12345-192.168.201.13@tcp) 00000100:00100000:2.0:1783441370.772409:0:5778:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073673286144 00000100:00100000:2.0:1783441370.772420:0:5778:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073673286144 00000100:00100000:2.0:1783441370.772476:0:5778:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.13@tcp, seq: 115 00000100:00100000:2.0:1783441370.772485:0:5778:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a848f34c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:51c2a82e-e792-4f56-84e8-12cc033e9e70+6:5557:x1870073673286144:12345-192.168.201.13@tcp:101: 00010000:00010000:2.0:1783441370.772503:0:5778:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1783441370.772523:0:5778:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff91a85f83cc00/0xa2426164df2c7720 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: local remote: 0x633a354aa4df4c39 expref: -99 pid: 5778 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783441370.772576:0:5778:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff91a85f83cc00/0xa2426164df2c7720 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x50000000000000 nid: 192.168.201.13@tcp remote: 0x633a354aa4df4c39 expref: 7 pid: 5778 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783441370.772588:0:5778:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff91a85f83cc00/0xa2426164df2c7720 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: 192.168.201.13@tcp remote: 0x633a354aa4df4c39 expref: 7 pid: 5778 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783441370.772598:0:5778:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91a85f83cc00, rc 0) 00000100:00100000:2.0:1783441370.772656:0:5778:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a848f34c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:51c2a82e-e792-4f56-84e8-12cc033e9e70+7:5557:x1870073673286144:12345-192.168.201.13@tcp:101: Request processed in 171us (400us total) trans 0 rc 0/0 00000100:00100000:2.0:1783441370.772663:0:5778:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.13@tcp, seq: 115 00000100:00100000:0.0:1783441370.775556:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.13@tcp (source: 12345-192.168.201.13@tcp) 00000100:00100000:3.0:1783441370.775636:0:5779:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073673286272 00000100:00100000:3.0:1783441370.775646:0:5779:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073673286272 00000100:00100000:3.0:1783441370.775738:0:5779:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.13@tcp, seq: 116 00000100:00100000:3.0:1783441370.775767:0:5779:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a8655e5450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:51c2a82e-e792-4f56-84e8-12cc033e9e70+7:5557:x1870073673286272:12345-192.168.201.13@tcp:501: 00000100:00100000:3.0:1783441370.776207:0:5779:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a8655e5450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:51c2a82e-e792-4f56-84e8-12cc033e9e70+8:5557:x1870073673286272:12345-192.168.201.13@tcp:501: Request processed in 440us (660us total) trans 0 rc 0/0 00000100:00100000:3.0:1783441370.776216:0:5779:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.13@tcp, seq: 116 00000100:00100000:2.0:1783441370.779730:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.13@tcp (source: 12345-192.168.201.13@tcp) 00000100:00100000:3.0:1783441370.779861:0:5780:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073673286400 00000100:00100000:3.0:1783441370.779871:0:5780:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073673286400 00000100:00100000:3.0:1783441370.779997:0:5780:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.13@tcp, seq: 117 00000100:00100000:3.0:1783441370.780008:0:5780:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a8655e5850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:51c2a82e-e792-4f56-84e8-12cc033e9e70+8:5557:x1870073673286400:12345-192.168.201.13@tcp:503: 00000100:00100000:3.0:1783441370.780579:0:5780:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a8655e5850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:51c2a82e-e792-4f56-84e8-12cc033e9e70+8:5557:x1870073673286400:12345-192.168.201.13@tcp:503: Request processed in 569us (855us total) trans 0 rc 0/0 00000100:00100000:3.0:1783441370.780590:0:5780:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.13@tcp, seq: 117 00000100:00100000:3.0:1783441370.786395:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.13@tcp (source: 12345-192.168.201.13@tcp) 00000100:00100000:2.0:1783441370.795127:0:5779:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073673286528 00000100:00100000:2.0:1783441370.795144:0:5779:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073673286528 00000100:00100000:2.0:1783441370.795220:0:5779:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.13@tcp, seq: 118 00000100:00100000:2.0:1783441370.795230:0:5779:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a8655e7050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:51c2a82e-e792-4f56-84e8-12cc033e9e70+8:5575:x1870073673286528:12345-192.168.201.13@tcp:502: 00000100:00100000:2.0:1783441370.796653:0:5779:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a8655e7050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:51c2a82e-e792-4f56-84e8-12cc033e9e70+8:5575:x1870073673286528:12345-192.168.201.13@tcp:502: Request processed in 1416us (10276us total) trans 0 rc 0/0 00000100:00100000:2.0:1783441370.796666:0:5779:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.13@tcp, seq: 118 00000100:00100000:1.0:1783441370.827685:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.13@tcp (source: 12345-192.168.201.13@tcp) 00000100:00100000:3.0:1783441370.827890:0:5778:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073673286656 00000100:00100000:3.0:1783441370.827903:0:5778:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073673286656 00000100:00100000:3.0:1783441370.827984:0:5778:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.13@tcp, seq: 119 00000100:00100000:3.0:1783441370.827995:0:5778:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a8655e4050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:51c2a82e-e792-4f56-84e8-12cc033e9e70+8:5575:x1870073673286656:12345-192.168.201.13@tcp:502: 00000100:00100000:3.0:1783441370.828703:0:5778:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a8655e4050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:51c2a82e-e792-4f56-84e8-12cc033e9e70+8:5575:x1870073673286656:12345-192.168.201.13@tcp:502: Request processed in 706us (1027us total) trans 0 rc 0/0 00000100:00100000:3.0:1783441370.828713:0:5778:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.13@tcp, seq: 119 00000100:00100000:1.0:1783441370.839439:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.13@tcp (source: 12345-192.168.201.13@tcp) 00000100:00100000:1.0:1783441370.839483:0:5779:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073673286784 00000100:00100000:1.0:1783441370.839492:0:5779:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073673286784 00000100:00100000:1.0:1783441370.839552:0:5780:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.13@tcp, seq: 120 00000100:00100000:1.0:1783441370.839563:0:5780:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a8655e4450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:51c2a82e-e792-4f56-84e8-12cc033e9e70+8:5557:x1870073673286784:12345-192.168.201.13@tcp:101: 00010000:00010000:1.0:1783441370.839581:0:5780:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1783441370.839598:0:5780:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff91a87da46a00/0xa2426164df2c7727 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x633a354aa4df4c63 expref: -99 pid: 5780 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783441370.839626:0:5780:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff91a87da46a00/0xa2426164df2c7727 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 192.168.201.13@tcp remote: 0x633a354aa4df4c63 expref: 9 pid: 5780 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783441370.839637:0:5780:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff91a87da46a00/0xa2426164df2c7727 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 192.168.201.13@tcp remote: 0x633a354aa4df4c63 expref: 9 pid: 5780 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783441370.839647:0:5780:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91a87da46a00, rc 0) 00000100:00100000:1.0:1783441370.839703:0:5780:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a8655e4450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:51c2a82e-e792-4f56-84e8-12cc033e9e70+9:5557:x1870073673286784:12345-192.168.201.13@tcp:101: Request processed in 142us (278us total) trans 0 rc 0/0 00000100:00100000:1.0:1783441370.839711:0:5780:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.13@tcp, seq: 120 00000100:00100000:3.0:1783441370.848403:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.13@tcp (source: 12345-192.168.201.13@tcp) 00000100:00100000:3.0:1783441370.848439:0:5778:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073673286912 00000100:00100000:3.0:1783441370.848449:0:5778:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073673286912 00000100:00100000:3.0:1783441370.848495:0:5778:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.13@tcp, seq: 121 00000100:00100000:3.0:1783441370.848505:0:5778:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a8655e7450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:51c2a82e-e792-4f56-84e8-12cc033e9e70+9:5557:x1870073673286912:12345-192.168.201.13@tcp:256: 20000000:01000000:3.0:1783441370.848529:0:5778:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-cliir bufsize 1048576. 20000000:01000000:3.0:1783441370.848547:0:5778:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/256/255. 20000000:01000000:3.0:1783441370.848551:0:5778:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4008/1/256/255. 20000000:01000000:3.0:1783441370.848554:0:5778:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3964/1/256/255. 20000000:01000000:3.0:1783441370.848556:0:5778:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 132, version 5 00000100:00100000:3.0:1783441370.852180:0:5778:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a8655e7450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:51c2a82e-e792-4f56-84e8-12cc033e9e70+9:5557:x1870073673286912:12345-192.168.201.13@tcp:256: Request processed in 3663us (3774us total) trans 0 rc 0/0 00000100:00100000:3.0:1783441370.852195:0:5778:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.13@tcp, seq: 121 00000100:00100000:2.0:1783441370.860812:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.13@tcp (source: 12345-192.168.201.13@tcp) 00000100:00100000:0.0:1783441370.860898:0:5779:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073673287040 00000100:00100000:0.0:1783441370.860908:0:5779:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073673287040 00000100:00100000:0.0:1783441370.861029:0:5779:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.13@tcp, seq: 122 00000100:00100000:0.0:1783441370.861039:0:5779:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a8655e5c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:51c2a82e-e792-4f56-84e8-12cc033e9e70+9:5557:x1870073673287040:12345-192.168.201.13@tcp:101: 00010000:00010000:0.0:1783441370.861067:0:5779:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1783441370.861086:0:5779:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff91a840030200/0xa2426164df2c772e lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x633a354aa4df4c6a expref: -99 pid: 5779 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783441370.861238:0:5779:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff91a840030200/0xa2426164df2c772e lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 192.168.201.13@tcp remote: 0x633a354aa4df4c6a expref: 10 pid: 5779 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783441370.861265:0:5779:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff91a840030200/0xa2426164df2c772e lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 192.168.201.13@tcp remote: 0x633a354aa4df4c6a expref: 10 pid: 5779 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783441370.861276:0:5779:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91a840030200, rc 0) 00000100:00100000:0.0:1783441370.861415:0:5779:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a8655e5c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:51c2a82e-e792-4f56-84e8-12cc033e9e70+10:5557:x1870073673287040:12345-192.168.201.13@tcp:101: Request processed in 377us (614us total) trans 0 rc 0/0 00000100:00100000:0.0:1783441370.861421:0:5779:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.13@tcp, seq: 122 00000100:00100000:2.0:1783441370.876497:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.13@tcp (source: 12345-192.168.201.13@tcp) 00000100:00100000:3.0:1783441370.876580:0:5778:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073673287168 00000100:00100000:3.0:1783441370.876589:0:5778:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073673287168 00000100:00100000:3.0:1783441370.876647:0:5778:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.13@tcp, seq: 123 00000100:00100000:3.0:1783441370.876657:0:5778:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a8655e5050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:51c2a82e-e792-4f56-84e8-12cc033e9e70+10:5557:x1870073673287168:12345-192.168.201.13@tcp:501: 00000100:00100000:3.0:1783441370.877651:0:5778:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a8655e5050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:51c2a82e-e792-4f56-84e8-12cc033e9e70+10:5557:x1870073673287168:12345-192.168.201.13@tcp:501: Request processed in 990us (1158us total) trans 0 rc 0/0 00000100:00100000:3.0:1783441370.877662:0:5778:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.13@tcp, seq: 123 00000100:00100000:2.0:1783441370.883805:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.13@tcp (source: 12345-192.168.201.13@tcp) 00000100:00100000:3.0:1783441370.883891:0:5780:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073673287296 00000100:00100000:3.0:1783441370.883901:0:5780:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073673287296 00000100:00100000:3.0:1783441370.883970:0:5780:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.13@tcp, seq: 124 00000100:00100000:3.0:1783441370.883982:0:5780:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a8655e4c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:51c2a82e-e792-4f56-84e8-12cc033e9e70+10:5557:x1870073673287296:12345-192.168.201.13@tcp:503: 00000100:00100000:3.0:1783441370.884701:0:5780:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a8655e4c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:51c2a82e-e792-4f56-84e8-12cc033e9e70+10:5557:x1870073673287296:12345-192.168.201.13@tcp:503: Request processed in 718us (905us total) trans 0 rc 0/0 00000100:00100000:3.0:1783441370.884711:0:5780:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.13@tcp, seq: 124 00000100:00100000:3.0:1783441370.891878:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.13@tcp (source: 12345-192.168.201.13@tcp) 00000100:00100000:2.0:1783441370.892711:0:5778:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073673287424 00000100:00100000:2.0:1783441370.892726:0:5778:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073673287424 00000100:00100000:2.0:1783441370.893642:0:5778:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.13@tcp, seq: 125 00000100:00100000:2.0:1783441370.893653:0:5778:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a8655e4850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:51c2a82e-e792-4f56-84e8-12cc033e9e70+10:5579:x1870073673287424:12345-192.168.201.13@tcp:502: 00000100:00100000:2.0:1783441370.894027:0:5778:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a8655e4850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:51c2a82e-e792-4f56-84e8-12cc033e9e70+10:5579:x1870073673287424:12345-192.168.201.13@tcp:502: Request processed in 375us (2158us total) trans 0 rc 0/0 00000100:00100000:2.0:1783441370.894053:0:5778:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.13@tcp, seq: 125 00000100:00100000:2.0:1783441370.903640:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.13@tcp (source: 12345-192.168.201.13@tcp) 00000100:00100000:3.0:1783441370.903773:0:5780:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073673287552 00000100:00100000:3.0:1783441370.903784:0:5780:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073673287552 00000100:00100000:3.0:1783441370.903840:0:5780:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.13@tcp, seq: 126 00000100:00100000:3.0:1783441370.903850:0:5780:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a8655e6450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:51c2a82e-e792-4f56-84e8-12cc033e9e70+10:5579:x1870073673287552:12345-192.168.201.13@tcp:502: 00000100:00100000:3.0:1783441370.904460:0:5780:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a8655e6450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:51c2a82e-e792-4f56-84e8-12cc033e9e70+10:5579:x1870073673287552:12345-192.168.201.13@tcp:502: Request processed in 608us (830us total) trans 0 rc 0/0 00000100:00100000:3.0:1783441370.904471:0:5780:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.13@tcp, seq: 126 00000100:00100000:3.0:1783441370.907857:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.13@tcp (source: 12345-192.168.201.13@tcp) 00000100:00100000:2.0:1783441370.908612:0:6605:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073673287680 00000100:00100000:2.0:1783441370.908623:0:6605:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073673287680 00000100:00100000:2.0:1783441370.908677:0:6605:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.13@tcp, seq: 4 00000100:00100000:2.0:1783441370.908685:0:6605:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a875691880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:2351:x1870073673287680:12345-192.168.201.13@tcp:38: 00010000:00080000:2.0:1783441370.908714:0:6605:0:(ldlm_lib.c:1432:target_handle_connect()) lustre-MDT0000: connection from 65454767-383a-4679-a788-eba05c6e0989@192.168.201.13@tcp t0 exp 0000000000000000 cur 208 last 0 00000020:00000080:2.0:1783441370.908790:0:6605:0:(genops.c:1406:class_connect()) connect: client 65454767-383a-4679-a788-eba05c6e0989, cookie 0xa2426164df2c7735 00000004:00100000:2.0:1783441370.908818:0:6605:0:(mdt_handler.c:7282:mdt_connect_internal()) lustre-MDT0000: cli supports cksum type f7, return f7 00000001:00000004:2.0:1783441370.908824:0:6605:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 1, last_transno is 4294967296 00000100:00080000:0.0:1783441370.962509:0:6605:0:(import.c:65:import_set_state_nolock()) ffff91a7450eb000 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1783441370.962594:0:6605:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a875691880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:65454767-383a-4679-a788-eba05c6e0989+6:2351:x1870073673287680:12345-192.168.201.13@tcp:38: Request processed in 53905us (54745us total) trans 0 rc 0/0 00000100:00100000:0.0:1783441370.962605:0:6605:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.13@tcp, seq: 4 00000100:00100000:2.0:1783441370.988996:0:3306:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1783441370.989022:0:3306:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff91a875693800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3306:1870073693233280:0@lo:13: 00000100:00100000:2.0:1783441370.989092:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783441370.989213:0:6585:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073693233280 00000100:00100000:3.0:1783441370.989222:0:6585:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073693233280 00000100:00100000:3.0:1783441370.989279:0:6585:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:3.0:1783441370.989297:0:6585:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a846f24700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3306:x1870073693233280:12345-0@lo:13: 00002000:00000024:3.0:1783441370.989339:0:6585:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1783441370.989578:0:6585:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a846f24700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3306:x1870073693233280:12345-0@lo:13: Request processed in 289us (484us total) trans 0 rc 0/0 00000100:00100000:3.0:1783441370.989586:0:6585:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00010000:00080000:2.0:1783441370.989670:0:3306:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff91a875693800 x1870073693233280/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1783441386 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1783441370.989689:0:3306:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff91a875693800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3306:1870073693233280:0@lo:13: 00010000:00010000:2.0:1783441371.182294:0:5772:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1783441371.977169:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.13@tcp (source: 12345-192.168.201.13@tcp) 00000100:00100000:2.0:1783441371.977219:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.13@tcp (source: 12345-192.168.201.13@tcp) 00000100:00100000:3.0:1783441371.977308:0:5786:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073673287936 00000100:00100000:1.0:1783441371.977308:0:5787:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073673287808 00000100:00100000:3.0:1783441371.977317:0:5786:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073673287936 00000100:00100000:1.0:1783441371.977318:0:5787:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073673287808 00000100:00100000:3.0:1783441371.977402:0:5786:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.13@tcp, seq: 5 00000100:00080000:0.0:1783441371.977402:0:5781:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1783441371.977414:0:5786:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a846f24000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:65454767-383a-4679-a788-eba05c6e0989+7:5557:x1870073673287936:12345-192.168.201.13@tcp:41: 00000004:00000024:3.0:1783441371.977467:0:5786:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 3407872 pending 0 free 2261778432 avail 2259681280 00000100:00100000:3.0:1783441371.977534:0:5786:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a846f24000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:65454767-383a-4679-a788-eba05c6e0989+7:5557:x1870073673287936:12345-192.168.201.13@tcp:41: Request processed in 122us (313us total) trans 0 rc 0/0 00000100:00100000:3.0:1783441371.977555:0:5786:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.13@tcp, seq: 5 00000100:00100000:1.0:1783441371.983039:0:5787:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.13@tcp, seq: 6 00000100:00100000:1.0:1783441371.983062:0:5787:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a846f26d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:65454767-383a-4679-a788-eba05c6e0989+6:0:x1870073673287808:12345-192.168.201.13@tcp:41: 00000004:00000024:1.0:1783441371.983096:0:5787:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 3407872 pending 0 free 2261778432 avail 2259681280 00000100:00100000:1.0:1783441371.983184:0:5787:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a846f26d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:65454767-383a-4679-a788-eba05c6e0989+6:0:x1870073673287808:12345-192.168.201.13@tcp:41: Request processed in 133us (6027us total) trans 0 rc 0/0 00000100:00100000:1.0:1783441371.983192:0:5787:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.13@tcp, seq: 6 00000100:00100000:3.0:1783441371.983290:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.13@tcp (source: 12345-192.168.201.13@tcp) 00000100:00100000:1.0:1783441371.983456:0:5785:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073673288064 00000100:00100000:1.0:1783441371.983476:0:5785:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073673288064 00000100:00100000:1.0:1783441371.983514:0:5785:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.13@tcp, seq: 7 00000100:00100000:1.0:1783441371.983520:0:5785:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a875690000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:65454767-383a-4679-a788-eba05c6e0989+6:5557:x1870073673288064:12345-192.168.201.13@tcp:40: 00000100:00100000:1.0:1783441371.983557:0:5785:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a875690000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:65454767-383a-4679-a788-eba05c6e0989+6:5557:x1870073673288064:12345-192.168.201.13@tcp:40: Request processed in 37us (273us total) trans 0 rc 0/0 00000100:00100000:1.0:1783441371.983563:0:5785:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.13@tcp, seq: 7 00000100:00100000:3.0:1783441371.990416:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.13@tcp (source: 12345-192.168.201.13@tcp) 00000100:00100000:3.0:1783441371.990475:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.13@tcp (source: 12345-192.168.201.13@tcp) 00000100:00100000:3.0:1783441371.990510:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.13@tcp (source: 12345-192.168.201.13@tcp) 00000100:00100000:3.0:1783441371.990543:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.13@tcp (source: 12345-192.168.201.13@tcp) 00000100:00100000:0.0:1783441371.990738:0:6581:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073673288192 00000100:00100000:0.0:1783441371.990768:0:6581:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073673288192 00000100:00100000:0.0:1783441371.990813:0:6581:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073673288320 00000100:00100000:0.0:1783441371.990817:0:6581:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073673288320 00000100:00100000:0.0:1783441371.990830:0:6581:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.13@tcp, seq: 9 00000100:00100000:0.0:1783441371.990839:0:6581:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a875693800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:2351:x1870073673288192:12345-192.168.201.13@tcp:8: 00010000:00080000:0.0:1783441371.990868:0:6581:0:(ldlm_lib.c:1432:target_handle_connect()) lustre-OST0000: connection from 65454767-383a-4679-a788-eba05c6e0989@192.168.201.13@tcp t0 exp 0000000000000000 cur 209 last 0 00000020:00000080:0.0:1783441371.990902:0:6581:0:(genops.c:1406:class_connect()) connect: client 65454767-383a-4679-a788-eba05c6e0989, cookie 0xa2426164df2c773c 00002000:00100000:0.0:1783441371.990915:0:6581:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli 65454767-383a-4679-a788-eba05c6e0989/ffff91a7450ee800 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113669 ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:0.0:1783441371.990926:0:6581:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0000: cli supports cksum type f7, return f7 00002000:00080000:0.0:1783441371.991270:0:6581:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:0.0:1783441371.991310:0:6581:0:(import.c:65:import_set_state_nolock()) ffff91a7450ef800 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1783441371.991407:0:6581:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a875693800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:65454767-383a-4679-a788-eba05c6e0989+6:2351:x1870073673288192:12345-192.168.201.13@tcp:8: Request processed in 568us (895us total) trans 0 rc 0/0 00000100:00100000:0.0:1783441371.991432:0:6581:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.13@tcp, seq: 9 00000100:00100000:0.0:1783441371.991451:0:6581:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.13@tcp, seq: 10 00000100:00100000:0.0:1783441371.991455:0:6581:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a875691f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:2351:x1870073673288320:12345-192.168.201.13@tcp:8: 00010000:00080000:0.0:1783441371.991470:0:6581:0:(ldlm_lib.c:1432:target_handle_connect()) lustre-OST0001: connection from 65454767-383a-4679-a788-eba05c6e0989@192.168.201.13@tcp t0 exp 0000000000000000 cur 209 last 0 00000020:00000080:0.0:1783441371.991486:0:6581:0:(genops.c:1406:class_connect()) connect: client 65454767-383a-4679-a788-eba05c6e0989, cookie 0xa2426164df2c7743 00002000:00100000:0.0:1783441371.991491:0:6581:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli 65454767-383a-4679-a788-eba05c6e0989/ffff91a7450ec800 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113669 ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:0.0:1783441371.991506:0:6581:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0001: cli supports cksum type f7, return f7 00002000:00080000:0.0:1783441371.991702:0:6581:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:0.0:1783441371.991718:0:6581:0:(import.c:65:import_set_state_nolock()) ffff91a7450ee000 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1783441371.991769:0:6581:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a875691f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:65454767-383a-4679-a788-eba05c6e0989+6:2351:x1870073673288320:12345-192.168.201.13@tcp:8: Request processed in 285us (1198us total) trans 0 rc 0/0 00000100:00100000:0.0:1783441371.991777:0:6581:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.13@tcp, seq: 10 00000100:00100000:2.0:1783441371.992340:0:5778:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073673288576 00000100:00100000:2.0:1783441371.992358:0:5778:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073673288576 00000100:00100000:2.0:1783441371.992406:0:5778:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.13@tcp, seq: 127 00000100:00100000:2.0:1783441371.992413:0:5778:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a8655e6c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:51c2a82e-e792-4f56-84e8-12cc033e9e70+10:2354:x1870073673288576:12345-192.168.201.13@tcp:400: 00000100:00100000:2.0:1783441371.992452:0:5778:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a8655e6c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:51c2a82e-e792-4f56-84e8-12cc033e9e70+10:2354:x1870073673288576:12345-192.168.201.13@tcp:400: Request processed in 40us (1977us total) trans 0 rc 0/0 00000100:00100000:2.0:1783441371.992470:0:5778:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.13@tcp, seq: 127 00000100:00100000:1.0:1783441371.992973:0:5788:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073673288448 00000100:00100000:1.0:1783441371.992979:0:5788:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073673288448 00000100:00100000:1.0:1783441371.993019:0:5788:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.13@tcp, seq: 0 00000100:00100000:1.0:1783441371.993028:0:5788:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a875693b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:65454767-383a-4679-a788-eba05c6e0989+6:5557:x1870073673288448:12345-192.168.201.13@tcp:33: 00000004:00080000:1.0:1783441372.018543:0:5788:0:(mdt_identity.c:119:mdt_identity_do_upcall()) lustre-MDT0000: invoked upcall /home/green/git/lustre-release/lustre/utils/l_getidentity lustre-MDT0000 0, time 25461us 00000004:00200000:2.0:1783441372.043074:0:5788:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 6656 00000100:00100000:2.0:1783441372.043246:0:5788:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a875693b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:65454767-383a-4679-a788-eba05c6e0989+6:5557:x1870073673288448:12345-192.168.201.13@tcp:33: Request processed in 50213us (52836us total) trans 0 rc 0/0 00000100:00100000:2.0:1783441372.043260:0:5788:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.13@tcp, seq: 0 00010000:00010000:0.0:1783441372.204881:0:5773:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1783441372.284812:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.13@tcp (source: 12345-192.168.201.13@tcp) 00000100:00100000:1.0:1783441372.284914:0:5787:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073673288704 00000100:00100000:1.0:1783441372.284924:0:5787:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073673288704 00000100:00100000:1.0:1783441372.284999:0:5787:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.13@tcp, seq: 8 00000100:00100000:1.0:1783441372.285009:0:5787:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a8756a6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:65454767-383a-4679-a788-eba05c6e0989+6:5596:x1870073673288704:12345-192.168.201.13@tcp:101: 00010000:00010000:1.0:1783441372.285031:0:5787:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1783441372.285104:0:5787:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91a87da47c00/0xa2426164df2c774a lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x633a354aa4df4c94 expref: -99 pid: 5787 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783441372.285162:0:5787:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff91a87da47200/0xa2426164df2c7751 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783441372.285172:0:5787:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91a87da47200/0xa2426164df2c7751 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783441372.285182:0:5787:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91a87da47200/0xa2426164df2c7751 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1783441372.285628:0:5787:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 6656 00000004:00200000:1.0:1783441372.285634:0:5787:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 1 stripe count 1 MDT count 1 00000004:00010000:1.0:1783441372.285715:0:5787:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff91a87da47200/0xa2426164df2c7751 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783441372.285774:0:5787:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91a87da47c00/0xa2426164df2c774a lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.13@tcp remote: 0x633a354aa4df4c94 expref: 8 pid: 5787 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783441372.285795:0:5787:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff91a87da47200/0xa2426164df2c7751 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.13@tcp remote: 0x633a354aa4df4c94 expref: 7 pid: 5787 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783441372.285804:0:5787:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff91a858b90200) 00010000:00010000:1.0:1783441372.285807:0:5787:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1783441372.285810:0:5787:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91a87da47200, rc 0) 00000100:00100000:1.0:1783441372.285921:0:5787:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a8756a6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:65454767-383a-4679-a788-eba05c6e0989+7:5596:x1870073673288704:12345-192.168.201.13@tcp:101: Request processed in 912us (1118us total) trans 0 rc 0/0 00000100:00100000:1.0:1783441372.285929:0:5787:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.13@tcp, seq: 8 00000001:00100000:1.0:1783441372.596087:0:6613:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of 65454767-383a-4679-a788-eba05c6e0989 00010000:00010000:2.0:1783441373.230948:0:5772:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783441374.252911:0:5773:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1783441374.512677:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.13@tcp (source: 12345-192.168.201.13@tcp) 00000100:00100000:3.0:1783441374.512767:0:5786:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073673288832 00000100:00100000:3.0:1783441374.512777:0:5786:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073673288832 00000100:00100000:3.0:1783441374.512851:0:5786:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.13@tcp, seq: 9 00000100:00100000:3.0:1783441374.512867:0:5786:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a8756a6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:65454767-383a-4679-a788-eba05c6e0989+7:5648:x1870073673288832:12345-192.168.201.13@tcp:41: 00000004:00000024:3.0:1783441374.512915:0:5786:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 3407872 pending 0 free 2261778432 avail 2259681280 00000100:00100000:3.0:1783441374.512991:0:5786:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a8756a6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:65454767-383a-4679-a788-eba05c6e0989+7:5648:x1870073673288832:12345-192.168.201.13@tcp:41: Request processed in 126us (324us total) trans 0 rc 0/0 00000100:00100000:3.0:1783441374.512999:0:5786:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.13@tcp, seq: 9 00000100:00080000:0.0:1783441374.513425:0:5781:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1783441374.522874:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.13@tcp (source: 12345-192.168.201.13@tcp) 00000100:00100000:2.0:1783441374.522936:0:6584:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073673288960 00000100:00100000:2.0:1783441374.522948:0:6584:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073673288960 00000100:00100000:2.0:1783441374.523027:0:6584:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.13@tcp, seq: 8 00000100:00100000:2.0:1783441374.523038:0:6584:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a8756a5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:65454767-383a-4679-a788-eba05c6e0989+5:5648:x1870073673288960:12345-192.168.201.13@tcp:13: 00002000:00000024:2.0:1783441374.523075:0:6584:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1783441374.523145:0:6584:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a8756a5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:65454767-383a-4679-a788-eba05c6e0989+5:5648:x1870073673288960:12345-192.168.201.13@tcp:13: Request processed in 108us (280us total) trans 0 rc 0/0 00000100:00100000:2.0:1783441374.523152:0:6584:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.13@tcp, seq: 8 00000100:00080000:0.0:1783441374.523471:0:5781:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1783441374.528112:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.13@tcp (source: 12345-192.168.201.13@tcp) 00000100:00100000:2.0:1783441374.528231:0:6584:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073673289088 00000100:00100000:2.0:1783441374.528251:0:6584:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073673289088 00000100:00100000:2.0:1783441374.528336:0:6584:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.13@tcp, seq: 9 00000100:00100000:2.0:1783441374.528346:0:6584:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a87d6a0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:65454767-383a-4679-a788-eba05c6e0989+6:5648:x1870073673289088:12345-192.168.201.13@tcp:13: 00002000:00000024:2.0:1783441374.528381:0:6584:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1783441374.528439:0:6584:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a87d6a0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:65454767-383a-4679-a788-eba05c6e0989+6:5648:x1870073673289088:12345-192.168.201.13@tcp:13: Request processed in 94us (337us total) trans 0 rc 0/0 00000100:00100000:2.0:1783441374.528446:0:6584:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.13@tcp, seq: 9 00000100:00080000:0.0:1783441374.528669:0:5781:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1783441374.574448:0:3303:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff91a875691c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3303:1870073693233536:0@lo:400: 00000100:00100000:3.0:1783441374.574522:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783441374.574540:0:3304:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff91a87d4ead80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3304:1870073693233664:0@lo:400: 00000100:00100000:3.0:1783441374.574576:0:3303:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff91a87d4e9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3303:1870073693234048:0@lo:400: 00000100:00100000:0.0:1783441374.574579:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783441374.574602:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783441374.574638:0:6581:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073693234048 00000100:00100000:0.0:1783441374.574644:0:6581:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073693234048 00000100:00100000:0.0:1783441374.574716:0:6581:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:0.0:1783441374.574725:0:6581:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a87d4e9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3303:x1870073693234048:12345-0@lo:400: 00000100:00100000:2.0:1783441374.574770:0:3306:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff91a875690700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:6c1ddb50-5795-40c6-a2b6-8f58add9da62:3306:1870073693233408:0@lo:400: 00000100:00100000:2.0:1783441374.574800:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783441374.574801:0:6581:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a87d4e9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3303:x1870073693234048:12345-0@lo:400: Request processed in 77us (197us total) trans 0 rc 0/0 00000100:00100000:0.0:1783441374.574808:0:6581:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:2.0:1783441374.574838:0:3306:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff91a87d4eaa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3306:1870073693233920:0@lo:400: 00000100:00100000:0.0:1783441374.574844:0:5785:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073693233536 00000100:00100000:0.0:1783441374.574847:0:5785:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073693233536 00000100:00100000:0.0:1783441374.574867:0:5785:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073693233664 00000100:00100000:2.0:1783441374.574868:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783441374.574869:0:5785:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073693233664 00000100:00100000:0.0:1783441374.574883:0:5785:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073693233920 00000100:00100000:0.0:1783441374.574885:0:5785:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073693233920 00000100:00100000:2.0:1783441374.574886:0:3306:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1783441374.574891:0:3306:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff91a87d4e8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3306:1870073693233792:0@lo:400: 00000100:00100000:0.0:1783441374.574897:0:5785:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:0.0:1783441374.574903:0:5785:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a87d4e8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3303:x1870073693233536:12345-0@lo:400: 00000100:00100000:2.0:1783441374.574923:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783441374.574932:0:5785:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a87d4e8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3303:x1870073693233536:12345-0@lo:400: Request processed in 29us (410us total) trans 0 rc 0/0 00000100:00100000:0.0:1783441374.574937:0:5785:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:2.0:1783441374.574948:0:5779:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073693233408 00000100:00100000:0.0:1783441374.574949:0:5785:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:2.0:1783441374.574952:0:5779:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073693233408 00000100:00100000:0.0:1783441374.574954:0:5785:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a844b7ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3304:x1870073693233664:12345-0@lo:400: 00000100:00100000:0.0:1783441374.574985:0:5785:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a844b7ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3304:x1870073693233664:12345-0@lo:400: Request processed in 31us (405us total) trans 0 rc 0/0 00000100:00100000:2.0:1783441374.574988:0:5779:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 128 00000100:00100000:0.0:1783441374.574992:0:5785:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00100000:2.0:1783441374.574994:0:5779:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a8484bbc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6c1ddb50-5795-40c6-a2b6-8f58add9da62+19:3306:x1870073693233408:12345-0@lo:400: 00000100:00100000:0.0:1783441374.575001:0:5785:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:0.0:1783441374.575006:0:5785:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a846f25180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3306:x1870073693233920:12345-0@lo:400: 00000100:00100000:2.0:1783441374.575025:0:5779:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a8484bbc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6c1ddb50-5795-40c6-a2b6-8f58add9da62+19:3306:x1870073693233408:12345-0@lo:400: Request processed in 31us (224us total) trans 0 rc 0/0 00000100:00100000:0.0:1783441374.575026:0:5785:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a846f25180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3306:x1870073693233920:12345-0@lo:400: Request processed in 20us (158us total) trans 0 rc 0/0 00000100:00100000:0.0:1783441374.575031:0:5785:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00100000:2.0:1783441374.575032:0:5779:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 128 00000100:00100000:2.0:1783441374.575057:0:6582:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073693233792 00000100:00100000:2.0:1783441374.575060:0:6582:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073693233792 00000100:00100000:0.0:1783441374.575064:0:3304:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff91a87d4ead80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3304:1870073693233664:0@lo:400: 00000100:00100000:2.0:1783441374.575083:0:6582:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:2.0:1783441374.575089:0:6582:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a846f27b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3306:x1870073693233792:12345-0@lo:400: 00000100:00100000:2.0:1783441374.575129:0:6582:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a846f27b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3306:x1870073693233792:12345-0@lo:400: Request processed in 40us (205us total) trans 0 rc 0/0 00000100:00100000:2.0:1783441374.575135:0:6582:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00010000:00080000:2.0:1783441374.575159:0:3306:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff91a87d4e8a80 x1870073693233792/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1783441390 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1783441374.575170:0:3306:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff91a87d4e8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3306:1870073693233792:0@lo:400: 00000100:00100000:2.0:1783441374.575178:0:3306:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff91a875690700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:6c1ddb50-5795-40c6-a2b6-8f58add9da62:3306:1870073693233408:0@lo:400: 00000100:00100000:2.0:1783441374.575187:0:3306:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff91a87d4eaa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3306:1870073693233920:0@lo:400: 00000100:00080000:3.0:1783441374.575695:0:5781:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1783441374.575701:0:5781:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1783441374.575703:0:5781:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1783441374.575727:0:3303:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff91a875691c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3303:1870073693233536:0@lo:400: 00010000:00080000:3.0:1783441374.575769:0:3303:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff91a87d4e9f80 x1870073693234048/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1783441390 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1783441374.575779:0:3303:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967298 gen 2 00000100:00100000:3.0:1783441374.575800:0:3303:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff91a87d4e9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3303:1870073693234048:0@lo:400: 00000100:00100000:0.0:1783441375.084993:0:3304:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff91a87d6a3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3304:1870073693234176:0@lo:13: 00000100:00100000:0.0:1783441375.085067:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783441375.085185:0:6584:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073693234176 00000100:00100000:3.0:1783441375.085192:0:6584:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073693234176 00000100:00100000:3.0:1783441375.085235:0:6584:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:3.0:1783441375.085247:0:6584:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a844b7ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3304:x1870073693234176:12345-0@lo:13: 00002000:00000024:3.0:1783441375.085264:0:6584:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1783441375.085387:0:6584:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a844b7ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3304:x1870073693234176:12345-0@lo:13: Request processed in 144us (318us total) trans 0 rc 0/0 00000100:00100000:3.0:1783441375.085396:0:6584:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00010000:00080000:0.0:1783441375.085457:0:3304:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff91a87d6a3800 x1870073693234176/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1783441391 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1783441375.085473:0:3304:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff91a87d6a3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3304:1870073693234176:0@lo:13: 00010000:00010000:2.0:1783441375.277118:0:5772:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1783441376.110155:0:3305:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff91a87d4e9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3305:1870073693234304:0@lo:13: 00000100:00100000:2.0:1783441376.110240:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783441376.110542:0:6585:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073693234304 00000100:00100000:1.0:1783441376.110551:0:6585:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073693234304 00000100:00100000:1.0:1783441376.110604:0:6585:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:1.0:1783441376.110615:0:6585:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a846f26680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3305:x1870073693234304:12345-0@lo:13: 00002000:00000024:1.0:1783441376.110638:0:6585:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1783441376.110689:0:6585:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a846f26680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3305:x1870073693234304:12345-0@lo:13: Request processed in 77us (448us total) trans 0 rc 0/0 00000100:00100000:1.0:1783441376.110696:0:6585:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00010000:00080000:1.0:1783441376.110777:0:3305:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff91a87d4e9f80 x1870073693234304/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1783441392 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1783441376.110796:0:3305:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff91a87d4e9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3305:1870073693234304:0@lo:13: 00000100:00080000:3.0:1783441376.110870:0:5781:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000001:00100000:3.0:1783441376.166301:0:5807:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of 65454767-383a-4679-a788-eba05c6e0989 00010000:00010000:0.0:1783441376.303081:0:5773:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:1.0:1783441376.704306:0:7492:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of 65454767-383a-4679-a788-eba05c6e0989 00000100:00100000:0.0:1783441377.139800:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.13@tcp (source: 12345-192.168.201.13@tcp) 00000100:00100000:0.0:1783441377.139835:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.13@tcp (source: 12345-192.168.201.13@tcp) 00000100:00100000:0.0:1783441377.139863:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.13@tcp (source: 12345-192.168.201.13@tcp) 00000100:00100000:0.0:1783441377.139893:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.13@tcp (source: 12345-192.168.201.13@tcp) 00000100:00100000:0.0:1783441377.139923:0:5785:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073673289344 00000100:00100000:0.0:1783441377.139933:0:5785:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073673289344 00000100:00100000:0.0:1783441377.139989:0:5785:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.13@tcp, seq: 25 00000100:00100000:0.0:1783441377.140000:0:5785:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a844b7df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:65454767-383a-4679-a788-eba05c6e0989+6:2354:x1870073673289344:12345-192.168.201.13@tcp:400: 00000100:00100000:0.0:1783441377.140078:0:5785:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a844b7df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:65454767-383a-4679-a788-eba05c6e0989+6:2354:x1870073673289344:12345-192.168.201.13@tcp:400: Request processed in 80us (213us total) trans 0 rc 0/0 00000100:00100000:0.0:1783441377.140086:0:5785:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.13@tcp, seq: 25 00000100:00100000:0.0:1783441377.140120:0:6581:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073673289472 00000100:00100000:0.0:1783441377.140124:0:6581:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073673289472 00000100:00100000:0.0:1783441377.140151:0:6581:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073673289600 00000100:00100000:0.0:1783441377.140153:0:6581:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073673289600 00000100:00100000:0.0:1783441377.140169:0:6581:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.13@tcp, seq: 9 00000100:00100000:0.0:1783441377.140174:0:6581:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a844b7ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:65454767-383a-4679-a788-eba05c6e0989+5:2354:x1870073673289472:12345-192.168.201.13@tcp:400: 00000100:00100000:0.0:1783441377.140210:0:6581:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a844b7ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:65454767-383a-4679-a788-eba05c6e0989+5:2354:x1870073673289472:12345-192.168.201.13@tcp:400: Request processed in 35us (374us total) trans 0 rc 0/0 00000100:00100000:0.0:1783441377.140216:0:6581:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.13@tcp, seq: 9 00000100:00100000:0.0:1783441377.140227:0:6581:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.13@tcp, seq: 10 00000100:00100000:0.0:1783441377.140245:0:6581:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a844b7c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:65454767-383a-4679-a788-eba05c6e0989+5:2354:x1870073673289600:12345-192.168.201.13@tcp:400: 00000100:00100000:0.0:1783441377.140292:0:6581:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a844b7c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:65454767-383a-4679-a788-eba05c6e0989+5:2354:x1870073673289600:12345-192.168.201.13@tcp:400: Request processed in 48us (398us total) trans 0 rc 0/0 00000100:00100000:0.0:1783441377.140298:0:6581:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.13@tcp, seq: 10 00000100:00100000:3.0:1783441377.140471:0:5780:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073673289216 00000100:00100000:3.0:1783441377.140476:0:5780:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073673289216 00000100:00100000:3.0:1783441377.140511:0:5780:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.13@tcp, seq: 129 00000100:00100000:3.0:1783441377.140518:0:5780:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a8484ba050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:51c2a82e-e792-4f56-84e8-12cc033e9e70+10:2354:x1870073673289216:12345-192.168.201.13@tcp:400: 00000100:00100000:3.0:1783441377.140552:0:5780:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a8484ba050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:51c2a82e-e792-4f56-84e8-12cc033e9e70+10:2354:x1870073673289216:12345-192.168.201.13@tcp:400: Request processed in 34us (764us total) trans 0 rc 0/0 00000100:00100000:3.0:1783441377.140558:0:5780:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.13@tcp, seq: 129 00000100:00080000:3.0:1783441377.140584:0:5781:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1783441377.140588:0:5781:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1783441377.140592:0:5781:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:1.0:1783441377.325439:0:5772:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:1.0:1783441377.440515:0:8147:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: Using TIMEOUT=20 00010000:00010000:0.0:1783441378.349488:0:5773:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783441379.402053:0:5772:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1783441379.693975:0:3303:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff91a87d4e8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3303:1870073693234560:0@lo:400: 00000100:00100000:3.0:1783441379.694051:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783441379.694098:0:3303:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff91a87d4e8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3303:1870073693235072:0@lo:400: 00000100:00100000:3.0:1783441379.694123:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783441379.694154:0:3303:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1783441379.694168:0:3303:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff91a87d4ea300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3303:1870073693234688:0@lo:400: 00000100:00100000:3.0:1783441379.694190:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783441379.694236:0:5786:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073693234560 00000100:00100000:3.0:1783441379.694244:0:5786:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073693234560 00000100:00100000:3.0:1783441379.694291:0:5786:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073693234688 00000100:00100000:3.0:1783441379.694294:0:5786:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073693234688 00000100:00100000:3.0:1783441379.694322:0:5786:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:3.0:1783441379.694330:0:5786:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a87d4e8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3303:x1870073693234560:12345-0@lo:400: 00000100:00100000:3.0:1783441379.694382:0:5786:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a87d4e8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3303:x1870073693234560:12345-0@lo:400: Request processed in 52us (331us total) trans 0 rc 0/0 00000100:00100000:3.0:1783441379.694388:0:5786:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:3.0:1783441379.694404:0:5786:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:3.0:1783441379.694410:0:5786:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a87d4e9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3303:x1870073693234688:12345-0@lo:400: 00000100:00100000:3.0:1783441379.694434:0:5786:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a87d4e9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3303:x1870073693234688:12345-0@lo:400: Request processed in 25us (242us total) trans 0 rc 0/0 00000100:00100000:3.0:1783441379.694439:0:5786:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:3.0:1783441379.694456:0:6581:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073693235072 00000100:00100000:3.0:1783441379.694459:0:6581:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073693235072 00000100:00100000:3.0:1783441379.694485:0:6581:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:3.0:1783441379.694491:0:6581:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a87d4eb480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3303:x1870073693235072:12345-0@lo:400: 00000100:00100000:3.0:1783441379.694518:0:6581:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a87d4eb480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3303:x1870073693235072:12345-0@lo:400: Request processed in 26us (394us total) trans 0 rc 0/0 00000100:00100000:3.0:1783441379.694524:0:6581:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00080000:3.0:1783441379.694542:0:5781:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1783441379.694546:0:5781:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1783441379.694577:0:3303:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff91a87d4ea300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3303:1870073693234688:0@lo:400: 00000100:00100000:3.0:1783441379.694587:0:3303:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff91a87d4e8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3303:1870073693234560:0@lo:400: 00010000:00080000:3.0:1783441379.694608:0:3303:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff91a87d4e8000 x1870073693235072/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1783441395 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1783441379.694617:0:3303:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff91a87d4e8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3303:1870073693235072:0@lo:400: 00000100:00100000:0.0:1783441379.694703:0:3305:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff91a87d4eb800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3305:1870073693234816:0@lo:400: 00000100:00100000:0.0:1783441379.694731:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783441379.694774:0:3305:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:0.0:1783441379.694780:0:3305:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff91a87d4eb100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:6c1ddb50-5795-40c6-a2b6-8f58add9da62:3305:1870073693234432:0@lo:400: 00000100:00100000:0.0:1783441379.694805:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783441379.694827:0:3305:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff91a87d4e9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3305:1870073693234944:0@lo:400: 00000100:00100000:0.0:1783441379.694847:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783441379.695084:0:5778:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073693234432 00000100:00100000:0.0:1783441379.695089:0:5778:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073693234432 00000100:00100000:0.0:1783441379.695116:0:5778:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 130 00000100:00100000:0.0:1783441379.695123:0:5778:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a8484bb850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6c1ddb50-5795-40c6-a2b6-8f58add9da62+19:3305:x1870073693234432:12345-0@lo:400: 00000100:00100000:0.0:1783441379.695159:0:5778:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a8484bb850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6c1ddb50-5795-40c6-a2b6-8f58add9da62+19:3305:x1870073693234432:12345-0@lo:400: Request processed in 36us (352us total) trans 0 rc 0/0 00000100:00100000:0.0:1783441379.695165:0:5778:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 130 00000100:00100000:0.0:1783441379.695196:0:3305:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff91a87d4eb100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:6c1ddb50-5795-40c6-a2b6-8f58add9da62:3305:1870073693234432:0@lo:400: 00000100:00100000:3.0:1783441379.695266:0:6583:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073693234816 00000100:00100000:3.0:1783441379.695270:0:6583:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073693234816 00000100:00100000:3.0:1783441379.695310:0:6583:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:3.0:1783441379.695317:0:6583:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a844b7dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3305:x1870073693234816:12345-0@lo:400: 00000100:00100000:3.0:1783441379.695353:0:6583:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a844b7dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3305:x1870073693234816:12345-0@lo:400: Request processed in 37us (620us total) trans 0 rc 0/0 00000100:00100000:3.0:1783441379.695359:0:6583:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00010000:00080000:3.0:1783441379.695389:0:3305:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff91a87d4eb800 x1870073693234816/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1783441395 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1783441379.695399:0:3305:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff91a87d4eb800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3305:1870073693234816:0@lo:400: 00000100:00100000:3.0:1783441379.695415:0:5786:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073693234944 00000100:00100000:3.0:1783441379.695418:0:5786:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073693234944 00000100:00100000:3.0:1783441379.695443:0:5786:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:3.0:1783441379.695450:0:5786:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a844b7f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3305:x1870073693234944:12345-0@lo:400: 00000100:00100000:3.0:1783441379.695483:0:5786:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a844b7f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3305:x1870073693234944:12345-0@lo:400: Request processed in 34us (635us total) trans 0 rc 0/0 00000100:00100000:3.0:1783441379.695488:0:5786:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00100000:3.0:1783441379.695512:0:3305:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff91a87d4e9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3305:1870073693234944:0@lo:400: 00000100:00080000:0.0:1783441379.695719:0:5781:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1783441379.695723:0:5781:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1783441380.205878:0:3303:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1783441380.211412:0:3303:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff91a87d6a1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3303:1870073693235200:0@lo:13: 00000100:00100000:2.0:1783441380.214678:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783441380.214967:0:6585:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073693235200 00000100:00100000:1.0:1783441380.214980:0:6585:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073693235200 00000100:00100000:1.0:1783441380.215058:0:6585:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:1.0:1783441380.215069:0:6585:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a846f27480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3303:x1870073693235200:12345-0@lo:13: 00002000:00000024:1.0:1783441380.215124:0:6585:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1783441380.215187:0:6585:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a846f27480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3303:x1870073693235200:12345-0@lo:13: Request processed in 120us (523us total) trans 0 rc 0/0 00000100:00100000:1.0:1783441380.215195:0:6585:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00010000:00080000:2.0:1783441380.219064:0:3303:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff91a87d6a1180 x1870073693235200/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1783441396 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1783441380.219102:0:3303:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff91a87d6a1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3303:1870073693235200:0@lo:13: 00010000:00010000:0.0:1783441380.460950:0:5773:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1783441381.229692:0:3305:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff91a87d4e9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3305:1870073693235328:0@lo:13: 00000100:00100000:0.0:1783441381.229836:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783441381.230298:0:6585:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073693235328 00000100:00100000:1.0:1783441381.230309:0:6585:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073693235328 00000100:00100000:1.0:1783441381.230392:0:6585:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:1.0:1783441381.230403:0:6585:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a844b7ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3305:x1870073693235328:12345-0@lo:13: 00002000:00000024:1.0:1783441381.230452:0:6585:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1783441381.230511:0:6585:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a844b7ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3305:x1870073693235328:12345-0@lo:13: Request processed in 109us (675us total) trans 0 rc 0/0 00000100:00100000:1.0:1783441381.230518:0:6585:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00080000:0.0:1783441381.230852:0:5781:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:0.0:1783441381.230916:0:3305:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff91a87d4e9500 x1870073693235328/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1783441397 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1783441381.230954:0:3305:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff91a87d4e9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3305:1870073693235328:0@lo:13: 00010000:00010000:3.0:1783441381.488573:0:5772:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:3.0:1783441382.119730:0:8297:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007ffef23d9e40 20000000:00000080:3.0:1783441382.120694:0:8297:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff91a746e28c00 uarg=0000000000000000 20000000:01000000:3.0:1783441382.120733:0:8297:0:(mgs_llog.c:2006:mgs_parse_devname()) Device name lustre without fsname 20000000:01000000:3.0:1783441382.120873:0:8297:0:(mgs_llog.c:6065:mgs_set_conf_param()) lustre is seen as a file system name 20000000:01000000:3.0:1783441382.120876:0:8297:0:(mgs_llog.c:6096:mgs_set_conf_param()) set_conf_param fs='lustre' device='lustre' param='sys.jobid_var=procname_uid' 20000000:01000000:3.0:1783441382.120881:0:8297:0:(mgs_llog.c:4744:mgs_write_log_param()) next param 'sys.jobid_var=procname_uid' 20000000:01000000:3.0:1783441382.120886:0:8297:0:(mgs_llog.c:4177:mgs_write_log_sys()) global 'sys.jobid_var=procname_uid' val=procname_uid 20000000:01000000:3.0:1783441382.120901:0:8297:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping . 20000000:01000000:3.0:1783441382.120903:0:8297:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping .. 20000000:01000000:3.0:1783441382.121134:0:8297:0:(mgs_llog.c:2546:mgs_write_log_direct_all()) Changing log lustre-OST0000 20000000:01000000:3.0:1783441382.121137:0:8297:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-OST0000/lustre/sys.jobid_var fl=4 00000040:00080000:1.0:1783441382.122551:0:8298:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 11 count 11 00000040:00080000:3.0:1783441382.123271:0:8297:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].11, 224 off10160 00000040:00080000:3.0:1783441382.123338:0:8297:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].12, 120 off10280 00000040:00080000:3.0:1783441382.123374:0:8297:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].13, 224 off10504 20000000:01000000:3.0:1783441382.123387:0:8297:0:(mgs_llog.c:2546:mgs_write_log_direct_all()) Changing log lustre-client 20000000:01000000:3.0:1783441382.123390:0:8297:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-client/lustre/sys.jobid_var fl=4 00000040:00080000:3.0:1783441382.124486:0:8299:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 39 count 39 00000040:00080000:1.0:1783441382.125924:0:8297:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].39, 224 off14880 00000040:00080000:1.0:1783441382.125979:0:8297:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].40, 120 off15000 00000040:00080000:1.0:1783441382.126014:0:8297:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].41, 224 off15224 20000000:01000000:1.0:1783441382.126030:0:8297:0:(mgs_llog.c:2546:mgs_write_log_direct_all()) Changing log lustre-MDT0000 20000000:01000000:1.0:1783441382.126034:0:8297:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-MDT0000/lustre/sys.jobid_var fl=4 00000040:00080000:3.0:1783441382.127327:0:8300:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 34 count 34 00000040:00080000:1.0:1783441382.128018:0:8297:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].34, 224 off14144 00000040:00080000:1.0:1783441382.128068:0:8297:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].35, 120 off14264 00000040:00080000:1.0:1783441382.128124:0:8297:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].36, 224 off14488 20000000:01000000:1.0:1783441382.128137:0:8297:0:(mgs_llog.c:2546:mgs_write_log_direct_all()) Changing log lustre-OST0001 20000000:01000000:1.0:1783441382.128139:0:8297:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-OST0001/lustre/sys.jobid_var fl=4 00000040:00080000:3.0:1783441382.129391:0:8301:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x9:0x0] index 8 count 8 00000040:00080000:1.0:1783441382.129969:0:8297:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].8, 224 off9632 00000040:00080000:1.0:1783441382.130035:0:8297:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].9, 120 off9752 00000040:00080000:1.0:1783441382.130075:0:8297:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].10, 224 off9976 10000000:01000000:1.0:1783441382.130094:0:8297:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x0 (lustre) 00010000:00010000:1.0:1783441382.130117:0:8297:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff91a87da47000/0xa2426164df2c7758 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8297 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783441382.130136:0:8297:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff91a841477400/0xa2426164df2c7655 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xa2426164df2c764e expref: 18 pid: 5779 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783441382.130143:0:8297:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff91a85eb3d000/0xa2426164df2c767f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xa2426164df2c7678 expref: 18 pid: 5780 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783441382.130149:0:8297:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff91a841476000/0xa2426164df2c76a9 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xa2426164df2c76a2 expref: 18 pid: 5780 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783441382.130156:0:8297:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff91a841477c00/0xa2426164df2c76b7 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xa2426164df2c76b0 expref: 18 pid: 5778 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783441382.130163:0:8297:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff91a85eb3d600/0xa2426164df2c76c5 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xa2426164df2c76be expref: 18 pid: 5780 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783441382.130171:0:8297:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff91a85f83c200/0xa2426164df2c76e1 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xa2426164df2c76da expref: 18 pid: 5780 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783441382.130190:0:8297:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff91a840031000/0xa2426164df2c770b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xa2426164df2c7704 expref: 18 pid: 5778 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783441382.130213:0:8297:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff91a840031800/0xa2426164df2c7719 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 192.168.201.13@tcp remote: 0x633a354aa4df4c32 expref: 9 pid: 5779 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783441382.130222:0:8297:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff91a85f83cc00/0xa2426164df2c7720 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 192.168.201.13@tcp remote: 0x633a354aa4df4c39 expref: 9 pid: 5778 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783441382.130230:0:8297:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff91a87da47000/0xa2426164df2c7758 lrc: 12/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 8297 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783441382.130271:0:8297:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff91a85f83cc00/0xa2426164df2c7720 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000020 nid: 192.168.201.13@tcp remote: 0x633a354aa4df4c39 expref: 9 pid: 5778 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783441382.130290:0:8297:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff91a85f83cc00/0xa2426164df2c7720 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x70000400000020 nid: 192.168.201.13@tcp remote: 0x633a354aa4df4c39 expref: 9 pid: 5778 timeout: 320 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783441382.130305:0:8297:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff91a87d6a1180 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8297:1870073693235456:192.168.201.13@tcp:104: 00010000:00010000:1.0:1783441382.130467:0:8297:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff91a840031800/0xa2426164df2c7719 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000020 nid: 192.168.201.13@tcp remote: 0x633a354aa4df4c32 expref: 9 pid: 5779 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783441382.130477:0:8297:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff91a840031800/0xa2426164df2c7719 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x70000400000020 nid: 192.168.201.13@tcp remote: 0x633a354aa4df4c32 expref: 9 pid: 5779 timeout: 320 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783441382.130487:0:8297:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff91a87d6a3800 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8297:1870073693235584:192.168.201.13@tcp:104: 00010000:00010000:1.0:1783441382.130535:0:8297:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff91a840031000/0xa2426164df2c770b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xa2426164df2c7704 expref: 18 pid: 5778 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783441382.130544:0:8297:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff91a840031000/0xa2426164df2c770b lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xa2426164df2c7704 expref: 18 pid: 5778 timeout: 370 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783441382.130633:0:8297:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff91a859086680 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8297:1870073693235712:0@lo:104: 00000100:00100000:1.0:1783441382.130686:0:8297:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1783441382.130726:0:8297:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff91a85f83c200/0xa2426164df2c76e1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xa2426164df2c76da expref: 18 pid: 5780 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783441382.130733:0:8297:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff91a85f83c200/0xa2426164df2c76e1 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xa2426164df2c76da expref: 18 pid: 5780 timeout: 370 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783441382.130815:0:8297:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff91a859085180 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8297:1870073693235840:0@lo:104: 00000100:00100000:1.0:1783441382.130842:0:8297:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1783441382.130911:0:8297:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff91a85eb3d600/0xa2426164df2c76c5 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xa2426164df2c76be expref: 18 pid: 5780 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783441382.130920:0:8297:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff91a85eb3d600/0xa2426164df2c76c5 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xa2426164df2c76be expref: 18 pid: 5780 timeout: 370 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783441382.130928:0:8297:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff91a859086d80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8297:1870073693235968:0@lo:104: 00010000:00010000:1.0:1783441382.130954:0:8297:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff91a841477c00/0xa2426164df2c76b7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xa2426164df2c76b0 expref: 18 pid: 5778 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783441382.130961:0:8297:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff91a841477c00/0xa2426164df2c76b7 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xa2426164df2c76b0 expref: 18 pid: 5778 timeout: 370 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783441382.130968:0:8297:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff91a859084a80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8297:1870073693236096:0@lo:104: 00010000:00010000:1.0:1783441382.130988:0:8297:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff91a841476000/0xa2426164df2c76a9 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xa2426164df2c76a2 expref: 18 pid: 5780 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783441382.130995:0:8297:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff91a841476000/0xa2426164df2c76a9 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xa2426164df2c76a2 expref: 18 pid: 5780 timeout: 370 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783441382.131010:0:8297:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff91a859086a00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8297:1870073693236224:0@lo:104: 00010000:00010000:1.0:1783441382.131034:0:8297:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff91a85eb3d000/0xa2426164df2c767f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xa2426164df2c7678 expref: 18 pid: 5780 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783441382.131041:0:8297:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff91a85eb3d000/0xa2426164df2c767f lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xa2426164df2c7678 expref: 18 pid: 5780 timeout: 370 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783441382.131048:0:8297:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff91a859085f80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8297:1870073693236352:0@lo:104: 00010000:00010000:1.0:1783441382.131065:0:8297:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff91a841477400/0xa2426164df2c7655 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xa2426164df2c764e expref: 18 pid: 5779 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783441382.131072:0:8297:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff91a841477400/0xa2426164df2c7655 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xa2426164df2c764e expref: 18 pid: 5779 timeout: 370 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783441382.131079:0:8297:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff91a859084700 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8297:1870073693236480:0@lo:104: 00000100:00100000:1.0:1783441382.131093:0:8297:0:(client.c:2702:ptlrpc_set_wait()) set ffff91a848630600 going to sleep for 11 seconds 00000100:00100000:3.0:1783441382.131193:0:5768:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/2 left), rc = 0 00000100:00100000:3.0:1783441382.131213:0:5768:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783441382.131225:0:5768:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783441382.131233:0:5768:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783441382.131239:0:5768:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783441382.131246:0:5768:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783441382.131254:0:5768:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073693235712 00000100:00100000:3.0:1783441382.131262:0:5768:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073693235712 00000100:00100000:3.0:1783441382.131299:0:5768:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073693235840 00000100:00100000:3.0:1783441382.131302:0:5768:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073693235840 00000100:00100000:3.0:1783441382.131311:0:5768:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073693235968 00000100:00100000:3.0:1783441382.131313:0:5768:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073693235968 00000100:00100000:3.0:1783441382.131321:0:5768:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073693236096 00000100:00100000:3.0:1783441382.131323:0:5768:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073693236096 00000100:00100000:3.0:1783441382.131331:0:5768:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073693236224 00000100:00100000:3.0:1783441382.131333:0:5768:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073693236224 00000100:00100000:3.0:1783441382.131341:0:5768:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073693236352 00000100:00100000:3.0:1783441382.131343:0:5768:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073693236352 00000100:00100000:3.0:1783441382.131362:0:5768:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073693236480 00000100:00100000:3.0:1783441382.131365:0:5768:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073693236480 00000100:00100000:3.0:1783441382.131377:0:5768:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:3.0:1783441382.131384:0:5768:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a859087b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:6c1ddb50-5795-40c6-a2b6-8f58add9da62+9:8297:x1870073693235712:12345-0@lo:104: 00010000:00010000:3.0:1783441382.131397:0:5768:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.113@tcp lock: ffff91a85f83c600/0xa2426164df2c7704 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400000000000 nid: local remote: 0xa2426164df2c770b expref: -99 pid: 5783 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783441382.131459:0:5768:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1783441382.131466:0:5768:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a859087b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:6c1ddb50-5795-40c6-a2b6-8f58add9da62+9:8297:x1870073693235712:12345-0@lo:104: Request processed in 82us (781us total) trans 0 rc 0/0 00000100:00100000:3.0:1783441382.131472:0:5768:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:3.0:1783441382.131488:0:5768:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:3.0:1783441382.131494:0:5768:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a746e1d850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:6c1ddb50-5795-40c6-a2b6-8f58add9da62+8:8297:x1870073693235840:12345-0@lo:104: 00010000:00010000:3.0:1783441382.131500:0:5768:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.113@tcp lock: ffff91a85f83ca00/0xa2426164df2c76da lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400000000000 nid: local remote: 0xa2426164df2c76e1 expref: -99 pid: 5783 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783441382.131530:0:5768:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:3.0:1783441382.131534:0:5768:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a746e1d850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:6c1ddb50-5795-40c6-a2b6-8f58add9da62+8:8297:x1870073693235840:12345-0@lo:104: Request processed in 42us (692us total) trans 0 rc 0/0 00000100:00100000:3.0:1783441382.131540:0:5768:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:1.0:1783441382.131664:0:8297:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff91a859086680 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8297:1870073693235712:0@lo:104: 00000100:00100000:1.0:1783441382.131673:0:8297:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff91a859085180 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8297:1870073693235840:0@lo:104: 00000100:00100000:3.0:1783441382.131723:0:5768:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:3.0:1783441382.131730:0:5768:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a87d4eb800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:6c1ddb50-5795-40c6-a2b6-8f58add9da62+7:8297:x1870073693235968:12345-0@lo:104: 00010000:00010000:1.0:1783441382.131793:0:5773:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1783441382.131799:0:5773:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.113@tcp lock: ffff91a85f83c600/0xa2426164df2c7704 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1400000000000 nid: local remote: 0xa2426164df2c770b expref: -99 pid: 5783 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783441382.131807:0:5773:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91a85f83c600 already unused, calling callback (ffffffffc1b78c20) 10000000:00010000:1.0:1783441382.131811:0:5773:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.113@tcp lock: ffff91a85f83c600/0xa2426164df2c7704 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1400400000000 nid: local remote: 0xa2426164df2c770b expref: -99 pid: 5783 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783441382.131819:0:5773:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.113@tcp lock: ffff91a85f83c600/0xa2426164df2c7704 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1408400000000 nid: local remote: 0xa2426164df2c770b expref: -99 pid: 5783 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1783441382.131833:0:5773:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.113@tcp lock: ffff91a85f83c600/0xa2426164df2c7704 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1409400000000 nid: local remote: 0xa2426164df2c770b expref: -99 pid: 5783 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1783441382.131839:0:5773:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:1.0:1783441382.131872:0:5773:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.113@tcp lock: ffff91a85f83c600/0xa2426164df2c7704 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x5c09400000020 nid: local remote: 0xa2426164df2c770b expref: -99 pid: 5783 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783441382.131879:0:5773:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1783441382.131901:0:5773:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.113@tcp lock: ffff91a85f83c600/0xa2426164df2c7704 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x5c09400000020 nid: local remote: 0xa2426164df2c770b expref: -99 pid: 5783 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783441382.131908:0:5773:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.113@tcp lock: ffff91a85f83c600/0xa2426164df2c7704 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x5c09400000020 nid: local remote: 0xa2426164df2c770b expref: -99 pid: 5783 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783441382.131921:0:5773:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1783441382.131924:0:5773:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.113@tcp lock: ffff91a85f83ca00/0xa2426164df2c76da lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400000000000 nid: local remote: 0xa2426164df2c76e1 expref: -99 pid: 5783 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783441382.131929:0:5773:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91a85f83ca00 already unused, calling callback (ffffffffc1b78c20) 10000000:00010000:1.0:1783441382.131932:0:5773:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.113@tcp lock: ffff91a85f83ca00/0xa2426164df2c76da lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400400000000 nid: local remote: 0xa2426164df2c76e1 expref: -99 pid: 5783 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783441382.131938:0:5773:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.113@tcp lock: ffff91a85f83ca00/0xa2426164df2c76da lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1408400000000 nid: local remote: 0xa2426164df2c76e1 expref: -99 pid: 5783 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1783441382.131944:0:5773:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.113@tcp lock: ffff91a85f83ca00/0xa2426164df2c76da lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1409400000000 nid: local remote: 0xa2426164df2c76e1 expref: -99 pid: 5783 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1783441382.131948:0:5773:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:1.0:1783441382.131969:0:5773:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.113@tcp lock: ffff91a85f83ca00/0xa2426164df2c76da lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5c09400000020 nid: local remote: 0xa2426164df2c76e1 expref: -99 pid: 5783 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783441382.131975:0:5773:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1783441382.131989:0:5773:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.113@tcp lock: ffff91a85f83ca00/0xa2426164df2c76da lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5c09400000020 nid: local remote: 0xa2426164df2c76e1 expref: -99 pid: 5783 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783441382.131995:0:5773:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.113@tcp lock: ffff91a85f83ca00/0xa2426164df2c76da lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5c09400000020 nid: local remote: 0xa2426164df2c76e1 expref: -99 pid: 5783 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783441382.132003:0:5773:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783441382.132005:0:5773:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783441382.132007:0:5773:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783441382.132048:0:5768:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.113@tcp lock: ffff91a841477200/0xa2426164df2c76be lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400000000000 nid: local remote: 0xa2426164df2c76c5 expref: -99 pid: 5783 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783441382.132134:0:5768:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1783441382.132141:0:5768:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a87d4eb800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:6c1ddb50-5795-40c6-a2b6-8f58add9da62+7:8297:x1870073693235968:12345-0@lo:104: Request processed in 412us (927us total) trans 0 rc 0/0 00000100:00100000:3.0:1783441382.132158:0:5768:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:3.0:1783441382.132173:0:5768:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:3.0:1783441382.132191:0:5768:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a87d4e8000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:6c1ddb50-5795-40c6-a2b6-8f58add9da62+6:8297:x1870073693236096:12345-0@lo:104: 00010000:00010000:3.0:1783441382.132200:0:5768:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.113@tcp lock: ffff91a841476400/0xa2426164df2c76b0 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400000000000 nid: local remote: 0xa2426164df2c76b7 expref: -99 pid: 5783 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783441382.132230:0:5768:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:3.0:1783441382.132235:0:5768:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a87d4e8000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:6c1ddb50-5795-40c6-a2b6-8f58add9da62+6:8297:x1870073693236096:12345-0@lo:104: Request processed in 57us (1009us total) trans 0 rc 0/0 00000100:00100000:3.0:1783441382.132241:0:5768:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:3.0:1783441382.132253:0:5768:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:3.0:1783441382.132259:0:5768:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a87d4e8e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:6c1ddb50-5795-40c6-a2b6-8f58add9da62+5:8297:x1870073693236224:12345-0@lo:104: 00010000:00010000:3.0:1783441382.132267:0:5768:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.113@tcp lock: ffff91a85f83da00/0xa2426164df2c76a2 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400000000000 nid: local remote: 0xa2426164df2c76a9 expref: -99 pid: 5783 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783441382.132291:0:5768:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to priority blp list, 3 blwis in pool 00000100:00100000:3.0:1783441382.132296:0:5768:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a87d4e8e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:6c1ddb50-5795-40c6-a2b6-8f58add9da62+5:8297:x1870073693236224:12345-0@lo:104: Request processed in 38us (1062us total) trans 0 rc 0/0 00000100:00100000:3.0:1783441382.132301:0:5768:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:3.0:1783441382.132312:0:5768:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:3.0:1783441382.132317:0:5768:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a87d4ea300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:6c1ddb50-5795-40c6-a2b6-8f58add9da62+4:8297:x1870073693236352:12345-0@lo:104: 00010000:00010000:3.0:1783441382.132324:0:5768:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.113@tcp lock: ffff91a841476e00/0xa2426164df2c7678 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400000000000 nid: local remote: 0xa2426164df2c767f expref: -99 pid: 7474 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783441382.132349:0:5768:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/4 locks to priority blp list, 4 blwis in pool 00000100:00100000:3.0:1783441382.132354:0:5768:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a87d4ea300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:6c1ddb50-5795-40c6-a2b6-8f58add9da62+4:8297:x1870073693236352:12345-0@lo:104: Request processed in 38us (1114us total) trans 0 rc 0/0 00000100:00100000:3.0:1783441382.132368:0:5768:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:3.0:1783441382.132381:0:5768:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:3.0:1783441382.132388:0:5768:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a87d4ea680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:6c1ddb50-5795-40c6-a2b6-8f58add9da62+3:8297:x1870073693236480:12345-0@lo:104: 00010000:00010000:3.0:1783441382.132396:0:5768:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.113@tcp lock: ffff91a85f83d000/0xa2426164df2c764e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400000000000 nid: local remote: 0xa2426164df2c7655 expref: -99 pid: 7474 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783441382.132421:0:5768:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/5 locks to priority blp list, 5 blwis in pool 00000100:00100000:3.0:1783441382.132426:0:5768:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a87d4ea680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:6c1ddb50-5795-40c6-a2b6-8f58add9da62+3:8297:x1870073693236480:12345-0@lo:104: Request processed in 40us (1178us total) trans 0 rc 0/0 00000100:00100000:3.0:1783441382.132432:0:5768:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00010000:00010000:3.0:1783441382.132446:0:5772:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 4 total in blp. (4 blwis in pool) 00010000:00010000:3.0:1783441382.132451:0:5772:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.113@tcp lock: ffff91a841477200/0xa2426164df2c76be lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400000000000 nid: local remote: 0xa2426164df2c76c5 expref: -99 pid: 5783 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783441382.132457:0:5772:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91a841477200 already unused, calling callback (ffffffffc1b78c20) 10000000:00010000:3.0:1783441382.132460:0:5772:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.113@tcp lock: ffff91a841477200/0xa2426164df2c76be lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400400000000 nid: local remote: 0xa2426164df2c76c5 expref: -99 pid: 5783 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783441382.132467:0:5772:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.113@tcp lock: ffff91a841477200/0xa2426164df2c76be lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1408400000000 nid: local remote: 0xa2426164df2c76c5 expref: -99 pid: 5783 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1783441382.132474:0:5772:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.113@tcp lock: ffff91a841477200/0xa2426164df2c76be lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1409400000000 nid: local remote: 0xa2426164df2c76c5 expref: -99 pid: 5783 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1783441382.132479:0:5772:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:3.0:1783441382.132492:0:5772:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.113@tcp lock: ffff91a841477200/0xa2426164df2c76be lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0xa2426164df2c76c5 expref: -99 pid: 5783 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783441382.132498:0:5772:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1783441382.132509:0:5772:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.113@tcp lock: ffff91a841477200/0xa2426164df2c76be lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0xa2426164df2c76c5 expref: -99 pid: 5783 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783441382.132515:0:5772:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.113@tcp lock: ffff91a841477200/0xa2426164df2c76be lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0xa2426164df2c76c5 expref: -99 pid: 5783 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783441382.132524:0:5772:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 3 total in blp. (3 blwis in pool) 00010000:00010000:3.0:1783441382.132527:0:5772:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.113@tcp lock: ffff91a841476400/0xa2426164df2c76b0 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0xa2426164df2c76b7 expref: -99 pid: 5783 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783441382.132532:0:5772:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91a841476400 already unused, calling callback (ffffffffc1b78c20) 10000000:00010000:3.0:1783441382.132535:0:5772:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.113@tcp lock: ffff91a841476400/0xa2426164df2c76b0 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1400400000000 nid: local remote: 0xa2426164df2c76b7 expref: -99 pid: 5783 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783441382.132541:0:5772:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.113@tcp lock: ffff91a841476400/0xa2426164df2c76b0 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1408400000000 nid: local remote: 0xa2426164df2c76b7 expref: -99 pid: 5783 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1783441382.132548:0:5772:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.113@tcp lock: ffff91a841476400/0xa2426164df2c76b0 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1409400000000 nid: local remote: 0xa2426164df2c76b7 expref: -99 pid: 5783 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1783441382.132553:0:5772:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:3.0:1783441382.132641:0:5772:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.113@tcp lock: ffff91a841476400/0xa2426164df2c76b0 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0xa2426164df2c76b7 expref: -99 pid: 5783 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783441382.132648:0:5772:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1783441382.132655:0:5772:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.113@tcp lock: ffff91a841476400/0xa2426164df2c76b0 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0xa2426164df2c76b7 expref: -99 pid: 5783 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783441382.132661:0:5772:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.113@tcp lock: ffff91a841476400/0xa2426164df2c76b0 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0xa2426164df2c76b7 expref: -99 pid: 5783 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783441382.132670:0:5772:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:3.0:1783441382.132678:0:5772:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.113@tcp lock: ffff91a85f83da00/0xa2426164df2c76a2 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xa2426164df2c76a9 expref: -99 pid: 5783 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783441382.132684:0:5772:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91a85f83da00 already unused, calling callback (ffffffffc1b78c20) 10000000:00010000:3.0:1783441382.132687:0:5772:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.113@tcp lock: ffff91a85f83da00/0xa2426164df2c76a2 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0xa2426164df2c76a9 expref: -99 pid: 5783 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783441382.132693:0:5772:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.113@tcp lock: ffff91a85f83da00/0xa2426164df2c76a2 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0xa2426164df2c76a9 expref: -99 pid: 5783 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1783441382.132699:0:5772:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.113@tcp lock: ffff91a85f83da00/0xa2426164df2c76a2 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0xa2426164df2c76a9 expref: -99 pid: 5783 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1783441382.132703:0:5772:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:3.0:1783441382.132717:0:5772:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.113@tcp lock: ffff91a85f83da00/0xa2426164df2c76a2 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xa2426164df2c76a9 expref: -99 pid: 5783 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783441382.132722:0:5772:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1783441382.132726:0:5772:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.113@tcp lock: ffff91a85f83da00/0xa2426164df2c76a2 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xa2426164df2c76a9 expref: -99 pid: 5783 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783441382.132731:0:5772:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.113@tcp lock: ffff91a85f83da00/0xa2426164df2c76a2 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xa2426164df2c76a9 expref: -99 pid: 5783 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783441382.132757:0:5772:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1783441382.132761:0:5772:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.113@tcp lock: ffff91a841476e00/0xa2426164df2c7678 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xa2426164df2c767f expref: -99 pid: 7474 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783441382.132767:0:5772:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91a841476e00 already unused, calling callback (ffffffffc1b78c20) 10000000:00010000:3.0:1783441382.132769:0:5772:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.113@tcp lock: ffff91a841476e00/0xa2426164df2c7678 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0xa2426164df2c767f expref: -99 pid: 7474 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783441382.132787:0:5772:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.113@tcp lock: ffff91a841476e00/0xa2426164df2c7678 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0xa2426164df2c767f expref: -99 pid: 7474 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1783441382.132793:0:5772:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.113@tcp lock: ffff91a841476e00/0xa2426164df2c7678 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0xa2426164df2c767f expref: -99 pid: 7474 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1783441382.132798:0:5772:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:3.0:1783441382.132811:0:5772:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.113@tcp lock: ffff91a841476e00/0xa2426164df2c7678 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xa2426164df2c767f expref: -99 pid: 7474 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783441382.132817:0:5772:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1783441382.132822:0:5772:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.113@tcp lock: ffff91a841476e00/0xa2426164df2c7678 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xa2426164df2c767f expref: -99 pid: 7474 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783441382.132828:0:5772:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.113@tcp lock: ffff91a841476e00/0xa2426164df2c7678 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xa2426164df2c767f expref: -99 pid: 7474 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783441382.132838:0:5772:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1783441382.132840:0:5772:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.113@tcp lock: ffff91a85f83d000/0xa2426164df2c764e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xa2426164df2c7655 expref: -99 pid: 7474 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783441382.132844:0:5772:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91a85f83d000 already unused, calling callback (ffffffffc1b78c20) 10000000:00010000:3.0:1783441382.132847:0:5772:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.113@tcp lock: ffff91a85f83d000/0xa2426164df2c764e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xa2426164df2c7655 expref: -99 pid: 7474 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783441382.132853:0:5772:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.113@tcp lock: ffff91a85f83d000/0xa2426164df2c764e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xa2426164df2c7655 expref: -99 pid: 7474 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1783441382.132859:0:5772:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.113@tcp lock: ffff91a85f83d000/0xa2426164df2c764e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xa2426164df2c7655 expref: -99 pid: 7474 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1783441382.132870:0:5772:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:3.0:1783441382.132882:0:5772:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.113@tcp lock: ffff91a85f83d000/0xa2426164df2c764e lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xa2426164df2c7655 expref: -99 pid: 7474 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783441382.132887:0:5772:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1783441382.132891:0:5772:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.113@tcp lock: ffff91a85f83d000/0xa2426164df2c764e lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xa2426164df2c7655 expref: -99 pid: 7474 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783441382.132896:0:5772:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.113@tcp lock: ffff91a85f83d000/0xa2426164df2c764e lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xa2426164df2c7655 expref: -99 pid: 7474 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783441382.132908:0:5772:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783441382.132909:0:5772:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783441382.132911:0:5772:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783441382.132918:0:5773:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1783441382.132988:0:3306:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff91a859085c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:6c1ddb50-5795-40c6-a2b6-8f58add9da62:3306:1870073693236608:0@lo:103: 00000100:00100000:2.0:1783441382.133027:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783441382.133068:0:3306:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff91a87d4e9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:6c1ddb50-5795-40c6-a2b6-8f58add9da62:3306:1870073693237120:0@lo:103: 00000100:00100000:2.0:1783441382.133088:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783441382.133107:0:3306:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1783441382.133112:0:3306:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff91a87d4e9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:6c1ddb50-5795-40c6-a2b6-8f58add9da62:3306:1870073693236992:0@lo:103: 00000100:00100000:2.0:1783441382.133128:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783441382.133164:0:3303:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff91a859087100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:6c1ddb50-5795-40c6-a2b6-8f58add9da62:3303:1870073693236736:0@lo:103: 00000100:00100000:2.0:1783441382.133195:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783441382.133204:0:3303:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff91a87d4eb100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:6c1ddb50-5795-40c6-a2b6-8f58add9da62:3303:1870073693237248:0@lo:103: 00000100:00100000:2.0:1783441382.133220:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783441382.133229:0:3303:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:2.0:1783441382.133234:0:3303:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff91a87d4ebb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:6c1ddb50-5795-40c6-a2b6-8f58add9da62:3303:1870073693236864:0@lo:103: 00000100:00100000:2.0:1783441382.133251:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783441382.133259:0:3303:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff91a87d4e9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:6c1ddb50-5795-40c6-a2b6-8f58add9da62:3303:1870073693237376:0@lo:103: 00000100:00100000:2.0:1783441382.133277:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783441382.133294:0:5769:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073693236608 00000100:00100000:2.0:1783441382.133298:0:5769:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073693236608 00010000:00010000:2.0:1783441382.133327:0:5769:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff91a840031000/0xa2426164df2c770b lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xa2426164df2c7704 expref: 19 pid: 5778 timeout: 370 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783441382.133343:0:5769:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073693237120 00000100:00100000:2.0:1783441382.133345:0:5769:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073693237120 00010000:00010000:2.0:1783441382.133354:0:5769:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff91a841476000/0xa2426164df2c76a9 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xa2426164df2c76a2 expref: 20 pid: 5780 timeout: 370 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783441382.133362:0:5769:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073693236992 00000100:00100000:2.0:1783441382.133364:0:5769:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073693236992 00010000:00010000:2.0:1783441382.133372:0:5769:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff91a841477c00/0xa2426164df2c76b7 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xa2426164df2c76b0 expref: 21 pid: 5778 timeout: 370 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783441382.133380:0:5769:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073693236736 00000100:00100000:2.0:1783441382.133382:0:5769:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073693236736 00010000:00010000:2.0:1783441382.133390:0:5769:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff91a85f83c200/0xa2426164df2c76e1 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xa2426164df2c76da expref: 22 pid: 5780 timeout: 370 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783441382.133398:0:5769:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073693237248 00000100:00100000:2.0:1783441382.133400:0:5769:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073693237248 00010000:00010000:2.0:1783441382.133408:0:5769:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff91a85eb3d000/0xa2426164df2c767f lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xa2426164df2c7678 expref: 23 pid: 5780 timeout: 370 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783441382.133416:0:5769:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073693236864 00000100:00100000:2.0:1783441382.133418:0:5769:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073693236864 00010000:00010000:2.0:1783441382.133427:0:5769:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff91a85eb3d600/0xa2426164df2c76c5 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xa2426164df2c76be expref: 24 pid: 5780 timeout: 370 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783441382.133436:0:5769:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073693237376 00000100:00100000:2.0:1783441382.133438:0:5769:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073693237376 00010000:00010000:2.0:1783441382.133448:0:5769:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff91a841477400/0xa2426164df2c7655 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xa2426164df2c764e expref: 25 pid: 5779 timeout: 370 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783441382.133458:0:5769:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:2.0:1783441382.133472:0:5769:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a846f24380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:6c1ddb50-5795-40c6-a2b6-8f58add9da62+25:3306:x1870073693236608:12345-0@lo:103: 00010000:00010000:2.0:1783441382.133484:0:5769:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1783441382.133490:0:5769:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff91a840031000/0xa2426164df2c770b lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xa2426164df2c7704 expref: 25 pid: 5778 timeout: 370 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783441382.133500:0:5769:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff91a840031000/0xa2426164df2c770b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xa2426164df2c7704 expref: 25 pid: 5778 timeout: 370 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783441382.133517:0:5769:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff91a840031000/0xa2426164df2c770b lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xa2426164df2c7704 expref: 25 pid: 5778 timeout: 370 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783441382.133533:0:5769:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1783441382.133731:0:5769:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a846f24380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:6c1ddb50-5795-40c6-a2b6-8f58add9da62+24:3306:x1870073693236608:12345-0@lo:103: Request processed in 259us (704us total) trans 0 rc 0/0 00000100:00100000:2.0:1783441382.134718:0:5769:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:2.0:1783441382.134770:0:5769:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:2.0:1783441382.134783:0:5769:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a846f25500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:6c1ddb50-5795-40c6-a2b6-8f58add9da62+23:3306:x1870073693237120:12345-0@lo:103: 00010000:00010000:2.0:1783441382.134799:0:5769:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1783441382.134807:0:5769:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff91a841476000/0xa2426164df2c76a9 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xa2426164df2c76a2 expref: 23 pid: 5780 timeout: 370 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783441382.134819:0:5769:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff91a841476000/0xa2426164df2c76a9 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xa2426164df2c76a2 expref: 23 pid: 5780 timeout: 370 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783441382.134837:0:5769:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1783441382.134883:0:5769:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a846f25500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:6c1ddb50-5795-40c6-a2b6-8f58add9da62+23:3306:x1870073693237120:12345-0@lo:103: Request processed in 105us (1794us total) trans 0 rc 0/0 00000100:00100000:2.0:1783441382.134891:0:5769:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:2.0:1783441382.134904:0:5769:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:2.0:1783441382.134921:0:5769:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a846f24e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:6c1ddb50-5795-40c6-a2b6-8f58add9da62+22:3306:x1870073693236992:12345-0@lo:103: 00010000:00010000:2.0:1783441382.134929:0:5769:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1783441382.134933:0:5769:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff91a841477c00/0xa2426164df2c76b7 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xa2426164df2c76b0 expref: 22 pid: 5778 timeout: 370 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783441382.134943:0:5769:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff91a841477c00/0xa2426164df2c76b7 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xa2426164df2c76b0 expref: 22 pid: 5778 timeout: 370 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783441382.134952:0:5769:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1783441382.134972:0:5769:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a846f24e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:6c1ddb50-5795-40c6-a2b6-8f58add9da62+22:3306:x1870073693236992:12345-0@lo:103: Request processed in 51us (1842us total) trans 0 rc 0/0 00000100:00100000:2.0:1783441382.134978:0:5769:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:2.0:1783441382.134990:0:5769:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:2.0:1783441382.134996:0:5769:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a875691c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:6c1ddb50-5795-40c6-a2b6-8f58add9da62+21:3303:x1870073693236736:12345-0@lo:103: 00010000:00010000:2.0:1783441382.135002:0:5769:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1783441382.135007:0:5769:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff91a85f83c200/0xa2426164df2c76e1 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xa2426164df2c76da expref: 21 pid: 5780 timeout: 370 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783441382.135015:0:5769:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff91a85f83c200/0xa2426164df2c76e1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xa2426164df2c76da expref: 21 pid: 5780 timeout: 370 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783441382.135024:0:5769:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff91a85f83c200/0xa2426164df2c76e1 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xa2426164df2c76da expref: 21 pid: 5780 timeout: 370 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783441382.135036:0:5769:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1783441382.135061:0:5769:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a875691c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:6c1ddb50-5795-40c6-a2b6-8f58add9da62+20:3303:x1870073693236736:12345-0@lo:103: Request processed in 65us (1865us total) trans 0 rc 0/0 00000100:00100000:2.0:1783441382.135067:0:5769:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:2.0:1783441382.135080:0:5769:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:2.0:1783441382.135091:0:5769:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a875690700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:6c1ddb50-5795-40c6-a2b6-8f58add9da62+19:3303:x1870073693237248:12345-0@lo:103: 00010000:00010000:2.0:1783441382.135099:0:5769:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1783441382.135104:0:5769:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff91a85eb3d000/0xa2426164df2c767f lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xa2426164df2c7678 expref: 19 pid: 5780 timeout: 370 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783441382.135112:0:5769:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff91a85eb3d000/0xa2426164df2c767f lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xa2426164df2c7678 expref: 19 pid: 5780 timeout: 370 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783441382.135122:0:5769:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1783441382.135142:0:5769:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a875690700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:6c1ddb50-5795-40c6-a2b6-8f58add9da62+19:3303:x1870073693237248:12345-0@lo:103: Request processed in 52us (1921us total) trans 0 rc 0/0 00000100:00100000:2.0:1783441382.135148:0:5769:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:2.0:1783441382.135161:0:5769:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:2.0:1783441382.135166:0:5769:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a867cd4e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:6c1ddb50-5795-40c6-a2b6-8f58add9da62+18:3303:x1870073693236864:12345-0@lo:103: 00010000:00010000:2.0:1783441382.135174:0:5769:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1783441382.135191:0:5769:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff91a85eb3d600/0xa2426164df2c76c5 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xa2426164df2c76be expref: 18 pid: 5780 timeout: 370 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783441382.135200:0:5769:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff91a85eb3d600/0xa2426164df2c76c5 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xa2426164df2c76be expref: 18 pid: 5780 timeout: 370 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783441382.135209:0:5769:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1783441382.135230:0:5769:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a867cd4e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:6c1ddb50-5795-40c6-a2b6-8f58add9da62+18:3303:x1870073693236864:12345-0@lo:103: Request processed in 64us (1977us total) trans 0 rc 0/0 00000100:00100000:2.0:1783441382.135236:0:5769:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:2.0:1783441382.135247:0:5769:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:2.0:1783441382.135253:0:5769:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a84545b850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:6c1ddb50-5795-40c6-a2b6-8f58add9da62+17:3303:x1870073693237376:12345-0@lo:103: 00010000:00010000:2.0:1783441382.135260:0:5769:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1783441382.135270:0:5769:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff91a841477400/0xa2426164df2c7655 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xa2426164df2c764e expref: 17 pid: 5779 timeout: 370 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783441382.135278:0:5769:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff91a841477400/0xa2426164df2c7655 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xa2426164df2c764e expref: 17 pid: 5779 timeout: 370 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783441382.135287:0:5769:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1783441382.135309:0:5769:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a84545b850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:6c1ddb50-5795-40c6-a2b6-8f58add9da62+17:3303:x1870073693237376:12345-0@lo:103: Request processed in 56us (2030us total) trans 0 rc 0/0 00000100:00100000:2.0:1783441382.135314:0:5769:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:2.0:1783441382.135387:0:3306:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff91a87d4e9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:6c1ddb50-5795-40c6-a2b6-8f58add9da62:3306:1870073693236992:0@lo:103: 00000100:00100000:2.0:1783441382.135398:0:3306:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff91a859085c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:6c1ddb50-5795-40c6-a2b6-8f58add9da62:3306:1870073693236608:0@lo:103: 00000100:00100000:2.0:1783441382.135405:0:3306:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff91a87d4e9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:6c1ddb50-5795-40c6-a2b6-8f58add9da62:3306:1870073693237120:0@lo:103: 00000100:00100000:2.0:1783441382.135440:0:3303:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff91a87d4ebb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:6c1ddb50-5795-40c6-a2b6-8f58add9da62:3303:1870073693236864:0@lo:103: 00000100:00100000:2.0:1783441382.135447:0:3303:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff91a87d4e9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:6c1ddb50-5795-40c6-a2b6-8f58add9da62:3303:1870073693237376:0@lo:103: 00000100:00100000:2.0:1783441382.135452:0:3303:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff91a859087100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:6c1ddb50-5795-40c6-a2b6-8f58add9da62:3303:1870073693236736:0@lo:103: 00000100:00100000:2.0:1783441382.135459:0:3303:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff91a87d4eb100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:6c1ddb50-5795-40c6-a2b6-8f58add9da62:3303:1870073693237248:0@lo:103: 00010000:00010000:1.0:1783441382.138703:0:8297:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff91a85eb3d600/0xa2426164df2c76c5 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xa2426164df2c76be expref: 16 pid: 5780 timeout: 370 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783441382.138721:0:8297:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff91a859086d80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8297:1870073693235968:0@lo:104: 00010000:00010000:2.0:1783441382.139509:0:8297:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff91a841477c00/0xa2426164df2c76b7 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xa2426164df2c76b0 expref: 15 pid: 5778 timeout: 370 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783441382.139523:0:8297:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff91a859084a80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8297:1870073693236096:0@lo:104: 00010000:00010000:2.0:1783441382.139535:0:8297:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff91a841476000/0xa2426164df2c76a9 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xa2426164df2c76a2 expref: 14 pid: 5780 timeout: 370 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783441382.139545:0:8297:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff91a859086a00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8297:1870073693236224:0@lo:104: 00010000:00010000:2.0:1783441382.139641:0:8297:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff91a85eb3d000/0xa2426164df2c767f lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xa2426164df2c7678 expref: 13 pid: 5780 timeout: 370 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783441382.139651:0:8297:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff91a859085f80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8297:1870073693236352:0@lo:104: 00010000:00010000:2.0:1783441382.139660:0:8297:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff91a841477400/0xa2426164df2c7655 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xa2426164df2c764e expref: 12 pid: 5779 timeout: 370 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783441382.139668:0:8297:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff91a859084700 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8297:1870073693236480:0@lo:104: 00000100:00100000:2.0:1783441382.165482:0:8297:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff91a87d6a1180 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8297:1870073693235456:192.168.201.13@tcp:104: 00000100:00100000:3.0:1783441382.167719:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.13@tcp (source: 12345-192.168.201.13@tcp) 00000100:00100000:3.0:1783441382.167789:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.13@tcp (source: 12345-192.168.201.13@tcp) 00000100:00100000:1.0:1783441382.167854:0:5771:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073673289728 00000100:00100000:1.0:1783441382.167863:0:5771:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073673289728 00010000:00010000:1.0:1783441382.167897:0:5771:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff91a85f83cc00/0xa2426164df2c7720 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.201.13@tcp remote: 0x633a354aa4df4c39 expref: 10 pid: 5778 timeout: 320 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783441382.167930:0:5771:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073673289856 00000100:00100000:1.0:1783441382.167933:0:5771:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073673289856 00010000:00010000:1.0:1783441382.167958:0:5771:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff91a840031800/0xa2426164df2c7719 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.201.13@tcp remote: 0x633a354aa4df4c32 expref: 11 pid: 5779 timeout: 320 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783441382.167971:0:5771:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.13@tcp, seq: 19 00000100:00100000:1.0:1783441382.167979:0:5771:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a87d4eaa00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:51c2a82e-e792-4f56-84e8-12cc033e9e70+11:2354:x1870073673289728:12345-192.168.201.13@tcp:103: 00010000:00010000:1.0:1783441382.167993:0:5771:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1783441382.168010:0:5771:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff91a85f83cc00/0xa2426164df2c7720 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 192.168.201.13@tcp remote: 0x633a354aa4df4c39 expref: 11 pid: 5778 timeout: 320 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783441382.168021:0:5771:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff91a85f83cc00/0xa2426164df2c7720 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 192.168.201.13@tcp remote: 0x633a354aa4df4c39 expref: 11 pid: 5778 timeout: 320 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783441382.168037:0:5771:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff91a85f83cc00/0xa2426164df2c7720 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 192.168.201.13@tcp remote: 0x633a354aa4df4c39 expref: 11 pid: 5778 timeout: 320 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783441382.168052:0:5771:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1783441382.168097:0:5771:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a87d4eaa00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:51c2a82e-e792-4f56-84e8-12cc033e9e70+10:2354:x1870073673289728:12345-192.168.201.13@tcp:103: Request processed in 118us (388us total) trans 0 rc 0/0 00000100:00100000:1.0:1783441382.168104:0:5771:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.13@tcp, seq: 19 00000100:00100000:1.0:1783441382.168138:0:5771:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.13@tcp, seq: 20 00000100:00100000:1.0:1783441382.168144:0:5771:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a87d4e8a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:51c2a82e-e792-4f56-84e8-12cc033e9e70+9:2354:x1870073673289856:12345-192.168.201.13@tcp:103: 00010000:00010000:1.0:1783441382.168151:0:5771:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1783441382.168155:0:5771:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff91a840031800/0xa2426164df2c7719 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.201.13@tcp remote: 0x633a354aa4df4c32 expref: 9 pid: 5779 timeout: 320 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783441382.168163:0:5771:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff91a840031800/0xa2426164df2c7719 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 192.168.201.13@tcp remote: 0x633a354aa4df4c32 expref: 9 pid: 5779 timeout: 320 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783441382.168174:0:5771:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff91a87da47000/0xa2426164df2c7758 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 8297 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783441382.168193:0:5771:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff91a87da47000/0xa2426164df2c7758 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 8297 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783441382.168214:0:5771:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff91a87da47000/0xa2426164df2c7758 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 8297 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783441382.168230:0:5771:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff91a87da47000/0xa2426164df2c7758 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 8297 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783441382.168237:0:5771:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff91a87da47000/0xa2426164df2c7758 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 8297 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783441382.168243:0:5771:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff91a87da47000/0xa2426164df2c7758 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 8297 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783441382.168249:0:5771:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91a87da47000 already unused, calling callback (ffffffffc155ff90) 00010000:00010000:1.0:1783441382.168253:0:5771:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff91a87da47000/0xa2426164df2c7758 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 8297 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783441382.168260:0:5771:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff91a87da47000/0xa2426164df2c7758 lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 8297 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783441382.168268:0:5771:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff91a87da47000/0xa2426164df2c7758 lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 8297 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783441382.168276:0:5771:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1783441382.168293:0:5771:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a87d4e8a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:51c2a82e-e792-4f56-84e8-12cc033e9e70+9:2354:x1870073673289856:12345-192.168.201.13@tcp:103: Request processed in 149us (504us total) trans 0 rc 0/0 00000100:00100000:1.0:1783441382.168299:0:5771:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.13@tcp, seq: 20 00010000:00010000:2.0:1783441382.171022:0:8297:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff91a840031800/0xa2426164df2c7719 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x44801400000020 nid: 192.168.201.13@tcp remote: 0x633a354aa4df4c32 expref: 8 pid: 5779 timeout: 320 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783441382.171048:0:8297:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff91a87d6a3800 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8297:1870073693235584:192.168.201.13@tcp:104: 00010000:00010000:2.0:1783441382.171100:0:8297:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff91a87da47000/0xa2426164df2c7758 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 8297 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783441382.171404:0:8297:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff91a87da47000/0xa2426164df2c7758 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 8297 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783441382.171411:0:8297:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff91a87da47000/0xa2426164df2c7758 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 8297 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783441382.171470:0:8297:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff91a87da47000/0xa2426164df2c7758 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 8297 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783441382.267264:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.13@tcp (source: 12345-192.168.201.13@tcp) 00000100:00100000:0.0:1783441382.267301:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.13@tcp (source: 12345-192.168.201.13@tcp) 00000100:00100000:0.0:1783441382.267339:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.13@tcp (source: 12345-192.168.201.13@tcp) 00000100:00100000:2.0:1783441382.267396:0:6582:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073673290240 00000100:00100000:2.0:1783441382.267409:0:6582:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073673290240 00000100:00100000:2.0:1783441382.267477:0:6582:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073673290112 00000100:00100000:2.0:1783441382.267481:0:6582:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073673290112 00000100:00100000:2.0:1783441382.267513:0:6582:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.13@tcp, seq: 13 00000100:00100000:2.0:1783441382.267522:0:6582:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a844b7f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:65454767-383a-4679-a788-eba05c6e0989+5:2354:x1870073673290240:12345-192.168.201.13@tcp:400: 00000100:00100000:2.0:1783441382.267593:0:6582:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a844b7f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:65454767-383a-4679-a788-eba05c6e0989+5:2354:x1870073673290240:12345-192.168.201.13@tcp:400: Request processed in 72us (290us total) trans 0 rc 0/0 00000100:00100000:2.0:1783441382.267602:0:6582:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.13@tcp, seq: 13 00000100:00100000:2.0:1783441382.267618:0:6582:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.13@tcp, seq: 14 00000100:00100000:2.0:1783441382.267626:0:6582:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a844b7d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:65454767-383a-4679-a788-eba05c6e0989+5:2354:x1870073673290112:12345-192.168.201.13@tcp:400: 00000100:00100000:2.0:1783441382.267652:0:6582:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a844b7d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:65454767-383a-4679-a788-eba05c6e0989+5:2354:x1870073673290112:12345-192.168.201.13@tcp:400: Request processed in 27us (313us total) trans 0 rc 0/0 00000100:00100000:2.0:1783441382.267658:0:6582:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.13@tcp, seq: 14 00000100:00100000:3.0:1783441382.267776:0:5785:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073673289984 00000100:00100000:3.0:1783441382.267780:0:5785:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073673289984 00000100:00100000:3.0:1783441382.267815:0:5785:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.13@tcp, seq: 29 00000100:00100000:3.0:1783441382.267822:0:5785:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a844b7e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:65454767-383a-4679-a788-eba05c6e0989+6:2354:x1870073673289984:12345-192.168.201.13@tcp:400: 00000100:00100000:3.0:1783441382.267851:0:5785:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a844b7e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:65454767-383a-4679-a788-eba05c6e0989+6:2354:x1870073673289984:12345-192.168.201.13@tcp:400: Request processed in 30us (599us total) trans 0 rc 0/0 00000100:00100000:3.0:1783441382.267857:0:5785:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.13@tcp, seq: 29 00000100:00080000:0.0:1783441382.268196:0:5781:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1783441382.268203:0:5781:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1783441382.268205:0:5781:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00010000:3.0:1783441382.509285:0:5772:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:2.0:1783441383.213636:0:5783:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:2.0:1783441383.213644:0:5783:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-client-ffff91a875566000 from 39 10000000:01000000:2.0:1783441383.213649:0:5783:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:2.0:1783441383.213712:0:5783:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.113@tcp lock: ffff91a85f83c200/0xa2426164df2c775f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5783 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783441383.213725:0:5783:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.113@tcp lock: ffff91a85f83c200/0xa2426164df2c775f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5783 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783441383.213738:0:5783:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.113@tcp lock: ffff91a85f83c200/0xa2426164df2c775f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5783 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783441383.213794:0:5783:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff91a867cd4e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6c1ddb50-5795-40c6-a2b6-8f58add9da62:5783:1870073693237504:0@lo:101: 00000100:00100000:2.0:1783441383.213893:0:5783:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783441383.213964:0:5783:0:(client.c:2702:ptlrpc_set_wait()) set ffff91a747979cc0 going to sleep for 11 seconds 00000100:00100000:0.0:1783441383.214232:0:5779:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073693237504 00000100:00100000:0.0:1783441383.214241:0:5779:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073693237504 00000100:00100000:0.0:1783441383.214310:0:5779:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 131 00000100:00100000:0.0:1783441383.214319:0:5779:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a8484ba850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6c1ddb50-5795-40c6-a2b6-8f58add9da62+12:5783:x1870073693237504:12345-0@lo:101: 00010000:00010000:0.0:1783441383.214340:0:5779:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1783441383.214355:0:5779:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff91a840030600/0xa2426164df2c7766 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xa2426164df2c775f expref: -99 pid: 5779 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783441383.214377:0:5779:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff91a840030600/0xa2426164df2c7766 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xa2426164df2c775f expref: 13 pid: 5779 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783441383.214387:0:5779:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff91a840030600/0xa2426164df2c7766 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xa2426164df2c775f expref: 13 pid: 5779 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783441383.214396:0:5779:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91a840030600, rc 0) 00000100:00100000:0.0:1783441383.214447:0:5779:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a8484ba850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6c1ddb50-5795-40c6-a2b6-8f58add9da62+13:5783:x1870073693237504:12345-0@lo:101: Request processed in 129us (555us total) trans 0 rc 0/0 00000100:00100000:0.0:1783441383.214454:0:5779:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 131 00000100:00100000:1.0:1783441383.214665:0:5783:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff91a867cd4e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6c1ddb50-5795-40c6-a2b6-8f58add9da62:5783:1870073693237504:0@lo:101: 00010000:00010000:1.0:1783441383.214679:0:5783:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.113@tcp lock: ffff91a85f83c200/0xa2426164df2c775f lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xa2426164df2c7766 expref: -99 pid: 5783 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783441383.214688:0:5783:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.113@tcp lock: ffff91a85f83c200/0xa2426164df2c775f lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xa2426164df2c7766 expref: -99 pid: 5783 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783441383.214791:0:5783:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff91a859084e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6c1ddb50-5795-40c6-a2b6-8f58add9da62:5783:1870073693237632:0@lo:501: 00000100:00100000:1.0:1783441383.214820:0:5783:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783441383.214851:0:5783:0:(client.c:2702:ptlrpc_set_wait()) set ffff91a8486303c0 going to sleep for 11 seconds 00000100:00100000:3.0:1783441383.215030:0:5780:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073693237632 00000100:00100000:3.0:1783441383.215036:0:5780:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073693237632 00000100:00100000:3.0:1783441383.215071:0:5780:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 132 00000100:00100000:3.0:1783441383.215085:0:5780:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a848f75050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6c1ddb50-5795-40c6-a2b6-8f58add9da62+13:5783:x1870073693237632:12345-0@lo:501: 00000100:00100000:3.0:1783441383.215413:0:5780:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a848f75050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6c1ddb50-5795-40c6-a2b6-8f58add9da62+13:5783:x1870073693237632:12345-0@lo:501: Request processed in 328us (591us total) trans 0 rc 0/0 00000100:00100000:3.0:1783441383.215420:0:5780:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 132 00000100:00100000:1.0:1783441383.216397:0:5783:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff91a859084e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6c1ddb50-5795-40c6-a2b6-8f58add9da62:5783:1870073693237632:0@lo:501: 00000100:00100000:1.0:1783441383.216448:0:5783:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff91a859084e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6c1ddb50-5795-40c6-a2b6-8f58add9da62:5783:1870073693237760:0@lo:503: 00000100:00100000:1.0:1783441383.216519:0:5783:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783441383.216556:0:5783:0:(client.c:2702:ptlrpc_set_wait()) set ffff91a8486303c0 going to sleep for 11 seconds 00000100:00100000:2.0:1783441383.216613:0:5778:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073693237760 00000100:00100000:2.0:1783441383.216620:0:5778:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073693237760 00000100:00100000:2.0:1783441383.216667:0:5778:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 133 00000100:00100000:2.0:1783441383.216683:0:5778:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a848f74c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6c1ddb50-5795-40c6-a2b6-8f58add9da62+13:5783:x1870073693237760:12345-0@lo:503: 00000100:00100000:2.0:1783441383.216913:0:5778:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a848f74c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6c1ddb50-5795-40c6-a2b6-8f58add9da62+13:5783:x1870073693237760:12345-0@lo:503: Request processed in 230us (393us total) trans 0 rc 0/0 00000100:00100000:2.0:1783441383.216921:0:5778:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 133 00000100:00100000:1.0:1783441383.217224:0:5783:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff91a859084e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6c1ddb50-5795-40c6-a2b6-8f58add9da62:5783:1870073693237760:0@lo:503: 00000100:00100000:1.0:1783441383.217895:0:8313:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff91a859084e00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:6c1ddb50-5795-40c6-a2b6-8f58add9da62:8313:1870073693237888:0@lo:502: 00000100:00100000:1.0:1783441383.217956:0:8313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783441383.217990:0:8313:0:(client.c:2702:ptlrpc_set_wait()) set ffff91a848630300 going to sleep for 11 seconds 00000100:00100000:2.0:1783441383.218176:0:5778:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073693237888 00000100:00100000:2.0:1783441383.218181:0:5778:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073693237888 00000100:00100000:2.0:1783441383.218219:0:5778:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 134 00000100:00100000:2.0:1783441383.218227:0:5778:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a848f74850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6c1ddb50-5795-40c6-a2b6-8f58add9da62+13:8313:x1870073693237888:12345-0@lo:502: 00000100:00100000:2.0:1783441383.218459:0:5778:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a848f74850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6c1ddb50-5795-40c6-a2b6-8f58add9da62+13:8313:x1870073693237888:12345-0@lo:502: Request processed in 232us (502us total) trans 0 rc 0/0 00000100:00100000:2.0:1783441383.218467:0:5778:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 134 00000100:00100000:1.0:1783441383.218560:0:8313:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff91a859084e00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:6c1ddb50-5795-40c6-a2b6-8f58add9da62:8313:1870073693237888:0@lo:502: 00000100:00100000:1.0:1783441383.218614:0:8313:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff91a859084e00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:6c1ddb50-5795-40c6-a2b6-8f58add9da62:8313:1870073693238016:0@lo:502: 00000100:00100000:1.0:1783441383.218657:0:8313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783441383.218677:0:8313:0:(client.c:2702:ptlrpc_set_wait()) set ffff91a848630300 going to sleep for 11 seconds 00000100:00100000:0.0:1783441383.218993:0:5779:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073693238016 00000100:00100000:0.0:1783441383.218998:0:5779:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073693238016 00000100:00100000:0.0:1783441383.219042:0:5779:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 135 00000100:00100000:0.0:1783441383.219049:0:5779:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a848f76450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6c1ddb50-5795-40c6-a2b6-8f58add9da62+13:8313:x1870073693238016:12345-0@lo:502: 00000100:00100000:0.0:1783441383.219210:0:5779:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a848f76450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6c1ddb50-5795-40c6-a2b6-8f58add9da62+13:8313:x1870073693238016:12345-0@lo:502: Request processed in 161us (551us total) trans 0 rc 0/0 00000100:00100000:0.0:1783441383.219217:0:5779:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 135 00000100:00100000:1.0:1783441383.219287:0:8313:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff91a859084e00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:6c1ddb50-5795-40c6-a2b6-8f58add9da62:8313:1870073693238016:0@lo:502: 00000040:00080000:1.0:1783441383.219311:0:8313:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 42 count 42 00000020:01000000:0.0:1783441383.219782:0:5783:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 39-41 (rc=0) 10000000:01000000:0.0:1783441383.219799:0:5783:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.201.113@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:0.0:1783441383.219808:0:5783:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.113@tcp lock: ffff91a85f83c200/0xa2426164df2c775f lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xa2426164df2c7766 expref: -99 pid: 5783 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783441383.219820:0:5783:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.113@tcp lock: ffff91a85f83c200/0xa2426164df2c775f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xa2426164df2c7766 expref: -99 pid: 5783 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1783441383.219831:0:5783:0:(mgc_request.c:611:do_requeue()) updating log lustre-OST0001 10000000:01000000:0.0:1783441383.219834:0:5783:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-OST0001-0000000000000000 from 8 10000000:01000000:0.0:1783441383.219836:0:5783:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0001 (res 0x65727473756c) 00010000:00010000:0.0:1783441383.219862:0:5783:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.113@tcp lock: ffff91a840030800/0xa2426164df2c776d lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5783 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783441383.219870:0:5783:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.113@tcp lock: ffff91a840030800/0xa2426164df2c776d lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5783 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783441383.219879:0:5783:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.113@tcp lock: ffff91a840030800/0xa2426164df2c776d lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5783 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783441383.219895:0:5783:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff91a844b7c000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6c1ddb50-5795-40c6-a2b6-8f58add9da62:5783:1870073693238144:0@lo:101: 00000100:00100000:0.0:1783441383.219938:0:5783:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783441383.219964:0:5783:0:(client.c:2702:ptlrpc_set_wait()) set ffff91a844c90480 going to sleep for 11 seconds 00000100:00100000:3.0:1783441383.219992:0:5780:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073693238144 00000100:00100000:3.0:1783441383.219997:0:5780:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073693238144 00000100:00100000:3.0:1783441383.220022:0:5780:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 136 00000100:00100000:3.0:1783441383.220029:0:5780:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a848f76c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6c1ddb50-5795-40c6-a2b6-8f58add9da62+13:5783:x1870073693238144:12345-0@lo:101: 00010000:00010000:3.0:1783441383.220039:0:5780:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1783441383.220052:0:5780:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff91a85eb3d400/0xa2426164df2c7774 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xa2426164df2c776d expref: -99 pid: 5780 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783441383.220072:0:5780:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff91a85eb3d400/0xa2426164df2c7774 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xa2426164df2c776d expref: 14 pid: 5780 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783441383.220082:0:5780:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff91a85eb3d400/0xa2426164df2c7774 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xa2426164df2c776d expref: 14 pid: 5780 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783441383.220090:0:5780:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91a85eb3d400, rc 0) 00000100:00100000:3.0:1783441383.220128:0:5780:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a848f76c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6c1ddb50-5795-40c6-a2b6-8f58add9da62+14:5783:x1870073693238144:12345-0@lo:101: Request processed in 99us (189us total) trans 0 rc 0/0 00000100:00100000:3.0:1783441383.220133:0:5780:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 136 00000100:00100000:0.0:1783441383.220220:0:5783:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff91a844b7c000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6c1ddb50-5795-40c6-a2b6-8f58add9da62:5783:1870073693238144:0@lo:101: 00010000:00010000:0.0:1783441383.220242:0:5783:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.113@tcp lock: ffff91a840030800/0xa2426164df2c776d lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xa2426164df2c7774 expref: -99 pid: 5783 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783441383.220250:0:5783:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.113@tcp lock: ffff91a840030800/0xa2426164df2c776d lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xa2426164df2c7774 expref: -99 pid: 5783 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783441383.220544:0:5783:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff91a844b7c000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6c1ddb50-5795-40c6-a2b6-8f58add9da62:5783:1870073693238272:0@lo:501: 00000100:00100000:0.0:1783441383.220705:0:5783:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783441383.220728:0:5783:0:(client.c:2702:ptlrpc_set_wait()) set ffff91a844c90480 going to sleep for 11 seconds 00000100:00100000:3.0:1783441383.220811:0:5780:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073693238272 00000100:00100000:3.0:1783441383.220816:0:5780:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073693238272 00000100:00100000:3.0:1783441383.220860:0:5780:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 137 00000100:00100000:3.0:1783441383.220868:0:5780:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a848f77c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6c1ddb50-5795-40c6-a2b6-8f58add9da62+14:5783:x1870073693238272:12345-0@lo:501: 00000100:00100000:3.0:1783441383.221604:0:5780:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a848f77c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6c1ddb50-5795-40c6-a2b6-8f58add9da62+14:5783:x1870073693238272:12345-0@lo:501: Request processed in 735us (897us total) trans 0 rc 0/0 00000100:00100000:3.0:1783441383.221622:0:5780:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 137 00000100:00100000:0.0:1783441383.221736:0:5783:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff91a844b7c000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6c1ddb50-5795-40c6-a2b6-8f58add9da62:5783:1870073693238272:0@lo:501: 00000100:00100000:0.0:1783441383.221790:0:5783:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff91a844b7c000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6c1ddb50-5795-40c6-a2b6-8f58add9da62:5783:1870073693238400:0@lo:503: 00000100:00100000:0.0:1783441383.221842:0:5783:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783441383.222628:0:5783:0:(client.c:2702:ptlrpc_set_wait()) set ffff91a844c90480 going to sleep for 11 seconds 00000100:00100000:2.0:1783441383.223545:0:5779:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073693238400 00000100:00100000:2.0:1783441383.223555:0:5779:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073693238400 00000100:00100000:2.0:1783441383.223611:0:5779:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 138 00000100:00100000:2.0:1783441383.223622:0:5779:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a848f76050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6c1ddb50-5795-40c6-a2b6-8f58add9da62+14:5783:x1870073693238400:12345-0@lo:503: 00000100:00100000:2.0:1783441383.223895:0:5779:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a848f76050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6c1ddb50-5795-40c6-a2b6-8f58add9da62+14:5783:x1870073693238400:12345-0@lo:503: Request processed in 274us (2051us total) trans 0 rc 0/0 00000100:00100000:2.0:1783441383.223904:0:5779:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 138 00000100:00100000:3.0:1783441383.224557:0:5783:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff91a844b7c000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6c1ddb50-5795-40c6-a2b6-8f58add9da62:5783:1870073693238400:0@lo:503: 00000100:00100000:3.0:1783441383.227890:0:8314:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff91a87d4ead80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:6c1ddb50-5795-40c6-a2b6-8f58add9da62:8314:1870073693238528:0@lo:502: 00000100:00100000:3.0:1783441383.227981:0:8314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783441383.228017:0:8314:0:(client.c:2702:ptlrpc_set_wait()) set ffff91a843123d80 going to sleep for 11 seconds 00000100:00100000:0.0:1783441383.228086:0:5780:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073693238528 00000100:00100000:0.0:1783441383.228093:0:5780:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073693238528 00000100:00100000:0.0:1783441383.228149:0:5780:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 139 00000100:00100000:0.0:1783441383.228168:0:5780:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a848f77850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6c1ddb50-5795-40c6-a2b6-8f58add9da62+14:8314:x1870073693238528:12345-0@lo:502: 00000100:00100000:0.0:1783441383.228811:0:5780:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a848f77850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6c1ddb50-5795-40c6-a2b6-8f58add9da62+14:8314:x1870073693238528:12345-0@lo:502: Request processed in 652us (829us total) trans 0 rc 0/0 00000100:00100000:0.0:1783441383.228820:0:5780:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 139 00000100:00100000:3.0:1783441383.228996:0:8314:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff91a87d4ead80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:6c1ddb50-5795-40c6-a2b6-8f58add9da62:8314:1870073693238528:0@lo:502: 00000020:01000000:3.0:1783441383.229032:0:8314:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1783441383.229040:0:8314:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1783441383.229043:0:8314:0:(obd_config.c:1561:class_process_config()) marker 27 (0x1) lustre sys.jobid_var 00000020:00000080:3.0:1783441383.229048:0:8314:0:(obd_config.c:1470:class_process_config()) processing cmd: cf00f 00000100:00100000:3.0:1783441383.229073:0:8314:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff91a87d4ead80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:6c1ddb50-5795-40c6-a2b6-8f58add9da62:8314:1870073693238656:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1783441383.229109:0:8314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783441383.229139:0:8314:0:(client.c:2702:ptlrpc_set_wait()) set ffff91a844c90480 going to sleep for 11 seconds 00000100:00100000:0.0:1783441383.229255:0:5778:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073693238656 00000100:00100000:0.0:1783441383.229260:0:5778:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073693238656 00000100:00100000:0.0:1783441383.229888:0:5778:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 140 00000100:00100000:0.0:1783441383.229899:0:5778:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a848f76850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6c1ddb50-5795-40c6-a2b6-8f58add9da62+14:8314:x1870073693238656:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1783441383.230073:0:5778:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a848f76850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6c1ddb50-5795-40c6-a2b6-8f58add9da62+14:8314:x1870073693238656:12345-0@lo:502:llog_process_th.0 Request processed in 175us (963us total) trans 0 rc 0/0 00000100:00100000:0.0:1783441383.230089:0:5778:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 140 00000100:00100000:2.0:1783441383.230181:0:8314:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff91a87d4ead80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:6c1ddb50-5795-40c6-a2b6-8f58add9da62:8314:1870073693238656:0@lo:502:llog_process_th.0 00000020:01000000:2.0:1783441383.230208:0:8314:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1783441383.230213:0:8314:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1783441383.230215:0:8314:0:(obd_config.c:1561:class_process_config()) marker 27 (0x2) lustre sys.jobid_var 00000040:00080000:2.0:1783441383.230219:0:8314:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x9:0x0] index 11 count 11 00000020:01000000:1.0:1783441383.234445:0:5783:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0001 gen 8-10 (rc=0) 10000000:01000000:1.0:1783441383.234493:0:5783:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.201.113@tcp: configuration from log 'lustre-OST0001' succeeded (0). 00010000:00010000:1.0:1783441383.234506:0:5783:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.113@tcp lock: ffff91a840030800/0xa2426164df2c776d lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xa2426164df2c7774 expref: -99 pid: 5783 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783441383.234518:0:5783:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.113@tcp lock: ffff91a840030800/0xa2426164df2c776d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xa2426164df2c7774 expref: -99 pid: 5783 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1783441383.234543:0:5783:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:1.0:1783441383.234546:0:5783:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-client-ffff91a867cf2000 from 39 10000000:01000000:1.0:1783441383.234549:0:5783:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:1.0:1783441383.234598:0:5783:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.113@tcp lock: ffff91a87da46c00/0xa2426164df2c777b lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5783 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783441383.234607:0:5783:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.113@tcp lock: ffff91a87da46c00/0xa2426164df2c777b lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5783 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783441383.235172:0:5783:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.113@tcp lock: ffff91a87da46c00/0xa2426164df2c777b lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5783 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783441383.235205:0:5783:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff91a859084e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6c1ddb50-5795-40c6-a2b6-8f58add9da62:5783:1870073693238784:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1783441383.235292:0:5783:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783441383.241464:0:5783:0:(client.c:2702:ptlrpc_set_wait()) set ffff91a8486303c0 going to sleep for 11 seconds 00000100:00100000:0.0:1783441383.246060:0:5778:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073693238784 00000100:00100000:0.0:1783441383.246074:0:5778:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073693238784 00000100:00100000:0.0:1783441383.246137:0:5778:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 141 00000100:00100000:0.0:1783441383.246145:0:5778:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a848f75450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6c1ddb50-5795-40c6-a2b6-8f58add9da62+14:5783:x1870073693238784:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1783441383.246172:0:5778:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1783441383.246190:0:5778:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff91a840031800/0xa2426164df2c7782 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0xa2426164df2c777b expref: -99 pid: 5778 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783441383.246219:0:5778:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff91a840031800/0xa2426164df2c7782 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xa2426164df2c777b expref: 15 pid: 5778 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783441383.246229:0:5778:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff91a840031800/0xa2426164df2c7782 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xa2426164df2c777b expref: 15 pid: 5778 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783441383.246238:0:5778:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91a840031800, rc 0) 00000100:00100000:0.0:1783441383.246326:0:5778:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a848f75450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6c1ddb50-5795-40c6-a2b6-8f58add9da62+15:5783:x1870073693238784:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 182us (11034us total) trans 0 rc 0/0 00000100:00100000:0.0:1783441383.246333:0:5778:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 141 00000100:00100000:1.0:1783441383.246851:0:5783:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff91a859084e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6c1ddb50-5795-40c6-a2b6-8f58add9da62:5783:1870073693238784:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1783441383.246870:0:5783:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.113@tcp lock: ffff91a87da46c00/0xa2426164df2c777b lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xa2426164df2c7782 expref: -99 pid: 5783 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783441383.246879:0:5783:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.113@tcp lock: ffff91a87da46c00/0xa2426164df2c777b lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0xa2426164df2c7782 expref: -99 pid: 5783 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783441383.246949:0:5783:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff91a859084e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6c1ddb50-5795-40c6-a2b6-8f58add9da62:5783:1870073693238912:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1783441383.246983:0:5783:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783441383.247012:0:5783:0:(client.c:2702:ptlrpc_set_wait()) set ffff91a8486303c0 going to sleep for 11 seconds 00000100:00100000:3.0:1783441383.247532:0:5780:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073693238912 00000100:00100000:3.0:1783441383.247538:0:5780:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073693238912 00000100:00100000:3.0:1783441383.247587:0:5780:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 142 00000100:00100000:3.0:1783441383.247595:0:5780:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a848f75850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6c1ddb50-5795-40c6-a2b6-8f58add9da62+15:5783:x1870073693238912:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1783441383.248249:0:5780:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a848f75850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6c1ddb50-5795-40c6-a2b6-8f58add9da62+15:5783:x1870073693238912:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 652us (1263us total) trans 0 rc 0/0 00000100:00100000:3.0:1783441383.248257:0:5780:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 142 00000100:00100000:1.0:1783441383.248409:0:5783:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff91a859084e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6c1ddb50-5795-40c6-a2b6-8f58add9da62:5783:1870073693238912:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1783441383.248449:0:5783:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff91a859084e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6c1ddb50-5795-40c6-a2b6-8f58add9da62:5783:1870073693239040:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1783441383.248757:0:5783:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783441383.248782:0:5783:0:(client.c:2702:ptlrpc_set_wait()) set ffff91a8486303c0 going to sleep for 11 seconds 00000100:00100000:0.0:1783441383.248842:0:5778:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073693239040 00000100:00100000:0.0:1783441383.248847:0:5778:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073693239040 00000100:00100000:0.0:1783441383.248872:0:5778:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 143 00000100:00100000:0.0:1783441383.248880:0:5778:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a848f77050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6c1ddb50-5795-40c6-a2b6-8f58add9da62+15:5783:x1870073693239040:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1783441383.249052:0:5778:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a848f77050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6c1ddb50-5795-40c6-a2b6-8f58add9da62+15:5783:x1870073693239040:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 171us (311us total) trans 0 rc 0/0 00000100:00100000:0.0:1783441383.249058:0:5778:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 143 00000100:00100000:1.0:1783441383.249201:0:5783:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff91a859084e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6c1ddb50-5795-40c6-a2b6-8f58add9da62:5783:1870073693239040:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1783441383.251087:0:8315:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff91a867cd4380 pname:cluuid:pid:xid:nid:opc:job llog_process_th:6c1ddb50-5795-40c6-a2b6-8f58add9da62:8315:1870073693239168:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1783441383.251182:0:8315:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783441383.251211:0:8315:0:(client.c:2702:ptlrpc_set_wait()) set ffff91a747979480 going to sleep for 11 seconds 00000100:00100000:0.0:1783441383.251269:0:5778:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073693239168 00000100:00100000:0.0:1783441383.251281:0:5778:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073693239168 00000100:00100000:0.0:1783441383.251326:0:5778:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 144 00000100:00100000:0.0:1783441383.251334:0:5778:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a848f74050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6c1ddb50-5795-40c6-a2b6-8f58add9da62+15:8315:x1870073693239168:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1783441383.252009:0:5778:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a848f74050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6c1ddb50-5795-40c6-a2b6-8f58add9da62+15:8315:x1870073693239168:12345-0@lo:502:llog_process_th.0 Request processed in 672us (823us total) trans 0 rc 0/0 00000100:00100000:0.0:1783441383.252018:0:5778:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 144 00000100:00100000:3.0:1783441383.252811:0:8315:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff91a867cd4380 pname:cluuid:pid:xid:nid:opc:job llog_process_th:6c1ddb50-5795-40c6-a2b6-8f58add9da62:8315:1870073693239168:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1783441383.252884:0:8315:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff91a87d4ead80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:6c1ddb50-5795-40c6-a2b6-8f58add9da62:8315:1870073693239296:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1783441383.252934:0:8315:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783441383.252972:0:8315:0:(client.c:2702:ptlrpc_set_wait()) set ffff91a867cffc00 going to sleep for 11 seconds 00000100:00100000:0.0:1783441383.253592:0:5780:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073693239296 00000100:00100000:0.0:1783441383.253600:0:5780:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073693239296 00000100:00100000:0.0:1783441383.253894:0:5780:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 145 00000100:00100000:0.0:1783441383.253904:0:5780:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a848f74450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6c1ddb50-5795-40c6-a2b6-8f58add9da62+15:8315:x1870073693239296:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1783441383.254140:0:5780:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a848f74450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6c1ddb50-5795-40c6-a2b6-8f58add9da62+15:8315:x1870073693239296:12345-0@lo:502:llog_process_th.0 Request processed in 238us (1205us total) trans 0 rc 0/0 00000100:00100000:0.0:1783441383.254148:0:5780:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 145 00000100:00100000:3.0:1783441383.254734:0:8315:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff91a87d4ead80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:6c1ddb50-5795-40c6-a2b6-8f58add9da62:8315:1870073693239296:0@lo:502:llog_process_th.0 00000040:00080000:3.0:1783441383.254818:0:8315:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 42 count 42 00000020:01000000:0.0:1783441383.255970:0:5783:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 39-41 (rc=0) 10000000:01000000:0.0:1783441383.255998:0:5783:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.201.113@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:0.0:1783441383.256010:0:5783:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.113@tcp lock: ffff91a87da46c00/0xa2426164df2c777b lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xa2426164df2c7782 expref: -99 pid: 5783 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783441383.256023:0:5783:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.113@tcp lock: ffff91a87da46c00/0xa2426164df2c777b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xa2426164df2c7782 expref: -99 pid: 5783 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1783441383.256034:0:5783:0:(mgc_request.c:611:do_requeue()) updating log lustre-OST0000 10000000:01000000:0.0:1783441383.256037:0:5783:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-OST0000-0000000000000000 from 11 10000000:01000000:0.0:1783441383.256040:0:5783:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0000 (res 0x65727473756c) 00010000:00010000:0.0:1783441383.256079:0:5783:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.113@tcp lock: ffff91a840031000/0xa2426164df2c7789 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5783 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783441383.256087:0:5783:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.113@tcp lock: ffff91a840031000/0xa2426164df2c7789 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5783 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783441383.256109:0:5783:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.113@tcp lock: ffff91a840031000/0xa2426164df2c7789 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5783 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783441383.256132:0:5783:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff91a844b7c380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6c1ddb50-5795-40c6-a2b6-8f58add9da62:5783:1870073693239424:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1783441383.256200:0:5783:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783441383.256278:0:5783:0:(client.c:2702:ptlrpc_set_wait()) set ffff91a85fe52780 going to sleep for 11 seconds 00000100:00100000:2.0:1783441383.261820:0:5779:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073693239424 00000100:00100000:2.0:1783441383.261838:0:5779:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073693239424 00000100:00100000:2.0:1783441383.261898:0:5779:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 146 00000100:00100000:2.0:1783441383.261909:0:5779:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a848f77450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6c1ddb50-5795-40c6-a2b6-8f58add9da62+15:5783:x1870073693239424:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1783441383.261925:0:5779:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1783441383.261941:0:5779:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff91a85f83c800/0xa2426164df2c7790 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0xa2426164df2c7789 expref: -99 pid: 5779 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783441383.261970:0:5779:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff91a85f83c800/0xa2426164df2c7790 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xa2426164df2c7789 expref: 16 pid: 5779 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783441383.261981:0:5779:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff91a85f83c800/0xa2426164df2c7790 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xa2426164df2c7789 expref: 16 pid: 5779 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783441383.261991:0:5779:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91a85f83c800, rc 0) 00000100:00100000:2.0:1783441383.262076:0:5779:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a848f77450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6c1ddb50-5795-40c6-a2b6-8f58add9da62+16:5783:x1870073693239424:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 168us (5875us total) trans 0 rc 0/0 00000100:00100000:2.0:1783441383.262082:0:5779:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 146 00000100:00100000:3.0:1783441383.262210:0:5783:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff91a844b7c380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6c1ddb50-5795-40c6-a2b6-8f58add9da62:5783:1870073693239424:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1783441383.262232:0:5783:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.113@tcp lock: ffff91a840031000/0xa2426164df2c7789 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xa2426164df2c7790 expref: -99 pid: 5783 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783441383.262241:0:5783:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.113@tcp lock: ffff91a840031000/0xa2426164df2c7789 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0xa2426164df2c7790 expref: -99 pid: 5783 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783441383.262314:0:5783:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff91a87d4ead80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6c1ddb50-5795-40c6-a2b6-8f58add9da62:5783:1870073693239552:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1783441383.262350:0:5783:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783441383.262386:0:5783:0:(client.c:2702:ptlrpc_set_wait()) set ffff91a867cffc00 going to sleep for 11 seconds 00000100:00100000:0.0:1783441383.262510:0:5780:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073693239552 00000100:00100000:0.0:1783441383.262515:0:5780:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073693239552 00000100:00100000:0.0:1783441383.262549:0:5780:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 147 00000100:00100000:0.0:1783441383.262556:0:5780:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a848f75c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6c1ddb50-5795-40c6-a2b6-8f58add9da62+16:5783:x1870073693239552:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1783441383.262852:0:5780:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a848f75c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6c1ddb50-5795-40c6-a2b6-8f58add9da62+16:5783:x1870073693239552:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 296us (501us total) trans 0 rc 0/0 00000100:00100000:0.0:1783441383.262860:0:5780:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 147 00000100:00100000:3.0:1783441383.263016:0:5783:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff91a87d4ead80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6c1ddb50-5795-40c6-a2b6-8f58add9da62:5783:1870073693239552:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1783441383.263048:0:5783:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff91a87d4ead80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6c1ddb50-5795-40c6-a2b6-8f58add9da62:5783:1870073693239680:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1783441383.263086:0:5783:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783441383.263104:0:5783:0:(client.c:2702:ptlrpc_set_wait()) set ffff91a867cffc00 going to sleep for 11 seconds 00000100:00100000:0.0:1783441383.263549:0:5780:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073693239680 00000100:00100000:0.0:1783441383.263555:0:5780:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073693239680 00000100:00100000:0.0:1783441383.263592:0:5780:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 148 00000100:00100000:0.0:1783441383.263600:0:5780:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a848f71850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6c1ddb50-5795-40c6-a2b6-8f58add9da62+16:5783:x1870073693239680:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1783441383.263784:0:5780:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a848f71850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6c1ddb50-5795-40c6-a2b6-8f58add9da62+16:5783:x1870073693239680:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 184us (697us total) trans 0 rc 0/0 00000100:00100000:0.0:1783441383.263791:0:5780:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 148 00000100:00100000:3.0:1783441383.263951:0:5783:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff91a87d4ead80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6c1ddb50-5795-40c6-a2b6-8f58add9da62:5783:1870073693239680:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1783441383.265049:0:8316:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff91a867cd7800 pname:cluuid:pid:xid:nid:opc:job llog_process_th:6c1ddb50-5795-40c6-a2b6-8f58add9da62:8316:1870073693239808:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1783441383.265111:0:8316:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783441383.265138:0:8316:0:(client.c:2702:ptlrpc_set_wait()) set ffff91a7479799c0 going to sleep for 11 seconds 00000100:00100000:0.0:1783441383.265368:0:5780:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073693239808 00000100:00100000:0.0:1783441383.265376:0:5780:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073693239808 00000100:00100000:0.0:1783441383.265458:0:5780:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 149 00000100:00100000:0.0:1783441383.265467:0:5780:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a848f73050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6c1ddb50-5795-40c6-a2b6-8f58add9da62+16:8316:x1870073693239808:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1783441383.266064:0:5780:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a848f73050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6c1ddb50-5795-40c6-a2b6-8f58add9da62+16:8316:x1870073693239808:12345-0@lo:502:llog_process_th.0 Request processed in 596us (950us total) trans 0 rc 0/0 00000100:00100000:0.0:1783441383.266080:0:5780:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 149 00000100:00100000:2.0:1783441383.266155:0:8316:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff91a867cd7800 pname:cluuid:pid:xid:nid:opc:job llog_process_th:6c1ddb50-5795-40c6-a2b6-8f58add9da62:8316:1870073693239808:0@lo:502:llog_process_th.0 00000020:01000000:2.0:1783441383.266200:0:8316:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1783441383.266209:0:8316:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1783441383.266211:0:8316:0:(obd_config.c:1561:class_process_config()) marker 24 (0x1) lustre sys.jobid_var 00000020:00000080:2.0:1783441383.266217:0:8316:0:(obd_config.c:1470:class_process_config()) processing cmd: cf00f 00000100:00100000:2.0:1783441383.266239:0:8316:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff91a867cd7800 pname:cluuid:pid:xid:nid:opc:job llog_process_th:6c1ddb50-5795-40c6-a2b6-8f58add9da62:8316:1870073693239936:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1783441383.266276:0:8316:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783441383.271236:0:8316:0:(client.c:2702:ptlrpc_set_wait()) set ffff91a7479799c0 going to sleep for 11 seconds 00000100:00100000:3.0:1783441383.271315:0:5779:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073693239936 00000100:00100000:3.0:1783441383.271325:0:5779:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073693239936 00000100:00100000:3.0:1783441383.271545:0:5779:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 150 00000100:00100000:3.0:1783441383.271555:0:5779:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a848f70050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6c1ddb50-5795-40c6-a2b6-8f58add9da62+16:8316:x1870073693239936:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1783441383.271870:0:5779:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a848f70050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6c1ddb50-5795-40c6-a2b6-8f58add9da62+16:8316:x1870073693239936:12345-0@lo:502:llog_process_th.0 Request processed in 316us (5593us total) trans 0 rc 0/0 00000100:00100000:3.0:1783441383.271879:0:5779:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 150 00000100:00100000:2.0:1783441383.272061:0:8316:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff91a867cd7800 pname:cluuid:pid:xid:nid:opc:job llog_process_th:6c1ddb50-5795-40c6-a2b6-8f58add9da62:8316:1870073693239936:0@lo:502:llog_process_th.0 00000020:01000000:2.0:1783441383.272099:0:8316:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1783441383.272107:0:8316:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1783441383.272109:0:8316:0:(obd_config.c:1561:class_process_config()) marker 24 (0x2) lustre sys.jobid_var 00000040:00080000:2.0:1783441383.272114:0:8316:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 14 count 14 00000020:01000000:3.0:1783441383.272497:0:5783:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0000 gen 11-13 (rc=0) 10000000:01000000:3.0:1783441383.272522:0:5783:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.201.113@tcp: configuration from log 'lustre-OST0000' succeeded (0). 00010000:00010000:3.0:1783441383.272532:0:5783:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.113@tcp lock: ffff91a840031000/0xa2426164df2c7789 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xa2426164df2c7790 expref: -99 pid: 5783 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783441383.272543:0:5783:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.113@tcp lock: ffff91a840031000/0xa2426164df2c7789 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xa2426164df2c7790 expref: -99 pid: 5783 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1783441383.272553:0:5783:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:3.0:1783441383.272556:0:5783:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-client-ffff91a84869e800 from 39 10000000:01000000:3.0:1783441383.272559:0:5783:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:3.0:1783441383.272600:0:5783:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.113@tcp lock: ffff91a85eb3de00/0xa2426164df2c7797 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5783 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783441383.272609:0:5783:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.113@tcp lock: ffff91a85eb3de00/0xa2426164df2c7797 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5783 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783441383.272723:0:5783:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.113@tcp lock: ffff91a85eb3de00/0xa2426164df2c7797 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5783 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783441383.272824:0:5783:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff91a87d4ead80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6c1ddb50-5795-40c6-a2b6-8f58add9da62:5783:1870073693240064:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1783441383.272869:0:5783:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783441383.272936:0:5783:0:(client.c:2702:ptlrpc_set_wait()) set ffff91a867cff600 going to sleep for 11 seconds 00000100:00100000:0.0:1783441383.273066:0:5780:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073693240064 00000100:00100000:0.0:1783441383.273073:0:5780:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073693240064 00000100:00100000:1.0:1783441383.273171:0:5778:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 151 00000100:00100000:1.0:1783441383.273182:0:5778:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a848f70450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6c1ddb50-5795-40c6-a2b6-8f58add9da62+16:5783:x1870073693240064:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1783441383.273193:0:5778:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1783441383.273206:0:5778:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff91a87da46e00/0xa2426164df2c779e lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0xa2426164df2c7797 expref: -99 pid: 5778 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783441383.273229:0:5778:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff91a87da46e00/0xa2426164df2c779e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xa2426164df2c7797 expref: 17 pid: 5778 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783441383.273239:0:5778:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff91a87da46e00/0xa2426164df2c779e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xa2426164df2c7797 expref: 17 pid: 5778 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783441383.273248:0:5778:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91a87da46e00, rc 0) 00000100:00100000:1.0:1783441383.273284:0:5778:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a848f70450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6c1ddb50-5795-40c6-a2b6-8f58add9da62+17:5783:x1870073693240064:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 104us (414us total) trans 0 rc 0/0 00000100:00100000:1.0:1783441383.273290:0:5778:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 151 00000100:00100000:3.0:1783441383.273404:0:5783:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff91a87d4ead80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6c1ddb50-5795-40c6-a2b6-8f58add9da62:5783:1870073693240064:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1783441383.273417:0:5783:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.113@tcp lock: ffff91a85eb3de00/0xa2426164df2c7797 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xa2426164df2c779e expref: -99 pid: 5783 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783441383.273427:0:5783:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.113@tcp lock: ffff91a85eb3de00/0xa2426164df2c7797 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0xa2426164df2c779e expref: -99 pid: 5783 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783441383.273475:0:5783:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff91a87d4ead80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6c1ddb50-5795-40c6-a2b6-8f58add9da62:5783:1870073693240192:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1783441383.273509:0:5783:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783441383.273529:0:5783:0:(client.c:2702:ptlrpc_set_wait()) set ffff91a867cff600 going to sleep for 11 seconds 00000100:00100000:2.0:1783441383.273710:0:5779:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073693240192 00000100:00100000:2.0:1783441383.273715:0:5779:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073693240192 00000100:00100000:2.0:1783441383.273735:0:5779:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 152 00000100:00100000:2.0:1783441383.273770:0:5779:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a848f73450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6c1ddb50-5795-40c6-a2b6-8f58add9da62+17:5783:x1870073693240192:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1783441383.274016:0:5779:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a848f73450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6c1ddb50-5795-40c6-a2b6-8f58add9da62+17:5783:x1870073693240192:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 273us (505us total) trans 0 rc 0/0 00000100:00100000:2.0:1783441383.274023:0:5779:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 152 00000100:00100000:3.0:1783441383.274181:0:5783:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff91a87d4ead80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6c1ddb50-5795-40c6-a2b6-8f58add9da62:5783:1870073693240192:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1783441383.274210:0:5783:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff91a87d4ead80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6c1ddb50-5795-40c6-a2b6-8f58add9da62:5783:1870073693240320:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1783441383.274250:0:5783:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783441383.274280:0:5783:0:(client.c:2702:ptlrpc_set_wait()) set ffff91a867cff600 going to sleep for 11 seconds 00000100:00100000:2.0:1783441383.274320:0:5779:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073693240320 00000100:00100000:2.0:1783441383.274325:0:5779:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073693240320 00000100:00100000:2.0:1783441383.274344:0:5779:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 153 00000100:00100000:2.0:1783441383.274350:0:5779:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a848f71c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6c1ddb50-5795-40c6-a2b6-8f58add9da62+17:5783:x1870073693240320:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1783441383.274509:0:5779:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a848f71c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6c1ddb50-5795-40c6-a2b6-8f58add9da62+17:5783:x1870073693240320:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 159us (258us total) trans 0 rc 0/0 00000100:00100000:2.0:1783441383.274516:0:5779:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 153 00000100:00100000:3.0:1783441383.274845:0:5783:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff91a87d4ead80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6c1ddb50-5795-40c6-a2b6-8f58add9da62:5783:1870073693240320:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1783441383.275252:0:8317:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff91a87d4ead80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:6c1ddb50-5795-40c6-a2b6-8f58add9da62:8317:1870073693240448:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1783441383.275292:0:8317:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783441383.275322:0:8317:0:(client.c:2702:ptlrpc_set_wait()) set ffff91a846f7c540 going to sleep for 11 seconds 00000100:00100000:2.0:1783441383.275586:0:5779:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073693240448 00000100:00100000:2.0:1783441383.275592:0:5779:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073693240448 00000100:00100000:2.0:1783441383.275736:0:5779:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 154 00000100:00100000:2.0:1783441383.275775:0:5779:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a848f71050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6c1ddb50-5795-40c6-a2b6-8f58add9da62+17:8317:x1870073693240448:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1783441383.275995:0:5779:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a848f71050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6c1ddb50-5795-40c6-a2b6-8f58add9da62+17:8317:x1870073693240448:12345-0@lo:502:llog_process_th.0 Request processed in 222us (701us total) trans 0 rc 0/0 00000100:00100000:2.0:1783441383.276002:0:5779:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 154 00000100:00100000:3.0:1783441383.276103:0:8317:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff91a87d4ead80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:6c1ddb50-5795-40c6-a2b6-8f58add9da62:8317:1870073693240448:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1783441383.276149:0:8317:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff91a87d4ead80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:6c1ddb50-5795-40c6-a2b6-8f58add9da62:8317:1870073693240576:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1783441383.276195:0:8317:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783441383.276224:0:8317:0:(client.c:2702:ptlrpc_set_wait()) set ffff91a846f7c540 going to sleep for 11 seconds 00000100:00100000:0.0:1783441383.276288:0:5780:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073693240576 00000100:00100000:0.0:1783441383.276294:0:5780:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073693240576 00000100:00100000:0.0:1783441383.276315:0:5780:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 155 00000100:00100000:0.0:1783441383.276322:0:5780:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a848f70c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6c1ddb50-5795-40c6-a2b6-8f58add9da62+17:8317:x1870073693240576:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1783441383.277262:0:5780:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a848f70c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6c1ddb50-5795-40c6-a2b6-8f58add9da62+17:8317:x1870073693240576:12345-0@lo:502:llog_process_th.0 Request processed in 935us (1061us total) trans 0 rc 0/0 00000100:00100000:0.0:1783441383.277272:0:5780:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 155 00000100:00100000:3.0:1783441383.277378:0:8317:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff91a87d4ead80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:6c1ddb50-5795-40c6-a2b6-8f58add9da62:8317:1870073693240576:0@lo:502:llog_process_th.0 00000040:00080000:3.0:1783441383.277431:0:8317:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 42 count 42 00000020:01000000:0.0:1783441383.277885:0:5783:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 39-41 (rc=0) 10000000:01000000:0.0:1783441383.277904:0:5783:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.201.113@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:0.0:1783441383.277914:0:5783:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.113@tcp lock: ffff91a85eb3de00/0xa2426164df2c7797 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xa2426164df2c779e expref: -99 pid: 5783 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783441383.277926:0:5783:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.113@tcp lock: ffff91a85eb3de00/0xa2426164df2c7797 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xa2426164df2c779e expref: -99 pid: 5783 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1783441383.277937:0:5783:0:(mgc_request.c:611:do_requeue()) updating log lustre-MDT0000 10000000:01000000:0.0:1783441383.277940:0:5783:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-MDT0000-0000000000000000 from 34 10000000:01000000:0.0:1783441383.277942:0:5783:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0000 (res 0x65727473756c) 00010000:00010000:0.0:1783441383.277977:0:5783:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.113@tcp lock: ffff91a840030400/0xa2426164df2c77a5 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5783 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783441383.277985:0:5783:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.113@tcp lock: ffff91a840030400/0xa2426164df2c77a5 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5783 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783441383.277996:0:5783:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.113@tcp lock: ffff91a840030400/0xa2426164df2c77a5 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5783 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783441383.278031:0:5783:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff91a844b7f480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6c1ddb50-5795-40c6-a2b6-8f58add9da62:5783:1870073693240704:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1783441383.278076:0:5783:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783441383.278111:0:5783:0:(client.c:2702:ptlrpc_set_wait()) set ffff91a8488976c0 going to sleep for 11 seconds 00000100:00100000:3.0:1783441383.278176:0:5780:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073693240704 00000100:00100000:3.0:1783441383.278182:0:5780:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073693240704 00000100:00100000:3.0:1783441383.278212:0:5780:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 156 00000100:00100000:3.0:1783441383.278220:0:5780:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a848f70850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6c1ddb50-5795-40c6-a2b6-8f58add9da62+17:5783:x1870073693240704:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1783441383.278232:0:5780:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1783441383.278244:0:5780:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff91a85eb3c000/0xa2426164df2c77ac lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0xa2426164df2c77a5 expref: -99 pid: 5780 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783441383.278276:0:5780:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff91a85eb3c000/0xa2426164df2c77ac lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xa2426164df2c77a5 expref: 18 pid: 5780 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783441383.278287:0:5780:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff91a85eb3c000/0xa2426164df2c77ac lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xa2426164df2c77a5 expref: 18 pid: 5780 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783441383.278295:0:5780:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91a85eb3c000, rc 0) 00000100:00100000:3.0:1783441383.278345:0:5780:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a848f70850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6c1ddb50-5795-40c6-a2b6-8f58add9da62+18:5783:x1870073693240704:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 116us (260us total) trans 0 rc 0/0 00000100:00100000:3.0:1783441383.278352:0:5780:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 156 00000100:00100000:0.0:1783441383.278582:0:5783:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff91a844b7f480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6c1ddb50-5795-40c6-a2b6-8f58add9da62:5783:1870073693240704:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1783441383.278595:0:5783:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.113@tcp lock: ffff91a840030400/0xa2426164df2c77a5 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0xa2426164df2c77ac expref: -99 pid: 5783 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783441383.278605:0:5783:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.113@tcp lock: ffff91a840030400/0xa2426164df2c77a5 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0xa2426164df2c77ac expref: -99 pid: 5783 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783441383.278654:0:5783:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff91a844b7f480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6c1ddb50-5795-40c6-a2b6-8f58add9da62:5783:1870073693240832:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1783441383.278677:0:5783:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783441383.278695:0:5783:0:(client.c:2702:ptlrpc_set_wait()) set ffff91a8488976c0 going to sleep for 11 seconds 00000100:00100000:3.0:1783441383.278856:0:5780:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073693240832 00000100:00100000:3.0:1783441383.278861:0:5780:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073693240832 00000100:00100000:3.0:1783441383.278881:0:5780:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 157 00000100:00100000:3.0:1783441383.278887:0:5780:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a848f72450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6c1ddb50-5795-40c6-a2b6-8f58add9da62+18:5783:x1870073693240832:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1783441383.279084:0:5780:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a848f72450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6c1ddb50-5795-40c6-a2b6-8f58add9da62+18:5783:x1870073693240832:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 197us (406us total) trans 0 rc 0/0 00000100:00100000:3.0:1783441383.279091:0:5780:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 157 00000100:00100000:0.0:1783441383.279207:0:5783:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff91a844b7f480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6c1ddb50-5795-40c6-a2b6-8f58add9da62:5783:1870073693240832:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1783441383.279232:0:5783:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff91a844b7f480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6c1ddb50-5795-40c6-a2b6-8f58add9da62:5783:1870073693240960:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1783441383.279266:0:5783:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783441383.279290:0:5783:0:(client.c:2702:ptlrpc_set_wait()) set ffff91a8488976c0 going to sleep for 11 seconds 00000100:00100000:3.0:1783441383.279329:0:5780:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073693240960 00000100:00100000:3.0:1783441383.279333:0:5780:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073693240960 00000100:00100000:3.0:1783441383.279362:0:5780:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 158 00000100:00100000:3.0:1783441383.279367:0:5780:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a848f72c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6c1ddb50-5795-40c6-a2b6-8f58add9da62+18:5783:x1870073693240960:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1783441383.279798:0:5780:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a848f72c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6c1ddb50-5795-40c6-a2b6-8f58add9da62+18:5783:x1870073693240960:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 429us (530us total) trans 0 rc 0/0 00000100:00100000:3.0:1783441383.279805:0:5780:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 158 00000100:00100000:0.0:1783441383.279905:0:5783:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff91a844b7f480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6c1ddb50-5795-40c6-a2b6-8f58add9da62:5783:1870073693240960:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1783441383.280241:0:8318:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff91a87d4ead80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:6c1ddb50-5795-40c6-a2b6-8f58add9da62:8318:1870073693241088:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1783441383.280280:0:8318:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783441383.280307:0:8318:0:(client.c:2702:ptlrpc_set_wait()) set ffff91a867cff600 going to sleep for 11 seconds 00000100:00100000:2.0:1783441383.280346:0:5779:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073693241088 00000100:00100000:2.0:1783441383.280351:0:5779:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073693241088 00000100:00100000:2.0:1783441383.280379:0:5779:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 159 00000100:00100000:2.0:1783441383.280385:0:5779:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a848f73c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6c1ddb50-5795-40c6-a2b6-8f58add9da62+18:8318:x1870073693241088:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1783441383.281221:0:5779:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a848f73c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6c1ddb50-5795-40c6-a2b6-8f58add9da62+18:8318:x1870073693241088:12345-0@lo:502:llog_process_th.0 Request processed in 834us (938us total) trans 0 rc 0/0 00000100:00100000:2.0:1783441383.281229:0:5779:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 159 00000100:00100000:0.0:1783441383.281533:0:8318:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff91a87d4ead80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:6c1ddb50-5795-40c6-a2b6-8f58add9da62:8318:1870073693241088:0@lo:502:llog_process_th.0 00000020:01000000:0.0:1783441383.281575:0:8318:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1783441383.281585:0:8318:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1783441383.281587:0:8318:0:(obd_config.c:1561:class_process_config()) marker 26 (0x1) lustre sys.jobid_var 00000020:00000080:0.0:1783441383.281594:0:8318:0:(obd_config.c:1470:class_process_config()) processing cmd: cf00f 00000100:00100000:0.0:1783441383.281626:0:8318:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff91a844b7f480 pname:cluuid:pid:xid:nid:opc:job llog_process_th:6c1ddb50-5795-40c6-a2b6-8f58add9da62:8318:1870073693241216:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1783441383.281665:0:8318:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783441383.281692:0:8318:0:(client.c:2702:ptlrpc_set_wait()) set ffff91a8488976c0 going to sleep for 11 seconds 00000100:00100000:2.0:1783441383.281810:0:5779:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073693241216 00000100:00100000:2.0:1783441383.281815:0:5779:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073693241216 00000100:00100000:2.0:1783441383.281841:0:5779:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 160 00000100:00100000:2.0:1783441383.281847:0:5779:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a848f72050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6c1ddb50-5795-40c6-a2b6-8f58add9da62+18:8318:x1870073693241216:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1783441383.281983:0:5779:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a848f72050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6c1ddb50-5795-40c6-a2b6-8f58add9da62+18:8318:x1870073693241216:12345-0@lo:502:llog_process_th.0 Request processed in 136us (317us total) trans 0 rc 0/0 00000100:00100000:2.0:1783441383.281989:0:5779:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 160 00000100:00100000:0.0:1783441383.282239:0:8318:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff91a844b7f480 pname:cluuid:pid:xid:nid:opc:job llog_process_th:6c1ddb50-5795-40c6-a2b6-8f58add9da62:8318:1870073693241216:0@lo:502:llog_process_th.0 00000020:01000000:0.0:1783441383.282261:0:8318:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1783441383.282265:0:8318:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1783441383.282267:0:8318:0:(obd_config.c:1561:class_process_config()) marker 26 (0x2) lustre sys.jobid_var 00000040:00080000:0.0:1783441383.282270:0:8318:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 37 count 37 00000020:01000000:2.0:1783441383.282831:0:5783:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0000 gen 34-36 (rc=0) 10000000:01000000:2.0:1783441383.282851:0:5783:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.201.113@tcp: configuration from log 'lustre-MDT0000' succeeded (0). 00010000:00010000:2.0:1783441383.282861:0:5783:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.113@tcp lock: ffff91a840030400/0xa2426164df2c77a5 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0xa2426164df2c77ac expref: -99 pid: 5783 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783441383.282873:0:5783:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.113@tcp lock: ffff91a840030400/0xa2426164df2c77a5 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0xa2426164df2c77ac expref: -99 pid: 5783 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1783441383.282885:0:5783:0:(mgc_request.c:611:do_requeue()) updating log lustre-sptlrpc 10000000:01000000:2.0:1783441383.282888:0:5783:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-sptlrpc-ffff91a84767cd40 from 1 10000000:01000000:2.0:1783441383.282891:0:5783:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:2.0:1783441383.282918:0:5783:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.113@tcp lock: ffff91a85f83ce00/0xa2426164df2c77b3 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5783 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783441383.282926:0:5783:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.113@tcp lock: ffff91a85f83ce00/0xa2426164df2c77b3 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5783 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783441383.282946:0:5783:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.113@tcp lock: ffff91a85f83ce00/0xa2426164df2c77b3 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5783 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783441383.282965:0:5783:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff91a867cd7800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6c1ddb50-5795-40c6-a2b6-8f58add9da62:5783:1870073693241344:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1783441383.283007:0:5783:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783441383.283040:0:5783:0:(client.c:2702:ptlrpc_set_wait()) set ffff91a8582b60c0 going to sleep for 11 seconds 00000100:00100000:1.0:1783441383.283208:0:5778:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073693241344 00000100:00100000:1.0:1783441383.283215:0:5778:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073693241344 00000100:00100000:1.0:1783441383.283262:0:5778:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 161 00000100:00100000:1.0:1783441383.283270:0:5778:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a848f73850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6c1ddb50-5795-40c6-a2b6-8f58add9da62+18:5783:x1870073693241344:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1783441383.283282:0:5778:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1783441383.283296:0:5778:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff91a87da47600/0xa2426164df2c77ba lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: local remote: 0xa2426164df2c77b3 expref: -99 pid: 5778 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783441383.283319:0:5778:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff91a87da47600/0xa2426164df2c77ba lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xa2426164df2c77b3 expref: 19 pid: 5778 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783441383.283346:0:5778:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff91a87da47600/0xa2426164df2c77ba lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xa2426164df2c77b3 expref: 19 pid: 5778 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783441383.283355:0:5778:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91a87da47600, rc 0) 00000100:00100000:1.0:1783441383.283400:0:5778:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a848f73850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6c1ddb50-5795-40c6-a2b6-8f58add9da62+19:5783:x1870073693241344:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 131us (392us total) trans 0 rc 0/0 00000100:00100000:1.0:1783441383.283406:0:5778:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 161 00000100:00100000:2.0:1783441383.283537:0:5783:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff91a867cd7800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6c1ddb50-5795-40c6-a2b6-8f58add9da62:5783:1870073693241344:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1783441383.283549:0:5783:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.113@tcp lock: ffff91a85f83ce00/0xa2426164df2c77b3 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0xa2426164df2c77ba expref: -99 pid: 5783 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783441383.283558:0:5783:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.113@tcp lock: ffff91a85f83ce00/0xa2426164df2c77b3 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0xa2426164df2c77ba expref: -99 pid: 5783 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783441383.283626:0:5783:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff91a867cd7800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6c1ddb50-5795-40c6-a2b6-8f58add9da62:5783:1870073693241472:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1783441383.283652:0:5783:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783441383.283673:0:5783:0:(client.c:2702:ptlrpc_set_wait()) set ffff91a8582b60c0 going to sleep for 11 seconds 00000100:00100000:1.0:1783441383.283840:0:5778:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073693241472 00000100:00100000:1.0:1783441383.283844:0:5778:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073693241472 00000100:00100000:1.0:1783441383.283868:0:5778:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 162 00000100:00100000:1.0:1783441383.283874:0:5778:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a848f72850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6c1ddb50-5795-40c6-a2b6-8f58add9da62+19:5783:x1870073693241472:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1783441383.284098:0:5778:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a848f72850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6c1ddb50-5795-40c6-a2b6-8f58add9da62+19:5783:x1870073693241472:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 224us (445us total) trans 0 rc -2/-2 00000100:00100000:1.0:1783441383.284105:0:5778:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 162 00000100:00100000:1.0:1783441383.284135:0:5783:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff91a867cd7800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6c1ddb50-5795-40c6-a2b6-8f58add9da62:5783:1870073693241472:0@lo:501:ll_cfg_requeue.0 10000000:01000000:1.0:1783441383.284178:0:5783:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.201.113@tcp: configuration from log 'lustre-sptlrpc' failed (-2). 00010000:00010000:1.0:1783441383.284185:0:5783:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.113@tcp lock: ffff91a85f83ce00/0xa2426164df2c77b3 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0xa2426164df2c77ba expref: -99 pid: 5783 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783441383.284193:0:5783:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.113@tcp lock: ffff91a85f83ce00/0xa2426164df2c77b3 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0xa2426164df2c77ba expref: -99 pid: 5783 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783441383.359690:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.13@tcp (source: 12345-192.168.201.13@tcp) 00000100:00100000:1.0:1783441383.361132:0:5778:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073673290368 00000100:00100000:1.0:1783441383.361147:0:5778:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073673290368 00000100:00100000:1.0:1783441383.361284:0:5778:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.13@tcp, seq: 163 00000100:00100000:1.0:1783441383.361296:0:5778:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a848f71450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:51c2a82e-e792-4f56-84e8-12cc033e9e70+8:5571:x1870073673290368:12345-192.168.201.13@tcp:101: 00010000:00010000:1.0:1783441383.361329:0:5778:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1783441383.361358:0:5778:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff91a87da46800/0xa2426164df2c77c1 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: local remote: 0x633a354aa4df4c9b expref: -99 pid: 5778 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783441383.361388:0:5778:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff91a87da46800/0xa2426164df2c77c1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50000000000000 nid: 192.168.201.13@tcp remote: 0x633a354aa4df4c9b expref: 9 pid: 5778 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783441383.361410:0:5778:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff91a87da46800/0xa2426164df2c77c1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: 192.168.201.13@tcp remote: 0x633a354aa4df4c9b expref: 9 pid: 5778 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783441383.361418:0:5778:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91a87da46800, rc 0) 00000100:00100000:1.0:1783441383.361491:0:5778:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a848f71450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:51c2a82e-e792-4f56-84e8-12cc033e9e70+9:5571:x1870073673290368:12345-192.168.201.13@tcp:101: Request processed in 197us (1875us total) trans 0 rc 0/0 00000100:00100000:1.0:1783441383.361498:0:5778:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.13@tcp, seq: 163 00000100:00100000:3.0:1783441383.368772:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.13@tcp (source: 12345-192.168.201.13@tcp) 00000100:00100000:2.0:1783441383.368875:0:5780:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073673290496 00000100:00100000:2.0:1783441383.368885:0:5780:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073673290496 00000100:00100000:2.0:1783441383.368936:0:5780:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.13@tcp, seq: 164 00000100:00100000:2.0:1783441383.368946:0:5780:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a848f34850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:51c2a82e-e792-4f56-84e8-12cc033e9e70+9:5571:x1870073673290496:12345-192.168.201.13@tcp:501: 00000100:00100000:2.0:1783441383.369319:0:5780:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a848f34850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:51c2a82e-e792-4f56-84e8-12cc033e9e70+9:5571:x1870073673290496:12345-192.168.201.13@tcp:501: Request processed in 373us (588us total) trans 0 rc 0/0 00000100:00100000:2.0:1783441383.369328:0:5780:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.13@tcp, seq: 164 00000100:00100000:2.0:1783441383.375012:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.13@tcp (source: 12345-192.168.201.13@tcp) 00000100:00100000:1.0:1783441383.375218:0:5778:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073673290624 00000100:00100000:1.0:1783441383.375229:0:5778:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073673290624 00000100:00100000:1.0:1783441383.375283:0:5778:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.13@tcp, seq: 165 00000100:00100000:1.0:1783441383.375292:0:5778:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a848f36450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:51c2a82e-e792-4f56-84e8-12cc033e9e70+9:5571:x1870073673290624:12345-192.168.201.13@tcp:503: 00000100:00100000:1.0:1783441383.377408:0:5778:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a848f36450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:51c2a82e-e792-4f56-84e8-12cc033e9e70+9:5571:x1870073673290624:12345-192.168.201.13@tcp:503: Request processed in 2097us (2387us total) trans 0 rc 0/0 00000100:00100000:1.0:1783441383.377423:0:5778:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.13@tcp, seq: 165 00000100:00100000:3.0:1783441383.405501:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.13@tcp (source: 12345-192.168.201.13@tcp) 00000100:00100000:0.0:1783441383.405862:0:5779:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073673290752 00000100:00100000:0.0:1783441383.405872:0:5779:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073673290752 00000100:00100000:0.0:1783441383.405936:0:5779:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.13@tcp, seq: 166 00000100:00100000:0.0:1783441383.405947:0:5779:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a848f36c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:51c2a82e-e792-4f56-84e8-12cc033e9e70+9:6041:x1870073673290752:12345-192.168.201.13@tcp:502: 00000100:00100000:0.0:1783441383.406381:0:5779:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a848f36c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:51c2a82e-e792-4f56-84e8-12cc033e9e70+9:6041:x1870073673290752:12345-192.168.201.13@tcp:502: Request processed in 435us (889us total) trans 0 rc 0/0 00000100:00100000:0.0:1783441383.406389:0:5779:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.13@tcp, seq: 166 00000100:00100000:3.0:1783441383.415399:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.13@tcp (source: 12345-192.168.201.13@tcp) 00000100:00100000:1.0:1783441383.415793:0:5778:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073673290880 00000100:00100000:1.0:1783441383.415803:0:5778:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073673290880 00000100:00100000:1.0:1783441383.415863:0:5778:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.13@tcp, seq: 167 00000100:00100000:1.0:1783441383.415872:0:5778:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a848f37c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:51c2a82e-e792-4f56-84e8-12cc033e9e70+9:6041:x1870073673290880:12345-192.168.201.13@tcp:502:llog_process_th.0 00000100:00100000:1.0:1783441383.416119:0:5778:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a848f37c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:51c2a82e-e792-4f56-84e8-12cc033e9e70+9:6041:x1870073673290880:12345-192.168.201.13@tcp:502:llog_process_th.0 Request processed in 248us (731us total) trans 0 rc 0/0 00000100:00100000:1.0:1783441383.416135:0:5778:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.13@tcp, seq: 167 00000100:00100000:1.0:1783441383.428071:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.13@tcp (source: 12345-192.168.201.13@tcp) 00000100:00100000:2.0:1783441383.428178:0:5780:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073673291008 00000100:00100000:2.0:1783441383.428187:0:5780:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073673291008 00000100:00100000:2.0:1783441383.428254:0:5780:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.13@tcp, seq: 168 00000100:00100000:2.0:1783441383.428265:0:5780:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a848f36050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:51c2a82e-e792-4f56-84e8-12cc033e9e70+9:5571:x1870073673291008:12345-192.168.201.13@tcp:101:ll_cfg_requeue.0 00010000:00010000:2.0:1783441383.428284:0:5780:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1783441383.428303:0:5780:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff91a85f83dc00/0xa2426164df2c77c8 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: local remote: 0x633a354aa4df4ca2 expref: -99 pid: 5780 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783441383.428331:0:5780:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff91a85f83dc00/0xa2426164df2c77c8 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x50000000000000 nid: 192.168.201.13@tcp remote: 0x633a354aa4df4ca2 expref: 10 pid: 5780 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783441383.428342:0:5780:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff91a85f83dc00/0xa2426164df2c77c8 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: 192.168.201.13@tcp remote: 0x633a354aa4df4ca2 expref: 10 pid: 5780 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783441383.428351:0:5780:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91a85f83dc00, rc 0) 00000100:00100000:2.0:1783441383.428425:0:5780:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a848f36050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:51c2a82e-e792-4f56-84e8-12cc033e9e70+10:5571:x1870073673291008:12345-192.168.201.13@tcp:101:ll_cfg_requeue.0 Request processed in 162us (364us total) trans 0 rc 0/0 00000100:00100000:2.0:1783441383.428433:0:5780:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.13@tcp, seq: 168 00000100:00100000:3.0:1783441383.440131:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.13@tcp (source: 12345-192.168.201.13@tcp) 00000100:00100000:0.0:1783441383.440253:0:5779:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073673291136 00000100:00100000:0.0:1783441383.440264:0:5779:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073673291136 00000100:00100000:0.0:1783441383.440328:0:5779:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.13@tcp, seq: 169 00000100:00100000:0.0:1783441383.440338:0:5779:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a848f37850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:51c2a82e-e792-4f56-84e8-12cc033e9e70+10:5571:x1870073673291136:12345-192.168.201.13@tcp:501:ll_cfg_requeue.0 00000100:00100000:0.0:1783441383.440854:0:5779:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a848f37850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:51c2a82e-e792-4f56-84e8-12cc033e9e70+10:5571:x1870073673291136:12345-192.168.201.13@tcp:501:ll_cfg_requeue.0 Request processed in 515us (732us total) trans 0 rc -2/-2 00000100:00100000:0.0:1783441383.440863:0:5779:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.13@tcp, seq: 169 00010000:00010000:3.0:1783441383.533056:0:5773:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:0.0:1783441384.318122:0:8355:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007fff81270a00 20000000:00000080:0.0:1783441384.318139:0:8355:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff91a875314000 uarg=0000000000000000 20000000:01000000:0.0:1783441384.318208:0:8355:0:(mgs_llog.c:6188:mgs_set_param2()) set_param2 fs='' device='general' param='lod.*.mdt_hash=crush' 20000000:01000000:0.0:1783441384.318213:0:8355:0:(mgs_llog.c:4643:mgs_write_log_param2()) next param 'lod.*.mdt_hash=crush' 20000000:01000000:0.0:1783441384.318217:0:8355:0:(mgs_llog.c:1379:mgs_modify_param()) modify params/general/lod.*.mdt_hash=crush del=0 00000040:00080000:0.0:1783441384.319314:0:8356:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 4 count 4 20000000:02000000:1.0:1783441384.319585:0:8355:0:(mgs_llog.c:4116:mgs_wlp_lcfg()) Setting parameter general.lod.*.mdt_hash=crush in log params 00000040:00080000:0.0:1783441384.324373:0:8355:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].4, 224 off8976 00000040:00080000:0.0:1783441384.324430:0:8355:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].5, 112 off9088 00000040:00080000:0.0:1783441384.324485:0:8355:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].6, 224 off9312 10000000:01000000:0.0:1783441384.324518:0:8355:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 00010000:00010000:0.0:1783441384.324538:0:8355:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff91a840031a00/0xa2426164df2c77cf lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8355 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783441384.324555:0:8355:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff91a85eb3ce00/0xa2426164df2c7598 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xa2426164df2c7591 expref: 18 pid: 5780 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783441384.324562:0:8355:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff91a841476800/0xa2426164df2c760f lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xa2426164df2c7608 expref: 18 pid: 5780 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783441384.324568:0:8355:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff91a85f83d400/0xa2426164df2c7671 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xa2426164df2c766a expref: 18 pid: 5778 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783441384.324578:0:8355:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff91a840030200/0xa2426164df2c772e lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 192.168.201.13@tcp remote: 0x633a354aa4df4c6a expref: 9 pid: 5779 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783441384.324585:0:8355:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff91a840031a00/0xa2426164df2c77cf lrc: 7/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 8355 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783441384.324625:0:8355:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff91a840030200/0xa2426164df2c772e lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000020 nid: 192.168.201.13@tcp remote: 0x633a354aa4df4c6a expref: 9 pid: 5779 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783441384.324644:0:8355:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff91a840030200/0xa2426164df2c772e lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x70000400000020 nid: 192.168.201.13@tcp remote: 0x633a354aa4df4c6a expref: 9 pid: 5779 timeout: 322 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783441384.324662:0:8355:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff91a844b7f480 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8355:1870073693241600:192.168.201.13@tcp:104: 00010000:00010000:0.0:1783441384.325131:0:8355:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff91a85f83d400/0xa2426164df2c7671 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xa2426164df2c766a expref: 18 pid: 5778 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783441384.325165:0:8355:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff91a85f83d400/0xa2426164df2c7671 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xa2426164df2c766a expref: 18 pid: 5778 timeout: 372 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783441384.325175:0:8355:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff91a844b7d880 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8355:1870073693241728:0@lo:104: 00000100:00100000:0.0:1783441384.325229:0:8355:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1783441384.325263:0:8355:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff91a841476800/0xa2426164df2c760f lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xa2426164df2c7608 expref: 18 pid: 5780 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783441384.325271:0:8355:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff91a841476800/0xa2426164df2c760f lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xa2426164df2c7608 expref: 18 pid: 5780 timeout: 372 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783441384.325279:0:8355:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff91a844b7fb80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8355:1870073693241856:0@lo:104: 00000100:00100000:0.0:1783441384.325303:0:8355:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1783441384.325330:0:8355:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff91a85eb3ce00/0xa2426164df2c7598 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xa2426164df2c7591 expref: 18 pid: 5780 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783441384.325338:0:8355:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff91a85eb3ce00/0xa2426164df2c7598 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xa2426164df2c7591 expref: 18 pid: 5780 timeout: 372 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783441384.325346:0:8355:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff91a844b7d180 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8355:1870073693241984:0@lo:104: 00000100:00100000:0.0:1783441384.325363:0:8355:0:(client.c:2702:ptlrpc_set_wait()) set ffff91a87d800180 going to sleep for 11 seconds 00000100:00100000:2.0:1783441384.325622:0:5767:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/2 left), rc = 0 00000100:00100000:2.0:1783441384.325641:0:5767:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783441384.325652:0:5767:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073693241728 00000100:00100000:2.0:1783441384.325659:0:5767:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073693241728 00000100:00100000:2.0:1783441384.325699:0:5767:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073693241856 00000100:00100000:2.0:1783441384.325702:0:5767:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073693241856 00000100:00100000:2.0:1783441384.325713:0:5767:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073693241984 00000100:00100000:2.0:1783441384.325715:0:5767:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073693241984 00000100:00100000:2.0:1783441384.325729:0:5767:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:2.0:1783441384.325737:0:5767:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a844b7e680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:6c1ddb50-5795-40c6-a2b6-8f58add9da62+5:8355:x1870073693241728:12345-0@lo:104: 00010000:00010000:2.0:1783441384.325784:0:5767:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.113@tcp lock: ffff91a841477600/0xa2426164df2c766a lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xa2426164df2c7671 expref: -99 pid: 7474 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783441384.325848:0:5767:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:2.0:1783441384.325855:0:5767:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a844b7e680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:6c1ddb50-5795-40c6-a2b6-8f58add9da62+5:8355:x1870073693241728:12345-0@lo:104: Request processed in 119us (626us total) trans 0 rc 0/0 00000100:00100000:2.0:1783441384.325862:0:5767:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00100000:2.0:1783441384.325880:0:5767:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:2.0:1783441384.325886:0:5767:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a746e2bc50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:6c1ddb50-5795-40c6-a2b6-8f58add9da62+4:8355:x1870073693241856:12345-0@lo:104: 00010000:00010000:2.0:1783441384.325893:0:5767:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.113@tcp lock: ffff91a841477800/0xa2426164df2c7608 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xa2426164df2c760f expref: -99 pid: 5783 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783441384.325925:0:5767:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:2.0:1783441384.325929:0:5767:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a746e2bc50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:6c1ddb50-5795-40c6-a2b6-8f58add9da62+4:8355:x1870073693241856:12345-0@lo:104: Request processed in 45us (625us total) trans 0 rc 0/0 00000100:00100000:2.0:1783441384.325934:0:5767:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00100000:2.0:1783441384.325959:0:5767:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:2.0:1783441384.325964:0:5767:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a867cd5f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:6c1ddb50-5795-40c6-a2b6-8f58add9da62+3:8355:x1870073693241984:12345-0@lo:104: 00010000:00010000:2.0:1783441384.325972:0:5767:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.113@tcp lock: ffff91a85eb3d200/0xa2426164df2c7591 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xa2426164df2c7598 expref: -99 pid: 6577 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783441384.325996:0:5767:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to priority blp list, 3 blwis in pool 00000100:00100000:2.0:1783441384.326001:0:5767:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a867cd5f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:6c1ddb50-5795-40c6-a2b6-8f58add9da62+3:8355:x1870073693241984:12345-0@lo:104: Request processed in 37us (359us total) trans 0 rc 0/0 00000100:00100000:2.0:1783441384.326006:0:5767:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00010000:00010000:2.0:1783441384.326022:0:5772:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:2.0:1783441384.326028:0:5772:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.113@tcp lock: ffff91a841477600/0xa2426164df2c766a lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xa2426164df2c7671 expref: -99 pid: 7474 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783441384.326035:0:5772:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91a841477600 already unused, calling callback (ffffffffc1b78c20) 10000000:00010000:2.0:1783441384.326045:0:5772:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.113@tcp lock: ffff91a841477600/0xa2426164df2c766a lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0xa2426164df2c7671 expref: -99 pid: 7474 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783441384.326054:0:5772:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.113@tcp lock: ffff91a841477600/0xa2426164df2c766a lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0xa2426164df2c7671 expref: -99 pid: 7474 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1783441384.326061:0:5772:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.113@tcp lock: ffff91a841477600/0xa2426164df2c766a lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0xa2426164df2c7671 expref: -99 pid: 7474 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1783441384.326067:0:5772:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:2.0:1783441384.326093:0:5772:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.113@tcp lock: ffff91a841477600/0xa2426164df2c766a lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xa2426164df2c7671 expref: -99 pid: 7474 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783441384.326100:0:5772:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1783441384.326120:0:5772:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.113@tcp lock: ffff91a841477600/0xa2426164df2c766a lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xa2426164df2c7671 expref: -99 pid: 7474 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783441384.326127:0:5772:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.113@tcp lock: ffff91a841477600/0xa2426164df2c766a lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xa2426164df2c7671 expref: -99 pid: 7474 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783441384.326150:0:5772:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1783441384.326153:0:5772:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.113@tcp lock: ffff91a841477800/0xa2426164df2c7608 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xa2426164df2c760f expref: -99 pid: 5783 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783441384.326160:0:5772:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91a841477800 already unused, calling callback (ffffffffc1b78c20) 10000000:00010000:2.0:1783441384.326163:0:5772:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.113@tcp lock: ffff91a841477800/0xa2426164df2c7608 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0xa2426164df2c760f expref: -99 pid: 5783 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783441384.326169:0:5772:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.113@tcp lock: ffff91a841477800/0xa2426164df2c7608 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0xa2426164df2c760f expref: -99 pid: 5783 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1783441384.326185:0:5772:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.113@tcp lock: ffff91a841477800/0xa2426164df2c7608 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0xa2426164df2c760f expref: -99 pid: 5783 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1783441384.326190:0:5772:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:2.0:1783441384.326203:0:5772:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.113@tcp lock: ffff91a841477800/0xa2426164df2c7608 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xa2426164df2c760f expref: -99 pid: 5783 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783441384.326208:0:5772:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1783441384.326214:0:5772:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.113@tcp lock: ffff91a841477800/0xa2426164df2c7608 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xa2426164df2c760f expref: -99 pid: 5783 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783441384.326220:0:5772:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.113@tcp lock: ffff91a841477800/0xa2426164df2c7608 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xa2426164df2c760f expref: -99 pid: 5783 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783441384.326228:0:5772:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1783441384.326231:0:5772:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.113@tcp lock: ffff91a85eb3d200/0xa2426164df2c7591 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xa2426164df2c7598 expref: -99 pid: 6577 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783441384.326235:0:5772:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91a85eb3d200 already unused, calling callback (ffffffffc1b78c20) 10000000:00010000:2.0:1783441384.326237:0:5772:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.113@tcp lock: ffff91a85eb3d200/0xa2426164df2c7591 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xa2426164df2c7598 expref: -99 pid: 6577 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783441384.326243:0:5772:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.113@tcp lock: ffff91a85eb3d200/0xa2426164df2c7591 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xa2426164df2c7598 expref: -99 pid: 6577 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1783441384.326250:0:5772:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.113@tcp lock: ffff91a85eb3d200/0xa2426164df2c7591 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xa2426164df2c7598 expref: -99 pid: 6577 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1783441384.326255:0:5772:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:2.0:1783441384.326273:0:5772:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.113@tcp lock: ffff91a85eb3d200/0xa2426164df2c7591 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xa2426164df2c7598 expref: -99 pid: 6577 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783441384.326279:0:5772:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1783441384.326292:0:5772:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.113@tcp lock: ffff91a85eb3d200/0xa2426164df2c7591 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xa2426164df2c7598 expref: -99 pid: 6577 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783441384.326299:0:5772:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.113@tcp lock: ffff91a85eb3d200/0xa2426164df2c7591 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xa2426164df2c7598 expref: -99 pid: 6577 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783441384.326313:0:5772:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783441384.326315:0:5772:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783441384.326317:0:5772:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783441384.326323:0:5773:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1783441384.326334:0:3305:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff91a867cd6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:6c1ddb50-5795-40c6-a2b6-8f58add9da62:3305:1870073693242112:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1783441384.326364:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783441384.326456:0:8355:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff91a844b7d880 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8355:1870073693241728:0@lo:104: 00000100:00100000:0.0:1783441384.326465:0:8355:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff91a844b7fb80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8355:1870073693241856:0@lo:104: 00000100:00100000:0.0:1783441384.326472:0:8355:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff91a844b7d180 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8355:1870073693241984:0@lo:104: 00000100:00100000:3.0:1783441384.332503:0:3303:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff91a867cd7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:6c1ddb50-5795-40c6-a2b6-8f58add9da62:3303:1870073693242368:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1783441384.332577:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783441384.332660:0:5769:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073693242112 00000100:00100000:1.0:1783441384.332669:0:5769:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073693242112 00010000:00010000:1.0:1783441384.332713:0:5769:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff91a85f83d400/0xa2426164df2c7671 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xa2426164df2c766a expref: 19 pid: 5778 timeout: 372 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783441384.332765:0:5769:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073693242368 00000100:00100000:1.0:1783441384.332769:0:5769:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073693242368 00010000:00010000:1.0:1783441384.332781:0:5769:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff91a85eb3ce00/0xa2426164df2c7598 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xa2426164df2c7591 expref: 20 pid: 5780 timeout: 372 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783441384.332796:0:5769:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:1.0:1783441384.332804:0:5769:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a867cd7800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:6c1ddb50-5795-40c6-a2b6-8f58add9da62+20:3305:x1870073693242112:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1783441384.332819:0:5769:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1783441384.332824:0:5769:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff91a85f83d400/0xa2426164df2c7671 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xa2426164df2c766a expref: 20 pid: 5778 timeout: 372 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783441384.332835:0:5769:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff91a85f83d400/0xa2426164df2c7671 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xa2426164df2c766a expref: 20 pid: 5778 timeout: 372 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783441384.332853:0:5769:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff91a85f83d400/0xa2426164df2c7671 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xa2426164df2c766a expref: 20 pid: 5778 timeout: 372 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783441384.332869:0:5769:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1783441384.332902:0:5769:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a867cd7800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:6c1ddb50-5795-40c6-a2b6-8f58add9da62+19:3305:x1870073693242112:12345-0@lo:103:ldlm_bl.0 Request processed in 98us (6536us total) trans 0 rc 0/0 00000100:00100000:1.0:1783441384.332909:0:5769:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00100000:1.0:1783441384.332938:0:5769:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:1.0:1783441384.332944:0:5769:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a87d4eb100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:6c1ddb50-5795-40c6-a2b6-8f58add9da62+18:3303:x1870073693242368:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1783441384.332950:0:5769:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1783441384.332954:0:5769:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff91a85eb3ce00/0xa2426164df2c7598 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xa2426164df2c7591 expref: 18 pid: 5780 timeout: 372 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783441384.332962:0:5769:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff91a85eb3ce00/0xa2426164df2c7598 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xa2426164df2c7591 expref: 18 pid: 5780 timeout: 372 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783441384.332971:0:5769:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff91a85eb3ce00/0xa2426164df2c7598 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xa2426164df2c7591 expref: 18 pid: 5780 timeout: 372 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783441384.332979:0:5769:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1783441384.333002:0:5769:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a87d4eb100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:6c1ddb50-5795-40c6-a2b6-8f58add9da62+17:3303:x1870073693242368:12345-0@lo:103:ldlm_bl.0 Request processed in 59us (427us total) trans 0 rc 0/0 00000100:00100000:1.0:1783441384.333008:0:5769:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:2.0:1783441384.333453:0:3305:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff91a867cd6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:6c1ddb50-5795-40c6-a2b6-8f58add9da62:3305:1870073693242112:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1783441384.333475:0:3305:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1783441384.333482:0:3305:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff91a867cd5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:6c1ddb50-5795-40c6-a2b6-8f58add9da62:3305:1870073693242240:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1783441384.333510:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783441384.333556:0:5771:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073693242240 00000100:00100000:2.0:1783441384.333561:0:5771:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073693242240 00010000:00010000:2.0:1783441384.333580:0:5771:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff91a841476800/0xa2426164df2c760f lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xa2426164df2c7608 expref: 17 pid: 5780 timeout: 372 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783441384.333602:0:5771:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:2.0:1783441384.333607:0:5771:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a867cd6a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:6c1ddb50-5795-40c6-a2b6-8f58add9da62+17:3305:x1870073693242240:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1783441384.333615:0:5771:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1783441384.333619:0:5771:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff91a841476800/0xa2426164df2c760f lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xa2426164df2c7608 expref: 17 pid: 5780 timeout: 372 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783441384.333634:0:5771:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff91a841476800/0xa2426164df2c760f lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xa2426164df2c7608 expref: 17 pid: 5780 timeout: 372 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783441384.333644:0:5771:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff91a841476800/0xa2426164df2c760f lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xa2426164df2c7608 expref: 17 pid: 5780 timeout: 372 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783441384.333654:0:5771:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1783441384.333680:0:5771:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a867cd6a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:6c1ddb50-5795-40c6-a2b6-8f58add9da62+16:3305:x1870073693242240:12345-0@lo:103:ldlm_bl.0 Request processed in 73us (169us total) trans 0 rc 0/0 00000100:00100000:2.0:1783441384.333686:0:5771:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00100000:2.0:1783441384.333709:0:3305:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff91a867cd5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:6c1ddb50-5795-40c6-a2b6-8f58add9da62:3305:1870073693242240:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1783441384.334030:0:3303:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff91a867cd7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:6c1ddb50-5795-40c6-a2b6-8f58add9da62:3303:1870073693242368:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1783441384.339379:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.13@tcp (source: 12345-192.168.201.13@tcp) 00000100:00100000:2.0:1783441384.339457:0:5771:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073673291264 00000100:00100000:2.0:1783441384.339467:0:5771:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073673291264 00010000:00010000:2.0:1783441384.339509:0:5771:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff91a840030200/0xa2426164df2c772e lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 192.168.201.13@tcp remote: 0x633a354aa4df4c6a expref: 10 pid: 5779 timeout: 322 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783441384.339554:0:5771:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.13@tcp, seq: 24 00000100:00100000:2.0:1783441384.339565:0:5771:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a87d4e9f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:51c2a82e-e792-4f56-84e8-12cc033e9e70+10:2355:x1870073673291264:12345-192.168.201.13@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1783441384.339580:0:5771:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1783441384.339585:0:5771:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff91a840030200/0xa2426164df2c772e lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.201.13@tcp remote: 0x633a354aa4df4c6a expref: 10 pid: 5779 timeout: 322 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783441384.339598:0:5771:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff91a840030200/0xa2426164df2c772e lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 192.168.201.13@tcp remote: 0x633a354aa4df4c6a expref: 10 pid: 5779 timeout: 322 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783441384.339621:0:5771:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff91a840031a00/0xa2426164df2c77cf lrc: 3/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 8355 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783441384.339652:0:5771:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff91a840031a00/0xa2426164df2c77cf lrc: 4/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 8355 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783441384.339670:0:5771:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff91a840031a00/0xa2426164df2c77cf lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 8355 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783441384.339677:0:5771:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff91a840031a00/0xa2426164df2c77cf lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 8355 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783441384.339684:0:5771:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff91a840031a00/0xa2426164df2c77cf lrc: 4/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 8355 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783441384.339690:0:5771:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff91a840031a00/0xa2426164df2c77cf lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 8355 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783441384.339699:0:5771:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91a840031a00 already unused, calling callback (ffffffffc155ff90) 00010000:00010000:2.0:1783441384.339703:0:5771:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff91a840031a00/0xa2426164df2c77cf lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 8355 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783441384.339713:0:5771:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff91a840031a00/0xa2426164df2c77cf lrc: 6/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 8355 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783441384.339724:0:5771:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff91a840031a00/0xa2426164df2c77cf lrc: 4/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 8355 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783441384.339736:0:5771:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1783441384.339840:0:5771:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a87d4e9f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:51c2a82e-e792-4f56-84e8-12cc033e9e70+10:2355:x1870073673291264:12345-192.168.201.13@tcp:103:ldlm_bl.0 Request processed in 276us (472us total) trans 0 rc 0/0 00000100:00100000:2.0:1783441384.339849:0:5771:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.13@tcp, seq: 24 00010000:00010000:0.0:1783441384.340020:0:8355:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff91a840030200/0xa2426164df2c772e lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44801400000020 nid: 192.168.201.13@tcp remote: 0x633a354aa4df4c6a expref: 9 pid: 5779 timeout: 322 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783441384.340045:0:8355:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff91a844b7f480 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8355:1870073693241600:192.168.201.13@tcp:104: 00010000:00010000:0.0:1783441384.340081:0:8355:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff91a840031a00/0xa2426164df2c77cf lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 8355 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783441384.340090:0:8355:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff91a840031a00/0xa2426164df2c77cf lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 8355 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783441384.340095:0:8355:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff91a840031a00/0xa2426164df2c77cf lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 8355 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783441384.340102:0:8355:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff91a840031a00/0xa2426164df2c77cf lrc: 0/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 8355 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783441384.558959:0:5772:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1783441384.813000:0:3303:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff91a87d4eb800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3303:1870073693242880:0@lo:400:kworker.0 00000100:00100000:3.0:1783441384.813073:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783441384.813149:0:3303:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:3.0:1783441384.813156:0:3303:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff91a87d4ebb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3303:1870073693242496:0@lo:400:kworker.0 00000100:00100000:3.0:1783441384.813180:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783441384.813197:0:3303:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff91a87d4e8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3303:1870073693243008:0@lo:400:kworker.0 00000100:00100000:3.0:1783441384.813221:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783441384.813260:0:5786:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073693242880 00000100:00100000:3.0:1783441384.813268:0:5786:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073693242880 00000100:00100000:3.0:1783441384.813323:0:5786:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073693242496 00000100:00100000:3.0:1783441384.813326:0:5786:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073693242496 00000100:00100000:3.0:1783441384.813349:0:5786:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:3.0:1783441384.813358:0:5786:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a87d4e8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3303:x1870073693242880:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1783441384.813432:0:5786:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a87d4e8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3303:x1870073693242880:12345-0@lo:400:kworker.0 Request processed in 75us (359us total) trans 0 rc 0/0 00000100:00100000:3.0:1783441384.813456:0:5786:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00100000:3.0:1783441384.813474:0:5786:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:3.0:1783441384.813481:0:5786:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a87d4ea300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3303:x1870073693242496:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1783441384.813511:0:5786:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a87d4ea300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3303:x1870073693242496:12345-0@lo:400:kworker.0 Request processed in 31us (331us total) trans 0 rc 0/0 00000100:00100000:3.0:1783441384.813516:0:5786:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00100000:3.0:1783441384.813535:0:6582:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073693243008 00000100:00100000:3.0:1783441384.813539:0:6582:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073693243008 00000100:00100000:3.0:1783441384.813561:0:6582:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:3.0:1783441384.813566:0:6582:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a87d4ea680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3303:x1870073693243008:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1783441384.813592:0:6582:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a87d4ea680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3303:x1870073693243008:12345-0@lo:400:kworker.0 Request processed in 26us (370us total) trans 0 rc 0/0 00000100:00100000:3.0:1783441384.813597:0:6582:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00080000:3.0:1783441384.813611:0:5781:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1783441384.813615:0:5781:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1783441384.813790:0:3306:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff91a87d4e9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3306:1870073693242752:0@lo:400:kworker.0 00000100:00100000:1.0:1783441384.813823:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783441384.813846:0:3306:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1783441384.813851:0:3306:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff91a87d4e9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3306:1870073693242624:0@lo:400:kworker.0 00000100:00100000:1.0:1783441384.813873:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783441384.813897:0:6581:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073693242752 00000100:00100000:1.0:1783441384.813901:0:6581:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073693242752 00000100:00100000:1.0:1783441384.813932:0:6581:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:1.0:1783441384.813938:0:6581:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a859084e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3306:x1870073693242752:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1783441384.813987:0:6581:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a859084e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3306:x1870073693242752:12345-0@lo:400:kworker.0 Request processed in 36us (150us total) trans 0 rc 0/0 00000100:00100000:1.0:1783441384.814003:0:6581:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00080000:1.0:1783441384.814019:0:5781:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:1.0:1783441384.814047:0:3306:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff91a87d4e9180 x1870073693242752/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1783441400 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1783441384.814060:0:3306:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff91a87d4e9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3306:1870073693242752:0@lo:400:kworker.0 00000100:00100000:1.0:1783441384.814081:0:5786:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073693242624 00000100:00100000:1.0:1783441384.814084:0:5786:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073693242624 00000100:00100000:1.0:1783441384.814112:0:5786:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:1.0:1783441384.814118:0:5786:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a859086300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3306:x1870073693242624:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1783441384.814164:0:5786:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a859086300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3306:x1870073693242624:12345-0@lo:400:kworker.0 Request processed in 46us (289us total) trans 0 rc 0/0 00000100:00100000:1.0:1783441384.814169:0:5786:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00080000:1.0:1783441384.814183:0:5781:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1783441384.814199:0:3306:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff91a87d4e9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3306:1870073693242624:0@lo:400:kworker.0 00000100:00100000:1.0:1783441384.814246:0:3303:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff91a87d4ebb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3303:1870073693242496:0@lo:400:kworker.0 00010000:00080000:1.0:1783441384.814257:0:3303:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff91a87d4e8000 x1870073693243008/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1783441400 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1783441384.814266:0:3303:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff91a87d4e8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3303:1870073693243008:0@lo:400:kworker.0 00000100:00100000:1.0:1783441384.814276:0:3303:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff91a87d4eb800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3303:1870073693242880:0@lo:400:kworker.0 00000100:00100000:3.0:1783441385.010226:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.13@tcp (source: 12345-192.168.201.13@tcp) 00000100:00100000:1.0:1783441385.013199:0:5778:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073673291392 00000100:00100000:1.0:1783441385.013223:0:5778:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073673291392 00000100:00100000:1.0:1783441385.013365:0:5778:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.13@tcp, seq: 170 00000100:00100000:1.0:1783441385.013389:0:5778:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a848f36850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:51c2a82e-e792-4f56-84e8-12cc033e9e70+9:5571:x1870073673291392:12345-192.168.201.13@tcp:101:ll_cfg_requeue.0 00010000:00010000:1.0:1783441385.013442:0:5778:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1783441385.013472:0:5778:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff91a87da47400/0xa2426164df2c77d6 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x633a354aa4df4ca9 expref: -99 pid: 5778 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783441385.013510:0:5778:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff91a87da47400/0xa2426164df2c77d6 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 192.168.201.13@tcp remote: 0x633a354aa4df4ca9 expref: 10 pid: 5778 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783441385.013524:0:5778:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff91a87da47400/0xa2426164df2c77d6 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 192.168.201.13@tcp remote: 0x633a354aa4df4ca9 expref: 10 pid: 5778 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783441385.013535:0:5778:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91a87da47400, rc 0) 00000100:00100000:1.0:1783441385.013642:0:5778:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a848f36850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:51c2a82e-e792-4f56-84e8-12cc033e9e70+10:5571:x1870073673291392:12345-192.168.201.13@tcp:101:ll_cfg_requeue.0 Request processed in 265us (3433us total) trans 0 rc 0/0 00000100:00100000:1.0:1783441385.013649:0:5778:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.13@tcp, seq: 170 00000100:00100000:3.0:1783441385.025380:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.13@tcp (source: 12345-192.168.201.13@tcp) 00000100:00100000:0.0:1783441385.025468:0:5779:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073673291520 00000100:00100000:0.0:1783441385.025484:0:5779:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073673291520 00000100:00100000:0.0:1783441385.025562:0:5779:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.13@tcp, seq: 171 00000100:00100000:0.0:1783441385.025577:0:5779:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a848f35450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:51c2a82e-e792-4f56-84e8-12cc033e9e70+10:5571:x1870073673291520:12345-192.168.201.13@tcp:501:ll_cfg_requeue.0 00000100:00100000:0.0:1783441385.026039:0:5779:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a848f35450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:51c2a82e-e792-4f56-84e8-12cc033e9e70+10:5571:x1870073673291520:12345-192.168.201.13@tcp:501:ll_cfg_requeue.0 Request processed in 463us (675us total) trans 0 rc 0/0 00000100:00100000:0.0:1783441385.026050:0:5779:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.13@tcp, seq: 171 00000100:00100000:3.0:1783441385.029396:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.13@tcp (source: 12345-192.168.201.13@tcp) 00000100:00100000:0.0:1783441385.030061:0:5778:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073673291648 00000100:00100000:0.0:1783441385.030075:0:5778:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073673291648 00000100:00100000:0.0:1783441385.030157:0:5778:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.13@tcp, seq: 172 00000100:00100000:0.0:1783441385.030168:0:5778:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a848f35850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:51c2a82e-e792-4f56-84e8-12cc033e9e70+10:5571:x1870073673291648:12345-192.168.201.13@tcp:503:ll_cfg_requeue.0 00000100:00100000:0.0:1783441385.030486:0:5778:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a848f35850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:51c2a82e-e792-4f56-84e8-12cc033e9e70+10:5571:x1870073673291648:12345-192.168.201.13@tcp:503:ll_cfg_requeue.0 Request processed in 317us (1115us total) trans 0 rc 0/0 00000100:00100000:0.0:1783441385.030505:0:5778:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.13@tcp, seq: 172 00000100:00100000:3.0:1783441385.038439:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.13@tcp (source: 12345-192.168.201.13@tcp) 00000100:00100000:3.0:1783441385.038495:0:5780:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073673291776 00000100:00100000:3.0:1783441385.038508:0:5780:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073673291776 00000100:00100000:3.0:1783441385.038587:0:5780:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.13@tcp, seq: 173 00000100:00100000:3.0:1783441385.038600:0:5780:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a848f37050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:51c2a82e-e792-4f56-84e8-12cc033e9e70+10:6094:x1870073673291776:12345-192.168.201.13@tcp:502:llog_process_th.0 00000100:00100000:3.0:1783441385.039072:0:5780:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a848f37050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:51c2a82e-e792-4f56-84e8-12cc033e9e70+10:6094:x1870073673291776:12345-192.168.201.13@tcp:502:llog_process_th.0 Request processed in 469us (642us total) trans 0 rc 0/0 00000100:00100000:3.0:1783441385.039083:0:5780:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.13@tcp, seq: 173 00000100:00100000:0.0:1783441385.047461:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.13@tcp (source: 12345-192.168.201.13@tcp) 00000100:00100000:1.0:1783441385.047551:0:5779:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073673291904 00000100:00100000:1.0:1783441385.047565:0:5779:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073673291904 00000100:00100000:1.0:1783441385.047632:0:5779:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.13@tcp, seq: 174 00000100:00100000:1.0:1783441385.047644:0:5779:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a848f34050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:51c2a82e-e792-4f56-84e8-12cc033e9e70+10:6094:x1870073673291904:12345-192.168.201.13@tcp:502:llog_process_th.0 00000100:00100000:1.0:1783441385.048046:0:5779:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a848f34050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:51c2a82e-e792-4f56-84e8-12cc033e9e70+10:6094:x1870073673291904:12345-192.168.201.13@tcp:502:llog_process_th.0 Request processed in 402us (599us total) trans 0 rc 0/0 00000100:00100000:1.0:1783441385.048055:0:5779:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.13@tcp, seq: 174 00000100:00100000:2.0:1783441385.326071:0:3306:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1783441385.326121:0:3306:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff91a867cd5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3306:1870073693243136:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1783441385.326224:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783441385.326314:0:6585:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073693243136 00000100:00100000:2.0:1783441385.326325:0:6585:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073693243136 00000100:00100000:2.0:1783441385.326388:0:6585:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:2.0:1783441385.326398:0:6585:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a867cd4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3306:x1870073693243136:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1783441385.326645:0:6585:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1783441385.326706:0:6585:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a867cd4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3306:x1870073693243136:12345-0@lo:13:osp-pre-1-0.0 Request processed in 308us (481us total) trans 0 rc 0/0 00000100:00100000:2.0:1783441385.326865:0:6585:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00010000:00080000:2.0:1783441385.326919:0:3306:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff91a867cd5c00 x1870073693243136/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1783441401 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1783441385.327101:0:3306:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff91a867cd5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3306:1870073693243136:0@lo:13:osp-pre-1-0.0 00010000:00010000:2.0:1783441385.581017:0:5773:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:0.0:1783441385.967917:0:5783:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:0.0:1783441385.967928:0:5783:0:(mgc_request.c:1801:mgc_process_log()) Process log params-ffff91a875566000 from 4 10000000:01000000:0.0:1783441385.967937:0:5783:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:0.0:1783441385.968008:0:5783:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.113@tcp lock: ffff91a840031a00/0xa2426164df2c77dd lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5783 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783441385.968024:0:5783:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.113@tcp lock: ffff91a840031a00/0xa2426164df2c77dd lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5783 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783441385.968039:0:5783:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.113@tcp lock: ffff91a840031a00/0xa2426164df2c77dd lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5783 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783441385.968073:0:5783:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff91a844b7f480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6c1ddb50-5795-40c6-a2b6-8f58add9da62:5783:1870073693243264:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1783441385.968185:0:5783:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783441385.968243:0:5783:0:(client.c:2702:ptlrpc_set_wait()) set ffff91a87d800c00 going to sleep for 11 seconds 00000100:00100000:3.0:1783441385.968390:0:5780:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073693243264 00000100:00100000:3.0:1783441385.968402:0:5780:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073693243264 00000100:00100000:3.0:1783441385.968478:0:5780:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 175 00000100:00100000:3.0:1783441385.968490:0:5780:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a848f34450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6c1ddb50-5795-40c6-a2b6-8f58add9da62+16:5783:x1870073693243264:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1783441385.968509:0:5780:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1783441385.968528:0:5780:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff91a85eb3d600/0xa2426164df2c77e4 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xa2426164df2c77dd expref: -99 pid: 5780 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783441385.968558:0:5780:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff91a85eb3d600/0xa2426164df2c77e4 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xa2426164df2c77dd expref: 17 pid: 5780 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783441385.968571:0:5780:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff91a85eb3d600/0xa2426164df2c77e4 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xa2426164df2c77dd expref: 17 pid: 5780 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783441385.968584:0:5780:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91a85eb3d600, rc 0) 00000100:00100000:3.0:1783441385.968638:0:5780:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a848f34450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6c1ddb50-5795-40c6-a2b6-8f58add9da62+17:5783:x1870073693243264:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 151us (454us total) trans 0 rc 0/0 00000100:00100000:3.0:1783441385.968646:0:5780:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 175 00000100:00100000:2.0:1783441385.968841:0:5783:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff91a844b7f480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6c1ddb50-5795-40c6-a2b6-8f58add9da62:5783:1870073693243264:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1783441385.968860:0:5783:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.113@tcp lock: ffff91a840031a00/0xa2426164df2c77dd lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xa2426164df2c77e4 expref: -99 pid: 5783 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783441385.968870:0:5783:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.113@tcp lock: ffff91a840031a00/0xa2426164df2c77dd lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xa2426164df2c77e4 expref: -99 pid: 5783 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783441385.968949:0:5783:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff91a867cd5c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6c1ddb50-5795-40c6-a2b6-8f58add9da62:5783:1870073693243392:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1783441385.968980:0:5783:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783441385.969008:0:5783:0:(client.c:2702:ptlrpc_set_wait()) set ffff91a846fb4780 going to sleep for 11 seconds 00000100:00100000:3.0:1783441385.969108:0:5778:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073693243392 00000100:00100000:3.0:1783441385.969120:0:5778:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073693243392 00000100:00100000:3.0:1783441385.969153:0:5778:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 176 00000100:00100000:3.0:1783441385.969160:0:5778:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a848f37450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6c1ddb50-5795-40c6-a2b6-8f58add9da62+17:5783:x1870073693243392:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1783441385.969475:0:5778:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a848f37450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6c1ddb50-5795-40c6-a2b6-8f58add9da62+17:5783:x1870073693243392:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 315us (494us total) trans 0 rc 0/0 00000100:00100000:3.0:1783441385.969482:0:5778:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 176 00000100:00100000:2.0:1783441385.970167:0:5783:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff91a867cd5c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6c1ddb50-5795-40c6-a2b6-8f58add9da62:5783:1870073693243392:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1783441385.970216:0:5783:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff91a867cd5c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6c1ddb50-5795-40c6-a2b6-8f58add9da62:5783:1870073693243520:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1783441385.970273:0:5783:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783441385.970309:0:5783:0:(client.c:2702:ptlrpc_set_wait()) set ffff91a846fb4780 going to sleep for 11 seconds 00000100:00100000:3.0:1783441385.970350:0:5778:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073693243520 00000100:00100000:3.0:1783441385.970355:0:5778:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073693243520 00000100:00100000:3.0:1783441385.970391:0:5778:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 177 00000100:00100000:3.0:1783441385.970399:0:5778:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a848f35c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6c1ddb50-5795-40c6-a2b6-8f58add9da62+17:5783:x1870073693243520:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1783441385.970592:0:5778:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a848f35c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6c1ddb50-5795-40c6-a2b6-8f58add9da62+17:5783:x1870073693243520:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 193us (317us total) trans 0 rc 0/0 00000100:00100000:3.0:1783441385.970599:0:5778:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 177 00000100:00100000:2.0:1783441385.970724:0:5783:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff91a867cd5c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6c1ddb50-5795-40c6-a2b6-8f58add9da62:5783:1870073693243520:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1783441385.972946:0:8407:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff91a867cd5c00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:6c1ddb50-5795-40c6-a2b6-8f58add9da62:8407:1870073693243648:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1783441385.973044:0:8407:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783441385.973095:0:8407:0:(client.c:2702:ptlrpc_set_wait()) set ffff91a846fb43c0 going to sleep for 11 seconds 00000100:00100000:3.0:1783441385.973167:0:5780:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073693243648 00000100:00100000:3.0:1783441385.973175:0:5780:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073693243648 00000100:00100000:3.0:1783441385.973235:0:5780:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 178 00000100:00100000:3.0:1783441385.973246:0:5780:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a848f35050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6c1ddb50-5795-40c6-a2b6-8f58add9da62+17:8407:x1870073693243648:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1783441385.973518:0:5780:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a848f35050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6c1ddb50-5795-40c6-a2b6-8f58add9da62+17:8407:x1870073693243648:12345-0@lo:502:llog_process_th.0 Request processed in 273us (473us total) trans 0 rc 0/0 00000100:00100000:3.0:1783441385.973526:0:5780:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 178 00000100:00100000:2.0:1783441385.973994:0:8407:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff91a867cd5c00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:6c1ddb50-5795-40c6-a2b6-8f58add9da62:8407:1870073693243648:0@lo:502:llog_process_th.0 00000020:01000000:2.0:1783441385.974036:0:8407:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1783441385.974050:0:8407:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1783441385.974052:0:8407:0:(obd_config.c:1561:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:2.0:1783441385.974059:0:8407:0:(obd_config.c:2005:class_config_llog_handler()) cmd ce032, instance name: general-ffff91a875566000 00000020:00000080:2.0:1783441385.974063:0:8407:0:(obd_config.c:1470:class_process_config()) processing cmd: ce032 00000100:00100000:2.0:1783441385.974171:0:8407:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff91a867cd5c00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:6c1ddb50-5795-40c6-a2b6-8f58add9da62:8407:1870073693243776:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1783441385.974214:0:8407:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783441385.974248:0:8407:0:(client.c:2702:ptlrpc_set_wait()) set ffff91a846fb43c0 going to sleep for 11 seconds 00000100:00100000:0.0:1783441385.974292:0:5779:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073693243776 00000100:00100000:0.0:1783441385.974297:0:5779:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073693243776 00000100:00100000:0.0:1783441385.974339:0:5779:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 179 00000100:00100000:0.0:1783441385.974348:0:5779:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a848f34c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6c1ddb50-5795-40c6-a2b6-8f58add9da62+17:8407:x1870073693243776:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1783441385.974501:0:5779:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a848f34c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6c1ddb50-5795-40c6-a2b6-8f58add9da62+17:8407:x1870073693243776:12345-0@lo:502:llog_process_th.0 Request processed in 154us (287us total) trans 0 rc 0/0 00000100:00100000:0.0:1783441385.974508:0:5779:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 179 00000100:00100000:2.0:1783441385.976564:0:8407:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff91a867cd5c00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:6c1ddb50-5795-40c6-a2b6-8f58add9da62:8407:1870073693243776:0@lo:502:llog_process_th.0 00000020:01000000:2.0:1783441385.976631:0:8407:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1783441385.976645:0:8407:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1783441385.976647:0:8407:0:(obd_config.c:1561:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000040:00080000:2.0:1783441385.976652:0:8407:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 7 count 7 00000020:01000000:0.0:1783441385.980468:0:5783:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 4-6 (rc=0) 10000000:01000000:0.0:1783441385.980528:0:5783:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.201.113@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:0.0:1783441385.980544:0:5783:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.113@tcp lock: ffff91a840031a00/0xa2426164df2c77dd lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xa2426164df2c77e4 expref: -99 pid: 5783 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783441385.980574:0:5783:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.113@tcp lock: ffff91a840031a00/0xa2426164df2c77dd lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xa2426164df2c77e4 expref: -99 pid: 5783 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1783441385.980587:0:5783:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:0.0:1783441385.980590:0:5783:0:(mgc_request.c:1801:mgc_process_log()) Process log params-ffff91a867cf2000 from 4 10000000:01000000:0.0:1783441385.980593:0:5783:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:0.0:1783441385.980642:0:5783:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.113@tcp lock: ffff91a840030200/0xa2426164df2c77eb lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5783 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783441385.980651:0:5783:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.113@tcp lock: ffff91a840030200/0xa2426164df2c77eb lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5783 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783441385.980666:0:5783:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.113@tcp lock: ffff91a840030200/0xa2426164df2c77eb lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5783 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783441385.980698:0:5783:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff91a844b7d180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6c1ddb50-5795-40c6-a2b6-8f58add9da62:5783:1870073693243904:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1783441385.980819:0:5783:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783441385.980889:0:5783:0:(client.c:2702:ptlrpc_set_wait()) set ffff91a87d800900 going to sleep for 11 seconds 00000100:00100000:0.0:1783441385.980922:0:5778:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073693243904 00000100:00100000:0.0:1783441385.980932:0:5778:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073693243904 00000100:00100000:0.0:1783441385.980991:0:5778:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 180 00000100:00100000:0.0:1783441385.981002:0:5778:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a8655e5450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6c1ddb50-5795-40c6-a2b6-8f58add9da62+17:5783:x1870073693243904:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1783441385.981019:0:5778:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1783441385.981052:0:5778:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff91a85fe59600/0xa2426164df2c77f2 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0xa2426164df2c77eb expref: -99 pid: 5778 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783441385.981083:0:5778:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff91a85fe59600/0xa2426164df2c77f2 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xa2426164df2c77eb expref: 18 pid: 5778 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783441385.981106:0:5778:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff91a85fe59600/0xa2426164df2c77f2 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xa2426164df2c77eb expref: 18 pid: 5778 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783441385.981124:0:5778:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91a85fe59600, rc 0) 00000100:00100000:0.0:1783441385.981169:0:5778:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a8655e5450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6c1ddb50-5795-40c6-a2b6-8f58add9da62+18:5783:x1870073693243904:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 168us (350us total) trans 0 rc 0/0 00000100:00100000:0.0:1783441385.981177:0:5778:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 180 00000100:00100000:0.0:1783441385.981243:0:5783:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff91a844b7d180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6c1ddb50-5795-40c6-a2b6-8f58add9da62:5783:1870073693243904:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1783441385.981260:0:5783:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.113@tcp lock: ffff91a840030200/0xa2426164df2c77eb lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xa2426164df2c77f2 expref: -99 pid: 5783 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783441385.981270:0:5783:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.113@tcp lock: ffff91a840030200/0xa2426164df2c77eb lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xa2426164df2c77f2 expref: -99 pid: 5783 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783441385.981334:0:5783:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff91a844b7d180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6c1ddb50-5795-40c6-a2b6-8f58add9da62:5783:1870073693244032:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1783441385.981358:0:5783:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783441385.981376:0:5783:0:(client.c:2702:ptlrpc_set_wait()) set ffff91a87d800900 going to sleep for 11 seconds 00000100:00100000:0.0:1783441385.981391:0:5780:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073693244032 00000100:00100000:0.0:1783441385.981394:0:5780:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073693244032 00000100:00100000:0.0:1783441385.981417:0:5780:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 181 00000100:00100000:0.0:1783441385.981423:0:5780:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a8655e5850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6c1ddb50-5795-40c6-a2b6-8f58add9da62+18:5783:x1870073693244032:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1783441385.981734:0:5780:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a8655e5850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6c1ddb50-5795-40c6-a2b6-8f58add9da62+18:5783:x1870073693244032:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 310us (373us total) trans 0 rc 0/0 00000100:00100000:0.0:1783441385.981772:0:5780:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 181 00000100:00100000:0.0:1783441385.981818:0:5783:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff91a844b7d180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6c1ddb50-5795-40c6-a2b6-8f58add9da62:5783:1870073693244032:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1783441385.981859:0:5783:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff91a844b7d180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6c1ddb50-5795-40c6-a2b6-8f58add9da62:5783:1870073693244160:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1783441385.981900:0:5783:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783441385.981923:0:5783:0:(client.c:2702:ptlrpc_set_wait()) set ffff91a87d800900 going to sleep for 11 seconds 00000100:00100000:0.0:1783441385.981935:0:5779:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073693244160 00000100:00100000:0.0:1783441385.981938:0:5779:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073693244160 00000100:00100000:0.0:1783441385.981961:0:5779:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 182 00000100:00100000:0.0:1783441385.981967:0:5779:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a8655e7050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6c1ddb50-5795-40c6-a2b6-8f58add9da62+18:5783:x1870073693244160:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1783441385.982153:0:5779:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a8655e7050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6c1ddb50-5795-40c6-a2b6-8f58add9da62+18:5783:x1870073693244160:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 185us (252us total) trans 0 rc 0/0 00000100:00100000:0.0:1783441385.982160:0:5779:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 182 00000100:00100000:0.0:1783441385.982199:0:5783:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff91a844b7d180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6c1ddb50-5795-40c6-a2b6-8f58add9da62:5783:1870073693244160:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1783441385.982433:0:8409:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff91a844b7d180 pname:cluuid:pid:xid:nid:opc:job llog_process_th:6c1ddb50-5795-40c6-a2b6-8f58add9da62:8409:1870073693244288:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1783441385.982468:0:8409:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783441385.982489:0:5778:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073693244288 00000100:00100000:0.0:1783441385.982493:0:5778:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073693244288 00000100:00100000:0.0:1783441385.982513:0:5778:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 183 00000100:00100000:0.0:1783441385.982519:0:5778:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a8655e4050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6c1ddb50-5795-40c6-a2b6-8f58add9da62+18:8409:x1870073693244288:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1783441385.982647:0:5778:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a8655e4050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6c1ddb50-5795-40c6-a2b6-8f58add9da62+18:8409:x1870073693244288:12345-0@lo:502:llog_process_th.0 Request processed in 127us (178us total) trans 0 rc 0/0 00000100:00100000:0.0:1783441385.982654:0:5778:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 183 00000100:00100000:0.0:1783441385.982682:0:8409:0:(client.c:2702:ptlrpc_set_wait()) set ffff91a87d800900 going to sleep for 11 seconds 00000100:00100000:0.0:1783441385.982696:0:8409:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff91a844b7d180 pname:cluuid:pid:xid:nid:opc:job llog_process_th:6c1ddb50-5795-40c6-a2b6-8f58add9da62:8409:1870073693244288:0@lo:502:llog_process_th.0 00000020:01000000:0.0:1783441385.982718:0:8409:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1783441385.982733:0:8409:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1783441385.982771:0:8409:0:(obd_config.c:1561:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:0.0:1783441385.982781:0:8409:0:(obd_config.c:2005:class_config_llog_handler()) cmd ce032, instance name: general-ffff91a867cf2000 00000020:00000080:0.0:1783441385.982783:0:8409:0:(obd_config.c:1470:class_process_config()) processing cmd: ce032 00000100:00100000:0.0:1783441385.983434:0:8409:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff91a844b7d180 pname:cluuid:pid:xid:nid:opc:job llog_process_th:6c1ddb50-5795-40c6-a2b6-8f58add9da62:8409:1870073693244416:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1783441385.983488:0:8409:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783441385.983519:0:5780:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073693244416 00000100:00100000:0.0:1783441385.983525:0:5780:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073693244416 00000100:00100000:0.0:1783441385.983562:0:5780:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 184 00000100:00100000:0.0:1783441385.983570:0:5780:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a8655e4450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6c1ddb50-5795-40c6-a2b6-8f58add9da62+18:8409:x1870073693244416:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1783441385.983787:0:5780:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a8655e4450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6c1ddb50-5795-40c6-a2b6-8f58add9da62+18:8409:x1870073693244416:12345-0@lo:502:llog_process_th.0 Request processed in 217us (298us total) trans 0 rc 0/0 00000100:00100000:0.0:1783441385.983794:0:5780:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 184 00000100:00100000:0.0:1783441385.983844:0:8409:0:(client.c:2702:ptlrpc_set_wait()) set ffff91a87d800900 going to sleep for 11 seconds 00000100:00100000:0.0:1783441385.983860:0:8409:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff91a844b7d180 pname:cluuid:pid:xid:nid:opc:job llog_process_th:6c1ddb50-5795-40c6-a2b6-8f58add9da62:8409:1870073693244416:0@lo:502:llog_process_th.0 00000020:01000000:0.0:1783441385.983886:0:8409:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1783441385.983893:0:8409:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1783441385.983895:0:8409:0:(obd_config.c:1561:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000040:00080000:0.0:1783441385.983899:0:8409:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 7 count 7 00000020:01000000:0.0:1783441385.983970:0:5783:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 4-6 (rc=0) 10000000:01000000:0.0:1783441385.983998:0:5783:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.201.113@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:0.0:1783441385.984010:0:5783:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.113@tcp lock: ffff91a840030200/0xa2426164df2c77eb lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xa2426164df2c77f2 expref: -99 pid: 5783 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783441385.984023:0:5783:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.113@tcp lock: ffff91a840030200/0xa2426164df2c77eb lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xa2426164df2c77f2 expref: -99 pid: 5783 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1783441385.984037:0:5783:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:0.0:1783441385.984040:0:5783:0:(mgc_request.c:1801:mgc_process_log()) Process log params-ffff91a84869e800 from 4 10000000:01000000:0.0:1783441385.984043:0:5783:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:0.0:1783441385.984080:0:5783:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.113@tcp lock: ffff91a85fe58800/0xa2426164df2c77f9 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5783 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783441385.984088:0:5783:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.113@tcp lock: ffff91a85fe58800/0xa2426164df2c77f9 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5783 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783441385.984097:0:5783:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.113@tcp lock: ffff91a85fe58800/0xa2426164df2c77f9 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5783 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783441385.984111:0:5783:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff91a844b7d180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6c1ddb50-5795-40c6-a2b6-8f58add9da62:5783:1870073693244544:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1783441385.998141:0:5783:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783441385.998217:0:5783:0:(client.c:2702:ptlrpc_set_wait()) set ffff91a87d800900 going to sleep for 11 seconds 00000100:00100000:0.0:1783441385.998264:0:5779:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073693244544 00000100:00100000:0.0:1783441385.998276:0:5779:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073693244544 00000100:00100000:0.0:1783441385.998347:0:5779:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 185 00000100:00100000:0.0:1783441385.998360:0:5779:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a8655e7450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6c1ddb50-5795-40c6-a2b6-8f58add9da62+18:5783:x1870073693244544:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1783441385.998387:0:5779:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1783441385.998413:0:5779:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff91a85fe58000/0xa2426164df2c7800 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0xa2426164df2c77f9 expref: -99 pid: 5779 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783441385.998454:0:5779:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff91a85fe58000/0xa2426164df2c7800 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xa2426164df2c77f9 expref: 19 pid: 5779 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783441385.998468:0:5779:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff91a85fe58000/0xa2426164df2c7800 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xa2426164df2c77f9 expref: 19 pid: 5779 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783441385.998478:0:5779:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91a85fe58000, rc 0) 00000100:00100000:0.0:1783441385.998526:0:5779:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a8655e7450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6c1ddb50-5795-40c6-a2b6-8f58add9da62+19:5783:x1870073693244544:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 168us (390us total) trans 0 rc 0/0 00000100:00100000:0.0:1783441385.998533:0:5779:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 185 00000100:00100000:0.0:1783441385.998610:0:5783:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff91a844b7d180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6c1ddb50-5795-40c6-a2b6-8f58add9da62:5783:1870073693244544:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1783441385.998630:0:5783:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.113@tcp lock: ffff91a85fe58800/0xa2426164df2c77f9 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xa2426164df2c7800 expref: -99 pid: 5783 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783441385.998641:0:5783:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.113@tcp lock: ffff91a85fe58800/0xa2426164df2c77f9 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0xa2426164df2c7800 expref: -99 pid: 5783 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783441385.998725:0:5783:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff91a844b7d180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6c1ddb50-5795-40c6-a2b6-8f58add9da62:5783:1870073693244672:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1783441385.998802:0:5783:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783441385.998825:0:5783:0:(client.c:2702:ptlrpc_set_wait()) set ffff91a87d800900 going to sleep for 11 seconds 00000100:00100000:0.0:1783441385.998840:0:5778:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073693244672 00000100:00100000:0.0:1783441385.998843:0:5778:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073693244672 00000100:00100000:0.0:1783441385.998867:0:5778:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 186 00000100:00100000:0.0:1783441385.998874:0:5778:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a8655e5c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6c1ddb50-5795-40c6-a2b6-8f58add9da62+19:5783:x1870073693244672:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1783441385.999201:0:5778:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a8655e5c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6c1ddb50-5795-40c6-a2b6-8f58add9da62+19:5783:x1870073693244672:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 326us (398us total) trans 0 rc 0/0 00000100:00100000:0.0:1783441385.999208:0:5778:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 186 00000100:00100000:0.0:1783441385.999239:0:5783:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff91a844b7d180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6c1ddb50-5795-40c6-a2b6-8f58add9da62:5783:1870073693244672:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1783441385.999272:0:5783:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff91a844b7d180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6c1ddb50-5795-40c6-a2b6-8f58add9da62:5783:1870073693244800:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1783441385.999313:0:5783:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783441385.999326:0:5783:0:(client.c:2702:ptlrpc_set_wait()) set ffff91a87d800900 going to sleep for 11 seconds 00000100:00100000:0.0:1783441385.999339:0:5780:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073693244800 00000100:00100000:0.0:1783441385.999342:0:5780:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073693244800 00000100:00100000:0.0:1783441385.999366:0:5780:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 187 00000100:00100000:0.0:1783441385.999372:0:5780:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a8655e5050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6c1ddb50-5795-40c6-a2b6-8f58add9da62+19:5783:x1870073693244800:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1783441385.999531:0:5780:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a8655e5050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6c1ddb50-5795-40c6-a2b6-8f58add9da62+19:5783:x1870073693244800:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 159us (217us total) trans 0 rc 0/0 00000100:00100000:0.0:1783441385.999545:0:5780:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 187 00000100:00100000:0.0:1783441385.999585:0:5783:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff91a844b7d180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6c1ddb50-5795-40c6-a2b6-8f58add9da62:5783:1870073693244800:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1783441386.009888:0:8411:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff91a87d4ead80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:6c1ddb50-5795-40c6-a2b6-8f58add9da62:8411:1870073693244928:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1783441386.010005:0:8411:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783441386.010060:0:8411:0:(client.c:2702:ptlrpc_set_wait()) set ffff91a84527b600 going to sleep for 11 seconds 00000100:00100000:1.0:1783441386.010137:0:5779:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073693244928 00000100:00100000:1.0:1783441386.010146:0:5779:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073693244928 00000100:00100000:1.0:1783441386.010207:0:5779:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 188 00000100:00100000:1.0:1783441386.010218:0:5779:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a8655e4c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6c1ddb50-5795-40c6-a2b6-8f58add9da62+19:8411:x1870073693244928:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1783441386.010502:0:5779:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a8655e4c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6c1ddb50-5795-40c6-a2b6-8f58add9da62+19:8411:x1870073693244928:12345-0@lo:502:llog_process_th.0 Request processed in 284us (496us total) trans 0 rc 0/0 00000100:00100000:1.0:1783441386.010518:0:5779:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 188 00000100:00100000:3.0:1783441386.010728:0:8411:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff91a87d4ead80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:6c1ddb50-5795-40c6-a2b6-8f58add9da62:8411:1870073693244928:0@lo:502:llog_process_th.0 00000020:01000000:3.0:1783441386.010799:0:8411:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1783441386.010811:0:8411:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1783441386.010814:0:8411:0:(obd_config.c:1561:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:3.0:1783441386.010823:0:8411:0:(obd_config.c:2005:class_config_llog_handler()) cmd ce032, instance name: general-ffff91a84869e800 00000020:00000080:3.0:1783441386.010827:0:8411:0:(obd_config.c:1470:class_process_config()) processing cmd: ce032 00000100:00100000:3.0:1783441386.010923:0:8411:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff91a87d4ead80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:6c1ddb50-5795-40c6-a2b6-8f58add9da62:8411:1870073693245056:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1783441386.010962:0:8411:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783441386.010980:0:8411:0:(client.c:2702:ptlrpc_set_wait()) set ffff91a848f22540 going to sleep for 11 seconds 00000100:00100000:0.0:1783441386.011055:0:5778:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073693245056 00000100:00100000:0.0:1783441386.011061:0:5778:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073693245056 00000100:00100000:0.0:1783441386.011142:0:5778:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 189 00000100:00100000:0.0:1783441386.011152:0:5778:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a8655e4850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6c1ddb50-5795-40c6-a2b6-8f58add9da62+19:8411:x1870073693245056:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1783441386.011296:0:5778:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a8655e4850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6c1ddb50-5795-40c6-a2b6-8f58add9da62+19:8411:x1870073693245056:12345-0@lo:502:llog_process_th.0 Request processed in 146us (333us total) trans 0 rc 0/0 00000100:00100000:0.0:1783441386.011303:0:5778:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 189 00000100:00100000:2.0:1783441386.014508:0:8411:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff91a87d4ead80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:6c1ddb50-5795-40c6-a2b6-8f58add9da62:8411:1870073693245056:0@lo:502:llog_process_th.0 00000020:01000000:2.0:1783441386.014571:0:8411:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1783441386.014582:0:8411:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1783441386.014585:0:8411:0:(obd_config.c:1561:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000040:00080000:2.0:1783441386.014590:0:8411:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 7 count 7 00000020:01000000:1.0:1783441386.017689:0:5783:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 4-6 (rc=0) 10000000:01000000:1.0:1783441386.017755:0:5783:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.201.113@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:1.0:1783441386.017773:0:5783:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.113@tcp lock: ffff91a85fe58800/0xa2426164df2c77f9 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xa2426164df2c7800 expref: -99 pid: 5783 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783441386.017790:0:5783:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.113@tcp lock: ffff91a85fe58800/0xa2426164df2c77f9 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xa2426164df2c7800 expref: -99 pid: 5783 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783441386.349896:0:3305:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1783441386.349929:0:3305:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff91a87d4ead80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3305:1870073693245184:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1783441386.350040:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783441386.350141:0:6585:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073693245184 00000100:00100000:3.0:1783441386.350158:0:6585:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073693245184 00000100:00080000:1.0:1783441386.350204:0:5781:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1783441386.350240:0:6585:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:3.0:1783441386.350254:0:6585:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a87d4eb800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3305:x1870073693245184:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1783441386.350306:0:6585:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1783441386.350370:0:6585:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a87d4eb800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3305:x1870073693245184:12345-0@lo:13:osp-pre-0-0.0 Request processed in 119us (339us total) trans 0 rc 0/0 00000100:00100000:3.0:1783441386.350378:0:6585:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00010000:00080000:1.0:1783441386.350495:0:3305:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff91a87d4ead80 x1870073693245184/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1783441402 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1783441386.350521:0:3305:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff91a87d4ead80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3305:1870073693245184:0@lo:13:osp-pre-0-0.0 00010000:00010000:1.0:1783441386.605984:0:5772:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1783441387.384681:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.13@tcp (source: 12345-192.168.201.13@tcp) 00000100:00100000:1.0:1783441387.384735:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.13@tcp (source: 12345-192.168.201.13@tcp) 00000100:00100000:1.0:1783441387.384815:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.13@tcp (source: 12345-192.168.201.13@tcp) 00000100:00100000:2.0:1783441387.384828:0:6581:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073673292416 00000100:00100000:1.0:1783441387.384851:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.13@tcp (source: 12345-192.168.201.13@tcp) 00000100:00100000:2.0:1783441387.384861:0:6581:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073673292416 00000100:00100000:1.0:1783441387.384889:0:6582:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073673292288 00000100:00100000:1.0:1783441387.384893:0:6582:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073673292288 00000100:00100000:2.0:1783441387.384948:0:6581:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.13@tcp, seq: 17 00000100:00100000:3.0:1783441387.384955:0:5786:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073673292160 00000100:00100000:3.0:1783441387.384960:0:5786:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073673292160 00000100:00100000:2.0:1783441387.384960:0:6581:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a859085500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:65454767-383a-4679-a788-eba05c6e0989+5:2355:x1870073673292416:12345-192.168.201.13@tcp:400:kworker.0 00000100:00100000:3.0:1783441387.384996:0:5786:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.13@tcp, seq: 33 00000100:00100000:3.0:1783441387.385003:0:5786:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a859087800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:65454767-383a-4679-a788-eba05c6e0989+6:2355:x1870073673292160:12345-192.168.201.13@tcp:400:kworker.0 00000100:00100000:0.0:1783441387.385085:0:5780:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073673292032 00000100:00100000:0.0:1783441387.385098:0:5780:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073673292032 00000100:00100000:0.0:1783441387.385139:0:5780:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.13@tcp, seq: 190 00000100:00100000:0.0:1783441387.385146:0:5780:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a8655e6450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:51c2a82e-e792-4f56-84e8-12cc033e9e70+10:2355:x1870073673292032:12345-192.168.201.13@tcp:400:kworker.0 00000100:00100000:2.0:1783441387.385209:0:6581:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a859085500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:65454767-383a-4679-a788-eba05c6e0989+5:2355:x1870073673292416:12345-192.168.201.13@tcp:400:kworker.0 Request processed in 251us (472us total) trans 0 rc 0/0 00000100:00100000:2.0:1783441387.385218:0:6581:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.13@tcp, seq: 17 00000100:00100000:3.0:1783441387.391248:0:5786:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a859087800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:65454767-383a-4679-a788-eba05c6e0989+6:2355:x1870073673292160:12345-192.168.201.13@tcp:400:kworker.0 Request processed in 6223us (6562us total) trans 0 rc 0/0 00000100:00100000:3.0:1783441387.391270:0:5786:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.13@tcp, seq: 33 00000100:00080000:3.0:1783441387.392822:0:5781:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1783441387.392837:0:5781:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1783441387.392841:0:5781:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1783441387.393302:0:6582:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.13@tcp, seq: 18 00000100:00100000:1.0:1783441387.393325:0:6582:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a859084000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:65454767-383a-4679-a788-eba05c6e0989+5:2355:x1870073673292288:12345-192.168.201.13@tcp:400:kworker.0 00000100:00100000:1.0:1783441387.393425:0:6582:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a859084000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:65454767-383a-4679-a788-eba05c6e0989+5:2355:x1870073673292288:12345-192.168.201.13@tcp:400:kworker.0 Request processed in 110us (8570us total) trans 0 rc 0/0 00000100:00100000:1.0:1783441387.393434:0:6582:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.13@tcp, seq: 18 00000100:00100000:0.0:1783441387.394432:0:5780:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a8655e6450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:51c2a82e-e792-4f56-84e8-12cc033e9e70+10:2355:x1870073673292032:12345-192.168.201.13@tcp:400:kworker.0 Request processed in 9274us (9604us total) trans 0 rc 0/0 00000100:00100000:0.0:1783441387.394446:0:5780:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.13@tcp, seq: 190 00010000:00010000:2.0:1783441387.630529:0:5773:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783441388.654448:0:5772:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783441389.691127:0:5773:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1783441389.935107:0:3303:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff91a87d4e8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:6c1ddb50-5795-40c6-a2b6-8f58add9da62:3303:1870073693245312:0@lo:400:kworker.0 00000100:00100000:2.0:1783441389.935182:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783441389.935246:0:3303:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff91a87d4ead80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3303:1870073693245824:0@lo:400:kworker.0 00000100:00100000:2.0:1783441389.935272:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783441389.935302:0:3303:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:2.0:1783441389.935307:0:3303:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff91a87d4ebb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3303:1870073693245440:0@lo:400:kworker.0 00000100:00100000:2.0:1783441389.935328:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783441389.935345:0:3303:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff91a87d6a3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3303:1870073693245952:0@lo:400:kworker.0 00000100:00100000:2.0:1783441389.935368:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783441389.935383:0:5778:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073693245312 00000100:00100000:2.0:1783441389.935390:0:6605:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073693245824 00000100:00100000:0.0:1783441389.935391:0:5778:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073693245312 00000100:00100000:2.0:1783441389.935393:0:6605:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073693245824 00000100:00100000:2.0:1783441389.935428:0:6605:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073693245440 00000100:00100000:2.0:1783441389.935431:0:6605:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073693245440 00000100:00100000:0.0:1783441389.935433:0:5778:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 191 00000100:00100000:0.0:1783441389.935440:0:5778:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a8655e6c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6c1ddb50-5795-40c6-a2b6-8f58add9da62+19:3303:x1870073693245312:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1783441389.935447:0:6605:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:2.0:1783441389.935452:0:6605:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a867cd5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3303:x1870073693245824:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1783441389.935497:0:5778:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a8655e6c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6c1ddb50-5795-40c6-a2b6-8f58add9da62+19:3303:x1870073693245312:12345-0@lo:400:kworker.0 Request processed in 56us (314us total) trans 0 rc 0/0 00000100:00100000:0.0:1783441389.935503:0:5778:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 191 00000100:00100000:1.0:1783441389.935649:0:3305:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff91a87d4e9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3305:1870073693245568:0@lo:400:kworker.0 00000100:00100000:1.0:1783441389.935682:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783441389.935695:0:3305:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1783441389.935700:0:3305:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff91a87d4e9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3305:1870073693245696:0@lo:400:kworker.0 00000100:00100000:1.0:1783441389.935718:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783441389.935760:0:6583:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073693245952 00000100:00100000:1.0:1783441389.935763:0:6583:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073693245952 00000100:00100000:1.0:1783441389.935787:0:6583:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073693245696 00000100:00100000:1.0:1783441389.935790:0:6583:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073693245696 00000100:00100000:1.0:1783441389.935804:0:6583:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:1.0:1783441389.935809:0:6583:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a867cd7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3303:x1870073693245952:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1783441389.938660:0:6605:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a867cd5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3303:x1870073693245824:12345-0@lo:400:kworker.0 Request processed in 3194us (3373us total) trans 0 rc 0/0 00000100:00100000:2.0:1783441389.938677:0:6605:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00000100:00100000:2.0:1783441389.938715:0:6605:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073693245568 00000100:00100000:2.0:1783441389.938735:0:6605:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073693245568 00000100:00100000:2.0:1783441389.938787:0:6605:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:2.0:1783441389.938795:0:6605:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a867cd4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3303:x1870073693245440:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1783441389.938867:0:6605:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a867cd4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3303:x1870073693245440:12345-0@lo:400:kworker.0 Request processed in 72us (3538us total) trans 0 rc 0/0 00000100:00100000:2.0:1783441389.938873:0:6605:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00000100:00100000:2.0:1783441389.938884:0:6605:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:2.0:1783441389.938890:0:6605:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a859084380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3305:x1870073693245568:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1783441389.938931:0:6605:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a859084380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3305:x1870073693245568:12345-0@lo:400:kworker.0 Request processed in 41us (3248us total) trans 0 rc 0/0 00000100:00100000:2.0:1783441389.938936:0:6605:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00000100:00100000:2.0:1783441389.938965:0:6582:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 3 min 3 max 116 00000100:00100000:2.0:1783441389.938973:0:6582:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost00_003' 00000100:00080000:2.0:1783441389.938990:0:5781:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1783441389.938995:0:5781:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1783441389.938997:0:5781:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1783441389.939014:0:6581:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 3 min 3 max 116 00000100:00100000:2.0:1783441389.939022:0:6581:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:2.0:1783441389.939028:0:6581:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a859087480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3305:x1870073693245696:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1783441389.939071:0:6581:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a859087480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3305:x1870073693245696:12345-0@lo:400:kworker.0 Request processed in 43us (3352us total) trans 0 rc 0/0 00000100:00100000:2.0:1783441389.939076:0:6581:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00010000:00080000:2.0:1783441389.939123:0:3305:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff91a87d4e9180 x1870073693245696/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1783441405 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1783441389.939139:0:3305:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff91a87d4e9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3305:1870073693245696:0@lo:400:kworker.0 00000100:00100000:2.0:1783441389.939150:0:3305:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff91a87d4e9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3305:1870073693245568:0@lo:400:kworker.0 00000100:00100000:0.0:1783441389.941705:0:3303:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff91a87d4e8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:6c1ddb50-5795-40c6-a2b6-8f58add9da62:3303:1870073693245312:0@lo:400:kworker.0 00000100:00100000:0.0:1783441389.941788:0:3303:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff91a87d4ead80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3303:1870073693245824:0@lo:400:kworker.0 00000100:00100000:0.0:1783441389.941823:0:3303:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff91a87d4ebb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3303:1870073693245440:0@lo:400:kworker.0 00000100:00100000:1.0:1783441389.942639:0:6583:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a867cd7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3303:x1870073693245952:12345-0@lo:400:kworker.0 Request processed in 6824us (7264us total) trans 0 rc 0/0 00000100:00100000:1.0:1783441389.942653:0:6583:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00010000:00080000:0.0:1783441389.952211:0:3303:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff91a87d6a3800 x1870073693245952/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1783441405 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1783441389.952252:0:3303:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff91a87d6a3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3303:1870073693245952:0@lo:400:kworker.0 00000100:00100000:3.0:1783441390.447092:0:3305:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff91a859085880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3305:1870073693246080:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1783441390.447184:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783441390.447326:0:6585:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073693246080 00000100:00100000:1.0:1783441390.447334:0:6585:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073693246080 00000100:00100000:1.0:1783441390.447374:0:6585:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:1.0:1783441390.447381:0:6585:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a87d6a1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3305:x1870073693246080:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1783441390.447412:0:6585:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1783441390.447451:0:6585:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a87d6a1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3305:x1870073693246080:12345-0@lo:13:osp-pre-1-0.0 Request processed in 71us (269us total) trans 0 rc 0/0 00000100:00100000:1.0:1783441390.447456:0:6585:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00010000:00080000:1.0:1783441390.447483:0:3305:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff91a859085880 x1870073693246080/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1783441406 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1783441390.447496:0:3305:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff91a859085880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3305:1870073693246080:0@lo:13:osp-pre-1-0.0 00010000:00010000:1.0:1783441390.701466:0:5772:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1783441391.469085:0:3306:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff91a87d6a1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3306:1870073693246208:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1783441391.469186:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783441391.469364:0:6585:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073693246208 00000100:00100000:3.0:1783441391.469374:0:6585:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073693246208 00000100:00100000:3.0:1783441391.469449:0:6585:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:3.0:1783441391.469459:0:6585:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a859085880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3306:x1870073693246208:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1783441391.469508:0:6585:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1783441391.469558:0:6585:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a859085880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3306:x1870073693246208:12345-0@lo:13:osp-pre-0-0.0 Request processed in 100us (372us total) trans 0 rc 0/0 00000100:00100000:3.0:1783441391.469570:0:6585:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00010000:00080000:1.0:1783441391.469656:0:3306:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff91a87d6a1880 x1870073693246208/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1783441407 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1783441391.469678:0:3306:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff91a87d6a1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3306:1870073693246208:0@lo:13:osp-pre-0-0.0 00000100:00080000:2.0:1783441391.469758:0:5781:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:0.0:1783441391.728868:0:5773:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:0.0:1783441392.064439:0:8654:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg113-server.virtnet: executing check_logdir /tmp/testlogs/ 00000100:00100000:3.0:1783441392.498408:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.13@tcp (source: 12345-192.168.201.13@tcp) 00000100:00100000:3.0:1783441392.498475:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.13@tcp (source: 12345-192.168.201.13@tcp) 00000100:00100000:3.0:1783441392.498513:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.13@tcp (source: 12345-192.168.201.13@tcp) 00000100:00100000:3.0:1783441392.498547:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.13@tcp (source: 12345-192.168.201.13@tcp) 00000100:00100000:3.0:1783441392.498582:0:5780:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073673292544 00000100:00100000:3.0:1783441392.498595:0:5780:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073673292544 00000100:00100000:3.0:1783441392.498666:0:5780:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.13@tcp, seq: 192 00000100:00100000:3.0:1783441392.498679:0:5780:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a8484bbc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:51c2a82e-e792-4f56-84e8-12cc033e9e70+10:2355:x1870073673292544:12345-192.168.201.13@tcp:400:kworker.0 00000100:00100000:3.0:1783441392.498810:0:5780:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a8484bbc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:51c2a82e-e792-4f56-84e8-12cc033e9e70+10:2355:x1870073673292544:12345-192.168.201.13@tcp:400:kworker.0 Request processed in 133us (295us total) trans 0 rc 0/0 00000100:00100000:3.0:1783441392.498818:0:5780:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.13@tcp, seq: 192 00000100:00100000:2.0:1783441392.499134:0:6605:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073673292672 00000100:00100000:2.0:1783441392.499140:0:6605:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073673292672 00000100:00100000:2.0:1783441392.499188:0:6605:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.13@tcp, seq: 37 00000100:00100000:2.0:1783441392.499197:0:6605:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a87d6a1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:65454767-383a-4679-a788-eba05c6e0989+6:2355:x1870073673292672:12345-192.168.201.13@tcp:400:kworker.0 00000100:00100000:2.0:1783441392.499239:0:6605:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a87d6a1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:65454767-383a-4679-a788-eba05c6e0989+6:2355:x1870073673292672:12345-192.168.201.13@tcp:400:kworker.0 Request processed in 44us (849us total) trans 0 rc 0/0 00000100:00100000:2.0:1783441392.499247:0:6605:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.13@tcp, seq: 37 00000100:00100000:2.0:1783441392.499273:0:6581:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073673292928 00000100:00100000:2.0:1783441392.499277:0:6581:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073673292928 00000100:00100000:2.0:1783441392.499306:0:6581:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073673292800 00000100:00100000:2.0:1783441392.499309:0:6581:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073673292800 00000100:00100000:2.0:1783441392.499341:0:6581:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.13@tcp, seq: 21 00000100:00100000:2.0:1783441392.499348:0:6581:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a87d6a3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:65454767-383a-4679-a788-eba05c6e0989+5:2355:x1870073673292928:12345-192.168.201.13@tcp:400:kworker.0 00000100:00100000:2.0:1783441392.499380:0:6581:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a87d6a3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:65454767-383a-4679-a788-eba05c6e0989+5:2355:x1870073673292928:12345-192.168.201.13@tcp:400:kworker.0 Request processed in 33us (905us total) trans 0 rc 0/0 00000100:00100000:2.0:1783441392.499387:0:6581:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.13@tcp, seq: 21 00000100:00100000:2.0:1783441392.499399:0:6581:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.13@tcp, seq: 22 00000100:00100000:2.0:1783441392.499406:0:6581:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a8756a5180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:65454767-383a-4679-a788-eba05c6e0989+5:2355:x1870073673292800:12345-192.168.201.13@tcp:400:kworker.0 00000100:00100000:2.0:1783441392.499429:0:6581:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a8756a5180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:65454767-383a-4679-a788-eba05c6e0989+5:2355:x1870073673292800:12345-192.168.201.13@tcp:400:kworker.0 Request processed in 24us (883us total) trans 0 rc 0/0 00000100:00100000:2.0:1783441392.499435:0:6581:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.13@tcp, seq: 22 00000100:00080000:2.0:1783441392.499470:0:5781:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1783441392.499474:0:5781:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1783441392.499477:0:5781:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:1.0:1783441392.749224:0:5772:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783441393.773188:0:5773:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783441394.801692:0:5772:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1783441395.053269:0:3303:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff91a8756a5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:6c1ddb50-5795-40c6-a2b6-8f58add9da62:3303:1870073693246336:0@lo:400:kworker.0 00000100:00100000:3.0:1783441395.053298:0:3305:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff91a8756a4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3305:1870073693246592:0@lo:400:kworker.0 00000100:00100000:2.0:1783441395.053388:0:3304:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff91a8756a7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3304:1870073693246464:0@lo:400:kworker.0 00000100:00100000:3.0:1783441395.054254:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783441395.054338:0:3305:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1783441395.054347:0:3305:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff91a8756a6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3305:1870073693246720:0@lo:400:kworker.0 00000100:00100000:3.0:1783441395.054522:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783441395.054573:0:5786:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073693246592 00000100:00100000:3.0:1783441395.054580:0:5786:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073693246592 00000100:00100000:3.0:1783441395.054639:0:5786:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:3.0:1783441395.054651:0:5786:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a745905880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3305:x1870073693246592:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1783441395.054715:0:5786:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a745905880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3305:x1870073693246592:12345-0@lo:400:kworker.0 Request processed in 67us (466us total) trans 0 rc 0/0 00000100:00100000:3.0:1783441395.054722:0:5786:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00000100:00100000:3.0:1783441395.054776:0:6581:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073693246720 00000100:00100000:3.0:1783441395.054794:0:6581:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073693246720 00000100:00100000:3.0:1783441395.055050:0:6581:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:3.0:1783441395.055059:0:6581:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a745906680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3305:x1870073693246720:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1783441395.055093:0:6581:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a745906680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3305:x1870073693246720:12345-0@lo:400:kworker.0 Request processed in 35us (571us total) trans 0 rc 0/0 00000100:00100000:3.0:1783441395.055099:0:6581:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00080000:3.0:1783441395.055117:0:5781:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1783441395.055122:0:5781:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:3.0:1783441395.055156:0:3305:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff91a8756a6d80 x1870073693246720/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1783441411 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1783441395.055169:0:3305:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff91a8756a6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3305:1870073693246720:0@lo:400:kworker.0 00000100:00100000:3.0:1783441395.055182:0:3305:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff91a8756a4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3305:1870073693246592:0@lo:400:kworker.0 00000100:00100000:0.0:1783441395.062370:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783441395.062486:0:3303:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff91a745904380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3303:1870073693246848:0@lo:400:kworker.0 00000100:00100000:0.0:1783441395.062570:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783441395.062658:0:6605:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073693246848 00000100:00100000:2.0:1783441395.062677:0:6605:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073693246848 00000100:00100000:2.0:1783441395.063008:0:6605:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 39 00000100:00100000:2.0:1783441395.063023:0:6605:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a844b7d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3303:x1870073693246848:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1783441395.063253:0:6605:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a844b7d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3303:x1870073693246848:12345-0@lo:400:kworker.0 Request processed in 234us (681us total) trans 0 rc 0/0 00000100:00100000:2.0:1783441395.063263:0:6605:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 39 00000100:00100000:2.0:1783441395.063320:0:3303:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff91a745904380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3303:1870073693246848:0@lo:400:kworker.0 00000100:00080000:2.0:1783441395.063347:0:5781:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1783441395.063428:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783441395.063474:0:3304:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff91a745907480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3304:1870073693246976:0@lo:400:kworker.0 00000100:00100000:3.0:1783441395.063509:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783441395.063583:0:8557:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073693246976 00000100:00100000:2.0:1783441395.063588:0:8557:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073693246976 00000100:00100000:2.0:1783441395.063635:0:8557:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:2.0:1783441395.063648:0:8557:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a745905180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3304:x1870073693246976:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1783441395.063674:0:5779:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073693246336 00000100:00100000:1.0:1783441395.063683:0:5779:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073693246336 00000100:00100000:2.0:1783441395.063699:0:8557:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a745905180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3304:x1870073693246976:12345-0@lo:400:kworker.0 Request processed in 54us (185us total) trans 0 rc 0/0 00000100:00100000:2.0:1783441395.063709:0:8557:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00100000:1.0:1783441395.063737:0:5779:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 193 00000100:00100000:1.0:1783441395.063778:0:5779:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a8484ba050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6c1ddb50-5795-40c6-a2b6-8f58add9da62+19:3303:x1870073693246336:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1783441395.063785:0:5786:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073693246464 00000100:00100000:2.0:1783441395.063793:0:5786:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073693246464 00000100:00100000:2.0:1783441395.063837:0:5786:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:1.0:1783441395.063845:0:5779:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a8484ba050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6c1ddb50-5795-40c6-a2b6-8f58add9da62+19:3303:x1870073693246336:12345-0@lo:400:kworker.0 Request processed in 68us (1488us total) trans 0 rc 0/0 00000100:00100000:2.0:1783441395.063854:0:5786:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a745907b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3304:x1870073693246464:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1783441395.063858:0:5779:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 193 00000100:00080000:3.0:1783441395.063955:0:5781:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1783441395.064045:0:5786:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a745907b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3304:x1870073693246464:12345-0@lo:400:kworker.0 Request processed in 200us (615us total) trans 0 rc 0/0 00000100:00100000:2.0:1783441395.064051:0:5786:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00000100:00100000:2.0:1783441395.064084:0:3303:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff91a8756a5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:6c1ddb50-5795-40c6-a2b6-8f58add9da62:3303:1870073693246336:0@lo:400:kworker.0 00000100:00100000:2.0:1783441395.064189:0:3304:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff91a8756a7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3304:1870073693246464:0@lo:400:kworker.0 00010000:00080000:2.0:1783441395.064222:0:3304:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff91a745907480 x1870073693246976/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1783441411 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1783441395.064233:0:3304:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff91a745907480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3304:1870073693246976:0@lo:400:kworker.0 00000100:00100000:0.0:1783441395.567276:0:3306:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1783441395.567311:0:3306:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff91a859084700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3306:1870073693247104:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1783441395.567405:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783441395.567545:0:6585:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073693247104 00000100:00100000:1.0:1783441395.567556:0:6585:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073693247104 00000100:00100000:1.0:1783441395.567656:0:6585:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:1.0:1783441395.567668:0:6585:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a844b7fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3306:x1870073693247104:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1783441395.567718:0:6585:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1783441395.567795:0:6585:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a844b7fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3306:x1870073693247104:12345-0@lo:13:osp-pre-1-0.0 Request processed in 129us (390us total) trans 0 rc 0/0 00000100:00100000:1.0:1783441395.567803:0:6585:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00010000:00080000:0.0:1783441395.579205:0:3306:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff91a859084700 x1870073693247104/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1783441411 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1783441395.579244:0:3306:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff91a859084700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3306:1870073693247104:0@lo:13:osp-pre-1-0.0 00010000:00010000:0.0:1783441395.824169:0:5773:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1783441396.592002:0:3305:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1783441396.592036:0:3305:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff91a745906d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3305:1870073693247232:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1783441396.592134:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783441396.592582:0:6584:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073693247232 00000100:00100000:1.0:1783441396.592598:0:6584:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073693247232 00000100:00100000:1.0:1783441396.592664:0:6584:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:1.0:1783441396.592676:0:6584:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a745904a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3305:x1870073693247232:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1783441396.592717:0:6584:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1783441396.592838:0:6584:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a745904a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3305:x1870073693247232:12345-0@lo:13:osp-pre-0-0.0 Request processed in 164us (704us total) trans 0 rc 0/0 00010000:00080000:3.0:1783441396.593063:0:3305:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff91a745906d80 x1870073693247232/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1783441412 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1783441396.593092:0:3305:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff91a745906d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3305:1870073693247232:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1783441396.597567:0:6584:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00010000:00010000:1.0:1783441396.845055:0:5772:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1783441397.619083:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.13@tcp (source: 12345-192.168.201.13@tcp) 00000100:00100000:3.0:1783441397.619167:0:5778:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073673293056 00000100:00100000:3.0:1783441397.619178:0:5778:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073673293056 00000100:00100000:3.0:1783441397.619237:0:5778:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.13@tcp, seq: 194 00000100:00100000:3.0:1783441397.619247:0:5778:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a8484bb850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:51c2a82e-e792-4f56-84e8-12cc033e9e70+10:2354:x1870073673293056:12345-192.168.201.13@tcp:400:kworker.0 00000100:00100000:3.0:1783441397.619326:0:5778:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a8484bb850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:51c2a82e-e792-4f56-84e8-12cc033e9e70+10:2354:x1870073673293056:12345-192.168.201.13@tcp:400:kworker.0 Request processed in 79us (251us total) trans 0 rc 0/0 00000100:00100000:3.0:1783441397.619334:0:5778:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.13@tcp, seq: 194 00000100:00100000:3.0:1783441397.622000:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.13@tcp (source: 12345-192.168.201.13@tcp) 00000100:00100000:2.0:1783441397.622081:0:6605:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073673293184 00000100:00100000:2.0:1783441397.622089:0:6605:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073673293184 00000100:00100000:2.0:1783441397.622868:0:6605:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.13@tcp, seq: 41 00000100:00100000:2.0:1783441397.622878:0:6605:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a745906d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:65454767-383a-4679-a788-eba05c6e0989+6:2354:x1870073673293184:12345-192.168.201.13@tcp:400:kworker.0 00000100:00100000:2.0:1783441397.622959:0:6605:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a745906d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:65454767-383a-4679-a788-eba05c6e0989+6:2354:x1870073673293184:12345-192.168.201.13@tcp:400:kworker.0 Request processed in 83us (967us total) trans 0 rc 0/0 00000100:00100000:2.0:1783441397.622966:0:6605:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.13@tcp, seq: 41 00000100:00080000:3.0:1783441397.628615:0:5781:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1783441397.628962:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.13@tcp (source: 12345-192.168.201.13@tcp) 00000100:00100000:2.0:1783441397.629046:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.13@tcp (source: 12345-192.168.201.13@tcp) 00000100:00100000:1.0:1783441397.629120:0:6582:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073673293312 00000100:00100000:1.0:1783441397.629130:0:6582:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073673293312 00000100:00100000:1.0:1783441397.629188:0:6582:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073673293440 00000100:00100000:1.0:1783441397.629192:0:6582:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073673293440 00000100:00100000:1.0:1783441397.629214:0:6582:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.13@tcp, seq: 11 00000100:00100000:1.0:1783441397.629224:0:6582:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a87d4ebb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:65454767-383a-4679-a788-eba05c6e0989+5:2351:x1870073673293312:12345-192.168.201.13@tcp:9:kworker.0 00000020:00000080:1.0:1783441397.629263:0:6582:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xa2426164df2c773c 00000100:00080000:1.0:1783441397.629273:0:6582:0:(import.c:65:import_set_state_nolock()) ffff91a7450ef800 : changing import state from FULL to CLOSED 00000001:00000004:1.0:1783441397.629312:0:6582:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 4294967298 00000100:00100000:1.0:1783441397.629670:0:6582:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a87d4ebb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:65454767-383a-4679-a788-eba05c6e0989+2:2351:x1870073673293312:12345-192.168.201.13@tcp:9:kworker.0 Request processed in 445us (712us total) trans 0 rc 0/0 00000100:00100000:1.0:1783441397.629678:0:6582:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.13@tcp, seq: 11 00000100:00100000:1.0:1783441397.629695:0:6582:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.13@tcp, seq: 12 00000100:00100000:1.0:1783441397.629702:0:6582:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a87d4ead80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:65454767-383a-4679-a788-eba05c6e0989+5:2351:x1870073673293440:12345-192.168.201.13@tcp:9:kworker.0 00000020:00000080:1.0:1783441397.629717:0:6582:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xa2426164df2c7743 00000100:00080000:1.0:1783441397.629723:0:6582:0:(import.c:65:import_set_state_nolock()) ffff91a7450ee000 : changing import state from FULL to CLOSED 00000001:00000004:1.0:1783441397.629785:0:6582:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 4294967298 00000100:00100000:1.0:1783441397.629968:0:6582:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a87d4ead80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:65454767-383a-4679-a788-eba05c6e0989+2:2351:x1870073673293440:12345-192.168.201.13@tcp:9:kworker.0 Request processed in 266us (921us total) trans 0 rc 0/0 00000100:00100000:1.0:1783441397.629975:0:6582:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.13@tcp, seq: 12 00010000:00010000:1.0:1783441397.630036:0:5773:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783441397.630042:0:5772:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:2.0:1783441397.630164:0:5781:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1783441397.630168:0:5781:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000001:02000400:3.0:1783441397.722829:0:8898:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg113-server.virtnet: executing yml_node 00010000:00010000:1.0:1783441397.874734:0:5773:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:2.0:1783441398.193144:0:6613:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of 65454767-383a-4679-a788-eba05c6e0989 00000020:00000080:2.0:1783441398.193155:0:6613:0:(genops.c:906:class_export_put()) final put ffff91a7450ee800/65454767-383a-4679-a788-eba05c6e0989 00000020:00000080:2.0:1783441398.193188:0:41:0:(genops.c:865:class_export_destroy()) destroying export ffff91a7450ee800/65454767-383a-4679-a788-eba05c6e0989 for lustre-OST0000 00000020:00000080:2.0:1783441398.193226:0:41:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff91a7450ef800 for lustre-OST0000 00010000:00010000:1.0:1783441398.909284:0:5772:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783441399.918198:0:5773:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1783441400.173493:0:3304:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff91a745905f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3304:1870073693247488:0@lo:400:kworker.0 00000100:00100000:3.0:1783441400.173526:0:3305:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff91a745904700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3305:1870073693247616:0@lo:400:kworker.0 00000100:00100000:1.0:1783441400.173595:0:3306:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff91a745905c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3306:1870073693247744:0@lo:400:kworker.0 00000100:00100000:2.0:1783441400.173608:0:3303:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff91a745906a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:6c1ddb50-5795-40c6-a2b6-8f58add9da62:3303:1870073693247360:0@lo:400:kworker.0 00000100:00100000:0.0:1783441400.182044:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783441400.182127:0:3304:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff91a745904e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3304:1870073693248000:0@lo:400:kworker.0 00000100:00100000:0.0:1783441400.182188:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783441400.182260:0:6582:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073693248000 00000100:00100000:0.0:1783441400.182268:0:6582:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073693248000 00000100:00100000:0.0:1783441400.182324:0:6582:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:0.0:1783441400.182335:0:6582:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a844b7f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3304:x1870073693248000:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1783441400.182390:0:6582:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a844b7f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3304:x1870073693248000:12345-0@lo:400:kworker.0 Request processed in 57us (201us total) trans 0 rc 0/0 00000100:00100000:0.0:1783441400.182398:0:6582:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00080000:0.0:1783441400.182420:0:5781:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00080000:0.0:1783441400.182527:0:3304:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff91a745904e00 x1870073693248000/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1783441416 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1783441400.182543:0:3304:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff91a745904e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3304:1870073693248000:0@lo:400:kworker.0 00000100:00100000:0.0:1783441400.182582:0:5786:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073693247488 00000100:00100000:0.0:1783441400.182586:0:5786:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073693247488 00000100:00100000:0.0:1783441400.182617:0:5786:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:0.0:1783441400.182623:0:5786:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a844b7d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3304:x1870073693247488:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1783441400.182661:0:5786:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a844b7d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3304:x1870073693247488:12345-0@lo:400:kworker.0 Request processed in 37us (625us total) trans 0 rc 0/0 00000100:00100000:0.0:1783441400.182668:0:5786:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00000100:00100000:0.0:1783441400.182696:0:3304:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff91a745905f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3304:1870073693247488:0@lo:400:kworker.0 00000100:00100000:3.0:1783441400.187900:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783441400.187912:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783441400.188006:0:6583:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073693247744 00000100:00100000:1.0:1783441400.188014:0:6583:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073693247744 00000100:00100000:1.0:1783441400.188118:0:6583:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:1.0:1783441400.188125:0:6583:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a859085f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3306:x1870073693247744:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1783441400.188227:0:6583:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a859085f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3306:x1870073693247744:12345-0@lo:400:kworker.0 Request processed in 103us (316us total) trans 0 rc 0/0 00000100:00100000:1.0:1783441400.188233:0:6583:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00010000:00080000:1.0:1783441400.188265:0:3306:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff91a745905c00 x1870073693247744/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1783441416 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1783441400.188276:0:3306:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff91a745905c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3306:1870073693247744:0@lo:400:kworker.0 00000100:00100000:3.0:1783441400.188362:0:6605:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073693247616 00000100:00100000:3.0:1783441400.188367:0:6605:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073693247616 00000100:00100000:3.0:1783441400.188399:0:6605:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 43 00000100:00100000:3.0:1783441400.188407:0:6605:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a745906300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3305:x1870073693247616:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1783441400.188449:0:6605:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a745906300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3305:x1870073693247616:12345-0@lo:400:kworker.0 Request processed in 43us (558us total) trans 0 rc 0/0 00000100:00100000:3.0:1783441400.188455:0:6605:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 43 00000100:00100000:3.0:1783441400.188484:0:3305:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff91a745904700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3305:1870073693247616:0@lo:400:kworker.0 00000100:00100000:2.0:1783441400.188632:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783441400.188680:0:3303:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff91a745907100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3303:1870073693247872:0@lo:400:kworker.0 00000100:00100000:2.0:1783441400.188711:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:0.0:1783441400.188767:0:5781:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1783441400.188772:0:5781:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1783441400.189114:0:5780:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073693247360 00000100:00100000:1.0:1783441400.189119:0:5780:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073693247360 00000100:00100000:1.0:1783441400.189157:0:5780:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 195 00000100:00100000:1.0:1783441400.189164:0:5780:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a8484ba850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6c1ddb50-5795-40c6-a2b6-8f58add9da62+19:3303:x1870073693247360:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1783441400.189200:0:5780:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a8484ba850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6c1ddb50-5795-40c6-a2b6-8f58add9da62+19:3303:x1870073693247360:12345-0@lo:400:kworker.0 Request processed in 36us (568us total) trans 0 rc 0/0 00000100:00100000:1.0:1783441400.189206:0:5780:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 195 00000100:00100000:2.0:1783441400.189419:0:3303:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff91a745906a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:6c1ddb50-5795-40c6-a2b6-8f58add9da62:3303:1870073693247360:0@lo:400:kworker.0 00000100:00100000:3.0:1783441400.193425:0:5786:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073693247872 00000100:00100000:3.0:1783441400.193443:0:5786:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073693247872 00000100:00080000:0.0:1783441400.193550:0:5781:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1783441400.193582:0:5786:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 44 00000100:00100000:3.0:1783441400.193593:0:5786:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a87d4e8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3303:x1870073693247872:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1783441400.193704:0:5786:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a87d4e8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3303:x1870073693247872:12345-0@lo:400:kworker.0 Request processed in 113us (4991us total) trans 0 rc 0/0 00000100:00100000:3.0:1783441400.193711:0:5786:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 44 00000100:00100000:0.0:1783441400.193813:0:3303:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff91a745907100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3303:1870073693247872:0@lo:400:kworker.0 00000100:00100000:1.0:1783441400.688592:0:3306:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1783441400.688616:0:3306:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff91a859086a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3306:1870073693248128:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1783441400.688687:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783441400.688835:0:6585:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073693248128 00000100:00100000:3.0:1783441400.688843:0:6585:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073693248128 00000100:00100000:3.0:1783441400.688916:0:6585:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:3.0:1783441400.688939:0:6585:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a859084a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3306:x1870073693248128:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1783441400.688984:0:6585:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1783441400.689032:0:6585:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a859084a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3306:x1870073693248128:12345-0@lo:13:osp-pre-1-0.0 Request processed in 95us (345us total) trans 0 rc 0/0 00000100:00100000:3.0:1783441400.689040:0:6585:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00010000:00080000:2.0:1783441400.689059:0:3306:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff91a859086a00 x1870073693248128/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1783441416 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1783441400.689085:0:3306:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff91a859086a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3306:1870073693248128:0@lo:13:osp-pre-1-0.0 00010000:00010000:1.0:1783441400.941945:0:5772:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1783441401.710264:0:3306:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff91a844b7e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3306:1870073693248256:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1783441401.710333:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783441401.710455:0:6585:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073693248256 00000100:00100000:0.0:1783441401.710464:0:6585:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073693248256 00000100:00100000:0.0:1783441401.710531:0:6585:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:0.0:1783441401.710542:0:6585:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a745904700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3306:x1870073693248256:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1783441401.710577:0:6585:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1783441401.710624:0:6585:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a745904700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3306:x1870073693248256:12345-0@lo:13:osp-pre-0-0.0 Request processed in 84us (290us total) trans 0 rc 0/0 00000100:00100000:0.0:1783441401.710631:0:6585:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00010000:00080000:3.0:1783441401.713730:0:3306:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff91a844b7e680 x1870073693248256/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1783441417 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1783441401.713775:0:3306:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff91a844b7e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3306:1870073693248256:0@lo:13:osp-pre-0-0.0 00010000:00010000:1.0:1783441401.970988:0:5773:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:1.0:1783441402.218321:0:9092:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: Client: 2.17.54.105 00000001:00100000:1.0:1783441402.294087:0:7492:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of 65454767-383a-4679-a788-eba05c6e0989 00000020:00000080:1.0:1783441402.294111:0:7492:0:(genops.c:906:class_export_put()) final put ffff91a7450ec800/65454767-383a-4679-a788-eba05c6e0989 00000020:00000080:1.0:1783441402.294140:0:443:0:(genops.c:865:class_export_destroy()) destroying export ffff91a7450ec800/65454767-383a-4679-a788-eba05c6e0989 for lustre-OST0001 00000020:00000080:1.0:1783441402.294179:0:443:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff91a7450ee000 for lustre-OST0001 00000100:00100000:1.0:1783441402.748900:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.13@tcp (source: 12345-192.168.201.13@tcp) 00000100:00100000:1.0:1783441402.748944:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.13@tcp (source: 12345-192.168.201.13@tcp) 00000100:00100000:1.0:1783441402.748973:0:6605:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073673293696 00000100:00100000:1.0:1783441402.748982:0:6605:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073673293696 00000100:00100000:1.0:1783441402.749035:0:6605:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.13@tcp, seq: 45 00000100:00100000:1.0:1783441402.749043:0:6605:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a859086d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:65454767-383a-4679-a788-eba05c6e0989+6:2355:x1870073673293696:12345-192.168.201.13@tcp:400:kworker.0 00000100:00100000:1.0:1783441402.749105:0:6605:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a859086d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:65454767-383a-4679-a788-eba05c6e0989+6:2355:x1870073673293696:12345-192.168.201.13@tcp:400:kworker.0 Request processed in 63us (214us total) trans 0 rc 0/0 00000100:00100000:1.0:1783441402.749112:0:6605:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.13@tcp, seq: 45 00000100:00100000:1.0:1783441402.749132:0:5779:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073673293568 00000100:00100000:1.0:1783441402.749134:0:5779:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073673293568 00000100:00100000:1.0:1783441402.749153:0:5779:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.13@tcp, seq: 196 00000100:00100000:1.0:1783441402.749158:0:5779:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a848f75050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:51c2a82e-e792-4f56-84e8-12cc033e9e70+10:2355:x1870073673293568:12345-192.168.201.13@tcp:400:kworker.0 00000100:00100000:1.0:1783441402.749177:0:5779:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a848f75050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:51c2a82e-e792-4f56-84e8-12cc033e9e70+10:2355:x1870073673293568:12345-192.168.201.13@tcp:400:kworker.0 Request processed in 19us (232us total) trans 0 rc 0/0 00000100:00100000:1.0:1783441402.749182:0:5779:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.13@tcp, seq: 196 00000100:00080000:1.0:1783441402.749202:0:5781:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:1.0:1783441402.989067:0:5772:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783441404.013160:0:5773:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783441405.037596:0:5772:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:1.0:1783441405.193386:0:9190:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: MDS: 2.17.54.105 00000100:00100000:0.0:1783441405.295148:0:3303:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff91a745907800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:6c1ddb50-5795-40c6-a2b6-8f58add9da62:3303:1870073693248384:0@lo:400:kworker.0 00000100:00100000:0.0:1783441405.295241:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783441405.295302:0:3303:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1783441405.295308:0:3303:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff91a745905500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3303:1870073693248512:0@lo:400:kworker.0 00000100:00100000:0.0:1783441405.295335:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783441405.295386:0:5778:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073693248384 00000100:00100000:0.0:1783441405.295396:0:5778:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073693248384 00000100:00100000:0.0:1783441405.295454:0:5778:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 197 00000100:00100000:0.0:1783441405.295463:0:5778:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a848f74c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6c1ddb50-5795-40c6-a2b6-8f58add9da62+19:3303:x1870073693248384:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1783441405.295515:0:5778:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a848f74c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6c1ddb50-5795-40c6-a2b6-8f58add9da62+19:3303:x1870073693248384:12345-0@lo:400:kworker.0 Request processed in 53us (274us total) trans 0 rc 0/0 00000100:00100000:0.0:1783441405.295522:0:5778:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 197 00000100:00100000:0.0:1783441405.295556:0:5787:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073693248512 00000100:00100000:0.0:1783441405.295559:0:5787:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073693248512 00000100:00100000:0.0:1783441405.295583:0:5787:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 46 00000100:00100000:0.0:1783441405.295589:0:5787:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a844b7c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3303:x1870073693248512:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1783441405.295617:0:5787:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a844b7c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3303:x1870073693248512:12345-0@lo:400:kworker.0 Request processed in 29us (281us total) trans 0 rc 0/0 00000100:00100000:0.0:1783441405.295623:0:5787:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 46 00000100:00100000:0.0:1783441405.295659:0:3303:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff91a745905500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3303:1870073693248512:0@lo:400:kworker.0 00000100:00100000:0.0:1783441405.295684:0:3303:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff91a745907800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:6c1ddb50-5795-40c6-a2b6-8f58add9da62:3303:1870073693248384:0@lo:400:kworker.0 00000100:00100000:3.0:1783441405.295967:0:3306:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff91a745907800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3306:1870073693248768:0@lo:400:kworker.0 00000100:00100000:3.0:1783441405.295998:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783441405.296779:0:3306:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1783441405.296788:0:3306:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff91a745904000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3306:1870073693248640:0@lo:400:kworker.0 00000100:00100000:3.0:1783441405.296949:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783441405.296996:0:6605:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073693248640 00000100:00100000:3.0:1783441405.297002:0:6605:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073693248640 00000100:00100000:0.0:1783441405.297147:0:6582:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073693248768 00000100:00100000:0.0:1783441405.297151:0:6582:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073693248768 00000100:00100000:0.0:1783441405.297204:0:6582:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:0.0:1783441405.297212:0:6582:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a745906a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3306:x1870073693248768:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1783441405.297263:0:6582:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a745906a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3306:x1870073693248768:12345-0@lo:400:kworker.0 Request processed in 52us (1263us total) trans 0 rc 0/0 00000100:00100000:0.0:1783441405.297270:0:6582:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00080000:0.0:1783441405.297302:0:5781:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:0.0:1783441405.297333:0:3306:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff91a745907800 x1870073693248768/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1783441421 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1783441405.297345:0:3306:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff91a745907800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3306:1870073693248768:0@lo:400:kworker.0 00000100:00100000:0.0:1783441405.297367:0:3304:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff91a745907100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3304:1870073693249024:0@lo:400:kworker.0 00000100:00100000:0.0:1783441405.297393:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783441405.297414:0:3304:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1783441405.297420:0:3304:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff91a745905500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3304:1870073693248896:0@lo:400:kworker.0 00000100:00100000:0.0:1783441405.297441:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783441405.297465:0:6583:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073693249024 00000100:00100000:0.0:1783441405.297469:0:6583:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073693249024 00000100:00100000:0.0:1783441405.297498:0:6583:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:0.0:1783441405.297504:0:6583:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a844b7c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3304:x1870073693249024:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1783441405.297537:0:6583:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a844b7c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3304:x1870073693249024:12345-0@lo:400:kworker.0 Request processed in 33us (143us total) trans 0 rc 0/0 00000100:00100000:0.0:1783441405.297544:0:6583:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00100000:0.0:1783441405.297561:0:5785:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073693248896 00000100:00100000:0.0:1783441405.297572:0:5785:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073693248896 00000100:00100000:0.0:1783441405.297597:0:5785:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 47 00000100:00100000:0.0:1783441405.297604:0:5785:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a844b7e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3304:x1870073693248896:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1783441405.297632:0:5785:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a844b7e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3304:x1870073693248896:12345-0@lo:400:kworker.0 Request processed in 29us (189us total) trans 0 rc 0/0 00000100:00100000:0.0:1783441405.297638:0:5785:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 47 00000100:00080000:0.0:1783441405.297656:0:5781:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1783441405.297659:0:5781:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1783441405.297677:0:3304:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff91a745905500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3304:1870073693248896:0@lo:400:kworker.0 00010000:00080000:0.0:1783441405.297686:0:3304:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff91a745907100 x1870073693249024/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1783441421 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1783441405.297694:0:3304:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff91a745907100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3304:1870073693249024:0@lo:400:kworker.0 00000100:00100000:3.0:1783441405.297956:0:6605:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 48 00000100:00100000:3.0:1783441405.297963:0:6605:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a745905c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3306:x1870073693248640:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1783441405.297998:0:6605:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a745905c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3306:x1870073693248640:12345-0@lo:400:kworker.0 Request processed in 35us (1050us total) trans 0 rc 0/0 00000100:00100000:3.0:1783441405.298004:0:6605:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 48 00000100:00080000:0.0:1783441405.299972:0:5781:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1783441405.301275:0:3306:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff91a745904000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3306:1870073693248640:0@lo:400:kworker.0 00000100:00100000:0.0:1783441405.810419:0:3305:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff91a745905f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3305:1870073693249152:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1783441405.810509:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783441405.810924:0:6585:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073693249152 00000100:00100000:3.0:1783441405.810932:0:6585:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073693249152 00000100:00100000:3.0:1783441405.810990:0:6585:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:3.0:1783441405.810998:0:6585:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a87d6f0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3305:x1870073693249152:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1783441405.811040:0:6585:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1783441405.811094:0:6585:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a87d6f0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3305:x1870073693249152:12345-0@lo:13:osp-pre-1-0.0 Request processed in 96us (584us total) trans 0 rc 0/0 00000100:00100000:3.0:1783441405.811101:0:6585:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00010000:00080000:0.0:1783441405.811189:0:3305:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff91a745905f80 x1870073693249152/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1783441421 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1783441405.811210:0:3305:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff91a745905f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3305:1870073693249152:0@lo:13:osp-pre-1-0.0 00010000:00010000:1.0:1783441406.062026:0:5773:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1783441406.829911:0:3306:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff91a87d6f3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3306:1870073693249280:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1783441406.829983:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783441406.830204:0:6585:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073693249280 00000100:00100000:3.0:1783441406.830213:0:6585:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073693249280 00000100:00100000:3.0:1783441406.830274:0:6585:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:3.0:1783441406.830283:0:6585:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a859085180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3306:x1870073693249280:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1783441406.830317:0:6585:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1783441406.830371:0:6585:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a859085180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3306:x1870073693249280:12345-0@lo:13:osp-pre-0-0.0 Request processed in 88us (387us total) trans 0 rc 0/0 00000100:00100000:3.0:1783441406.830378:0:6585:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00010000:00080000:1.0:1783441406.830551:0:3306:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff91a87d6f3480 x1870073693249280/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1783441422 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1783441406.830571:0:3306:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff91a87d6f3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3306:1870073693249280:0@lo:13:osp-pre-0-0.0 00010000:00010000:1.0:1783441407.085205:0:5772:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1783441407.863553:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.13@tcp (source: 12345-192.168.201.13@tcp) 00000100:00100000:2.0:1783441407.863598:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.13@tcp (source: 12345-192.168.201.13@tcp) 00000100:00100000:2.0:1783441407.863633:0:5780:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073673293824 00000100:00100000:2.0:1783441407.863644:0:5780:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073673293824 00000100:00100000:2.0:1783441407.863697:0:5780:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.13@tcp, seq: 198 00000100:00100000:2.0:1783441407.863707:0:5780:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a848f74850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:51c2a82e-e792-4f56-84e8-12cc033e9e70+10:2355:x1870073673293824:12345-192.168.201.13@tcp:400:kworker.0 00000100:00100000:2.0:1783441407.863812:0:5780:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a848f74850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:51c2a82e-e792-4f56-84e8-12cc033e9e70+10:2355:x1870073673293824:12345-192.168.201.13@tcp:400:kworker.0 Request processed in 105us (211us total) trans 0 rc 0/0 00000100:00100000:2.0:1783441407.863820:0:5780:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.13@tcp, seq: 198 00000100:00100000:0.0:1783441407.867155:0:5785:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073673293952 00000100:00100000:0.0:1783441407.867168:0:5785:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073673293952 00000100:00100000:0.0:1783441407.869331:0:5785:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.13@tcp, seq: 49 00000100:00100000:0.0:1783441407.869349:0:5785:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a87d4e9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:65454767-383a-4679-a788-eba05c6e0989+6:2355:x1870073673293952:12345-192.168.201.13@tcp:400:kworker.0 00000100:00100000:0.0:1783441407.869454:0:5785:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a87d4e9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:65454767-383a-4679-a788-eba05c6e0989+6:2355:x1870073673293952:12345-192.168.201.13@tcp:400:kworker.0 Request processed in 112us (5908us total) trans 0 rc 0/0 00000100:00100000:0.0:1783441407.869470:0:5785:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.13@tcp, seq: 49 00000100:00080000:3.0:1783441407.876525:0:5781:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000001:02000400:1.0:1783441408.049718:0:9289:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: OSS: 2.17.54.105 00010000:00010000:1.0:1783441408.115511:0:5773:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783441409.135332:0:5772:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:1.0:1783441409.700713:0:9338:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: -----============= acceptance-small: sanity-pcc ============----- Tue Jul 7 12:23:29 EDT 2026 00010000:00010000:1.0:1783441410.157988:0:5773:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1783441410.413084:0:3303:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff91a745904e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:6c1ddb50-5795-40c6-a2b6-8f58add9da62:3303:1870073693249408:0@lo:400:kworker.0 00000100:00100000:0.0:1783441410.413216:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783441410.413379:0:5779:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073693249408 00000100:00100000:1.0:1783441410.413391:0:5779:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073693249408 00000100:00100000:1.0:1783441410.413489:0:5779:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 199 00000100:00100000:1.0:1783441410.413501:0:5779:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a848f76450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6c1ddb50-5795-40c6-a2b6-8f58add9da62+19:3303:x1870073693249408:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1783441410.414185:0:3304:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff91a745907480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3304:1870073693249536:0@lo:400:kworker.0 00000100:00100000:2.0:1783441410.414240:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783441410.414319:0:6605:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073693249536 00000100:00100000:2.0:1783441410.414325:0:6605:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073693249536 00000100:00100000:2.0:1783441410.414370:0:6605:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 50 00000100:00100000:2.0:1783441410.414378:0:6605:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a87d4e9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3304:x1870073693249536:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1783441410.414445:0:6605:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a87d4e9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3304:x1870073693249536:12345-0@lo:400:kworker.0 Request processed in 67us (203us total) trans 0 rc 0/0 00000100:00100000:2.0:1783441410.414465:0:6605:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 50 00000100:00100000:2.0:1783441410.414521:0:3304:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff91a745907480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3304:1870073693249536:0@lo:400:kworker.0 00000100:00100000:1.0:1783441410.420344:0:5779:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a848f76450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6c1ddb50-5795-40c6-a2b6-8f58add9da62+19:3303:x1870073693249408:12345-0@lo:400:kworker.0 Request processed in 6826us (7109us total) trans 0 rc 0/0 00000100:00100000:1.0:1783441410.420367:0:5779:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 199 00000100:00100000:0.0:1783441410.421003:0:3303:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff91a745904e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:6c1ddb50-5795-40c6-a2b6-8f58add9da62:3303:1870073693249408:0@lo:400:kworker.0 00000100:00100000:2.0:1783441410.421788:0:3305:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff91a745904380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3305:1870073693249664:0@lo:400:kworker.0 00000100:00100000:2.0:1783441410.421880:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783441410.422061:0:5785:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073693249664 00000100:00100000:0.0:1783441410.422073:0:5785:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073693249664 00000100:00100000:0.0:1783441410.422166:0:5785:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 51 00000100:00100000:0.0:1783441410.422180:0:5785:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a846f24380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3305:x1870073693249664:12345-0@lo:400:kworker.0 00000100:00080000:1.0:1783441410.422331:0:5781:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1783441410.422349:0:3306:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff91a745904e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3306:1870073693249792:0@lo:400:kworker.0 00000100:00100000:1.0:1783441410.422391:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783441410.422468:0:6582:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073693249792 00000100:00100000:1.0:1783441410.422473:0:6582:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073693249792 00000100:00100000:1.0:1783441410.422515:0:6582:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:1.0:1783441410.422524:0:6582:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a859086680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3306:x1870073693249792:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1783441410.422564:0:6582:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a859086680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3306:x1870073693249792:12345-0@lo:400:kworker.0 Request processed in 41us (171us total) trans 0 rc 0/0 00000100:00100000:1.0:1783441410.422572:0:6582:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00080000:1.0:1783441410.422596:0:5781:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:1.0:1783441410.422642:0:3306:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff91a745904e00 x1870073693249792/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1783441426 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1783441410.422659:0:3306:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff91a745904e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3306:1870073693249792:0@lo:400:kworker.0 00000100:00100000:0.0:1783441410.428297:0:5785:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a846f24380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3305:x1870073693249664:12345-0@lo:400:kworker.0 Request processed in 6105us (6400us total) trans 0 rc 0/0 00000100:00100000:0.0:1783441410.428319:0:5785:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 51 00000100:00100000:1.0:1783441410.429008:0:3304:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff91a745905f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3304:1870073693250048:0@lo:400:kworker.0 00000100:00100000:1.0:1783441410.429109:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783441410.429171:0:3304:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1783441410.429178:0:3304:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff91a745907480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3304:1870073693249920:0@lo:400:kworker.0 00000100:00100000:1.0:1783441410.429208:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783441410.429251:0:6605:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073693249920 00000100:00100000:1.0:1783441410.429262:0:6605:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073693249920 00000100:00100000:1.0:1783441410.429335:0:6605:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 52 00000100:00100000:1.0:1783441410.429346:0:6605:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a859085c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3304:x1870073693249920:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1783441410.429425:0:6605:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a859085c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3304:x1870073693249920:12345-0@lo:400:kworker.0 Request processed in 80us (214us total) trans 0 rc 0/0 00000100:00100000:1.0:1783441410.429432:0:6605:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 52 00000100:00080000:1.0:1783441410.429717:0:5781:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1783441410.429797:0:3304:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff91a745907480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3304:1870073693249920:0@lo:400:kworker.0 00000100:00100000:3.0:1783441410.429910:0:6583:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073693250048 00000100:00100000:3.0:1783441410.429917:0:6583:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073693250048 00000100:00100000:3.0:1783441410.429985:0:6583:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:3.0:1783441410.429993:0:6583:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a859087100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3304:x1870073693250048:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1783441410.430048:0:6583:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a859087100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3304:x1870073693250048:12345-0@lo:400:kworker.0 Request processed in 57us (940us total) trans 0 rc 0/0 00000100:00100000:3.0:1783441410.430056:0:6583:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00010000:00080000:3.0:1783441410.430090:0:3304:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff91a745905f80 x1870073693250048/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1783441426 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1783441410.430101:0:3304:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff91a745905f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3304:1870073693250048:0@lo:400:kworker.0 00000100:00080000:1.0:1783441410.430264:0:5781:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1783441410.433524:0:3305:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff91a745904380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3305:1870073693249664:0@lo:400:kworker.0 00000100:00100000:0.0:1783441410.925296:0:3306:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1783441410.925325:0:3306:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff91a745905f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3306:1870073693250176:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1783441410.925427:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783441410.925582:0:6585:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073693250176 00000100:00100000:3.0:1783441410.925591:0:6585:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073693250176 00000100:00100000:3.0:1783441410.925651:0:6585:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:3.0:1783441410.925674:0:6585:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a87d6f1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3306:x1870073693250176:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1783441410.925720:0:6585:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1783441410.925803:0:6585:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a87d6f1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3306:x1870073693250176:12345-0@lo:13:osp-pre-1-0.0 Request processed in 131us (376us total) trans 0 rc 0/0 00000100:00100000:3.0:1783441410.925810:0:6585:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00010000:00080000:3.0:1783441410.925852:0:3306:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff91a745905f80 x1870073693250176/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1783441426 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1783441410.925870:0:3306:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff91a745905f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3306:1870073693250176:0@lo:13:osp-pre-1-0.0 00010000:00010000:1.0:1783441411.180980:0:5772:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1783441411.950160:0:3305:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1783441411.950182:0:3305:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff91a745905f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3305:1870073693250304:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1783441411.950252:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783441411.950312:0:6585:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073693250304 00000100:00100000:3.0:1783441411.950319:0:6585:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073693250304 00000100:00100000:3.0:1783441411.950374:0:6585:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:3.0:1783441411.950383:0:6585:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a745904000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3305:x1870073693250304:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1783441411.950419:0:6585:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1783441411.950461:0:6585:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a745904000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3305:x1870073693250304:12345-0@lo:13:osp-pre-0-0.0 Request processed in 79us (208us total) trans 0 rc 0/0 00000100:00100000:3.0:1783441411.950467:0:6585:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00010000:00080000:3.0:1783441411.950502:0:3305:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff91a745905f80 x1870073693250304/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1783441427 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1783441411.950520:0:3305:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff91a745905f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3305:1870073693250304:0@lo:13:osp-pre-0-0.0 00010000:00010000:3.0:1783441412.219549:0:5773:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1783441412.984506:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.13@tcp (source: 12345-192.168.201.13@tcp) 00000100:00100000:2.0:1783441412.984553:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.13@tcp (source: 12345-192.168.201.13@tcp) 00000100:00100000:0.0:1783441412.984834:0:5778:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073673294080 00000100:00100000:0.0:1783441412.984845:0:5778:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073673294080 00000100:00100000:3.0:1783441412.984860:0:5787:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073673294208 00000100:00100000:3.0:1783441412.984867:0:5787:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073673294208 00000100:00100000:0.0:1783441412.984911:0:5778:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.13@tcp, seq: 200 00000100:00100000:0.0:1783441412.984923:0:5778:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a848f76c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:51c2a82e-e792-4f56-84e8-12cc033e9e70+10:2354:x1870073673294080:12345-192.168.201.13@tcp:400:kworker.0 00000100:00100000:3.0:1783441412.984931:0:5787:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.13@tcp, seq: 53 00000100:00100000:3.0:1783441412.984941:0:5787:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a846f25500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:65454767-383a-4679-a788-eba05c6e0989+6:2354:x1870073673294208:12345-192.168.201.13@tcp:400:kworker.0 00000100:00100000:0.0:1783441412.985053:0:5778:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a848f76c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:51c2a82e-e792-4f56-84e8-12cc033e9e70+10:2354:x1870073673294080:12345-192.168.201.13@tcp:400:kworker.0 Request processed in 133us (554us total) trans 0 rc 0/0 00000100:00100000:0.0:1783441412.985060:0:5778:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.13@tcp, seq: 200 00000100:00080000:0.0:1783441412.996820:0:5781:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1783441412.998121:0:5787:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a846f25500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:65454767-383a-4679-a788-eba05c6e0989+6:2354:x1870073673294208:12345-192.168.201.13@tcp:400:kworker.0 Request processed in 13171us (13556us total) trans 0 rc 0/0 00000100:00100000:3.0:1783441412.998136:0:5787:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.13@tcp, seq: 53 00010000:00010000:1.0:1783441413.229050:0:5772:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783441414.254409:0:5773:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783441415.277205:0:5772:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1783441415.534153:0:3304:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff91a745907100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3304:1870073693250560:0@lo:400:kworker.0 00000100:00100000:1.0:1783441415.534169:0:3305:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff91a745905500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3305:1870073693250688:0@lo:400:kworker.0 00000100:00100000:3.0:1783441415.534248:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783441415.534274:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783441415.534312:0:3304:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff91a745907480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3304:1870073693251072:0@lo:400:kworker.0 00000100:00100000:1.0:1783441415.534319:0:3305:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1783441415.534328:0:3305:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff91a745907800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3305:1870073693250816:0@lo:400:kworker.0 00000100:00100000:3.0:1783441415.534343:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783441415.534367:0:5786:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073693250560 00000100:00100000:3.0:1783441415.534380:0:3304:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:1.0:1783441415.534385:0:5786:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073693250560 00000100:00100000:3.0:1783441415.534387:0:3304:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff91a745905f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:6c1ddb50-5795-40c6-a2b6-8f58add9da62:3304:1870073693250432:0@lo:400:kworker.0 00000100:00100000:3.0:1783441415.534415:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783441415.534435:0:3304:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff91a745904380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3304:1870073693250944:0@lo:400:kworker.0 00000100:00100000:1.0:1783441415.534444:0:5786:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073693250688 00000100:00100000:1.0:1783441415.534448:0:5786:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073693250688 00000100:00100000:3.0:1783441415.534455:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783441415.534472:0:5786:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073693250944 00000100:00100000:1.0:1783441415.534476:0:5786:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073693250944 00000100:00100000:3.0:1783441415.534492:0:6605:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 54 00000100:00100000:2.0:1783441415.534546:0:5779:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073693250432 00000100:00100000:2.0:1783441415.534550:0:5779:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073693250432 00000100:00100000:2.0:1783441415.534576:0:5779:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 201 00000100:00100000:2.0:1783441415.534582:0:5779:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a848f77c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6c1ddb50-5795-40c6-a2b6-8f58add9da62+19:3304:x1870073693250432:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1783441415.534640:0:5779:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a848f77c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6c1ddb50-5795-40c6-a2b6-8f58add9da62+19:3304:x1870073693250432:12345-0@lo:400:kworker.0 Request processed in 57us (223us total) trans 0 rc 0/0 00000100:00100000:2.0:1783441415.534646:0:5779:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 201 00000100:00100000:2.0:1783441415.534697:0:3304:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff91a745905f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:6c1ddb50-5795-40c6-a2b6-8f58add9da62:3304:1870073693250432:0@lo:400:kworker.0 00000100:00100000:2.0:1783441415.534728:0:6582:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073693251072 00000100:00100000:2.0:1783441415.534731:0:6582:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073693251072 00000100:00100000:2.0:1783441415.534778:0:6582:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:2.0:1783441415.534784:0:6582:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a8756a7100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3304:x1870073693251072:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1783441415.534825:0:6582:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a8756a7100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3304:x1870073693251072:12345-0@lo:400:kworker.0 Request processed in 31us (473us total) trans 0 rc 0/0 00000100:00100000:2.0:1783441415.534831:0:6582:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00100000:2.0:1783441415.534849:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783441415.534871:0:6583:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073693250816 00000100:00100000:2.0:1783441415.534874:0:6583:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073693250816 00000100:00100000:2.0:1783441415.534894:0:6583:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:2.0:1783441415.534899:0:6583:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a846f24e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3305:x1870073693250816:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1783441415.534926:0:6583:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a846f24e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3305:x1870073693250816:12345-0@lo:400:kworker.0 Request processed in 27us (75us total) trans 0 rc 0/0 00000100:00100000:2.0:1783441415.534930:0:6583:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00010000:00080000:2.0:1783441415.534954:0:3305:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff91a745907800 x1870073693250816/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1783441431 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1783441415.534972:0:3305:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff91a745907800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3305:1870073693250816:0@lo:400:kworker.0 00010000:00080000:2.0:1783441415.534991:0:3304:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff91a745907480 x1870073693251072/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1783441431 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1783441415.534999:0:3304:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff91a745907480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3304:1870073693251072:0@lo:400:kworker.0 00000100:00100000:3.0:1783441415.535230:0:6605:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a745904e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3304:x1870073693250560:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1783441415.535267:0:6605:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a745904e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3304:x1870073693250560:12345-0@lo:400:kworker.0 Request processed in 767us (1020us total) trans 0 rc 0/0 00000100:00080000:0.0:1783441415.535558:0:5781:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1783441415.535563:0:5781:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1783441415.535566:0:5781:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1783441415.540942:0:3304:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff91a745907100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3304:1870073693250560:0@lo:400:kworker.0 00000100:00100000:1.0:1783441415.542239:0:5786:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 55 00000100:00100000:0.0:1783441415.542350:0:5786:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a859087b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3305:x1870073693250688:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1783441415.542474:0:5786:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a859087b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3305:x1870073693250688:12345-0@lo:400:kworker.0 Request processed in 214us (8191us total) trans 0 rc 0/0 00000100:00100000:0.0:1783441415.542483:0:5786:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 55 00000100:00100000:0.0:1783441415.542515:0:5786:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 56 00000100:00100000:0.0:1783441415.542522:0:5786:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a8756a5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3304:x1870073693250944:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1783441415.542558:0:5786:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a8756a5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3304:x1870073693250944:12345-0@lo:400:kworker.0 Request processed in 37us (8103us total) trans 0 rc 0/0 00000100:00100000:0.0:1783441415.542565:0:5786:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 56 00000100:00100000:0.0:1783441415.542594:0:3304:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff91a745904380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3304:1870073693250944:0@lo:400:kworker.0 00000100:00100000:1.0:1783441415.542784:0:3305:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff91a745905500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3305:1870073693250688:0@lo:400:kworker.0 00000100:00100000:3.0:1783441415.545910:0:6605:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 54 00000100:00100000:1.0:1783441416.048150:0:3305:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff91a8756a4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3305:1870073693251200:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1783441416.048234:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783441416.053891:0:6585:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073693251200 00000100:00100000:1.0:1783441416.053906:0:6585:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073693251200 00000100:00100000:1.0:1783441416.053961:0:6585:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:1.0:1783441416.053971:0:6585:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a859086a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3305:x1870073693251200:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1783441416.054010:0:6585:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1783441416.056796:0:6585:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a859086a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3305:x1870073693251200:12345-0@lo:13:osp-pre-1-0.0 Request processed in 2819us (8554us total) trans 0 rc 0/0 00000100:00100000:1.0:1783441416.056811:0:6585:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00010000:00080000:3.0:1783441416.067841:0:3305:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff91a8756a4e00 x1870073693251200/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1783441432 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1783441416.067866:0:3305:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff91a8756a4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3305:1870073693251200:0@lo:13:osp-pre-1-0.0 00010000:00010000:1.0:1783441416.302811:0:5773:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1783441417.069019:0:3306:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff91a8756a4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3306:1870073693251328:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1783441417.069147:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783441417.069278:0:6584:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073693251328 00000100:00100000:0.0:1783441417.069286:0:6584:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073693251328 00000100:00100000:0.0:1783441417.069359:0:6584:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:0.0:1783441417.069369:0:6584:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a745905500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3306:x1870073693251328:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1783441417.069402:0:6584:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00080000:1.0:1783441417.072876:0:5781:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1783441417.074759:0:6584:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a745905500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3306:x1870073693251328:12345-0@lo:13:osp-pre-0-0.0 Request processed in 5369us (5589us total) trans 0 rc 0/0 00000100:00100000:0.0:1783441417.074772:0:6584:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00010000:00080000:3.0:1783441417.075640:0:3306:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff91a8756a4e00 x1870073693251328/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1783441433 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1783441417.075683:0:3306:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff91a8756a4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3306:1870073693251328:0@lo:13:osp-pre-0-0.0 00010000:00010000:3.0:1783441417.326021:0:5772:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1783441418.100260:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.13@tcp (source: 12345-192.168.201.13@tcp) 00000100:00100000:0.0:1783441418.100311:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.13@tcp (source: 12345-192.168.201.13@tcp) 00000100:00100000:2.0:1783441418.100327:0:5778:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073673294336 00000100:00100000:2.0:1783441418.100338:0:5778:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073673294336 00000100:00100000:2.0:1783441418.100424:0:5778:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.13@tcp, seq: 202 00000100:00100000:2.0:1783441418.100434:0:5778:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a848f76050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:51c2a82e-e792-4f56-84e8-12cc033e9e70+10:2354:x1870073673294336:12345-192.168.201.13@tcp:400:kworker.0 00000100:00100000:2.0:1783441418.100511:0:5778:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a848f76050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:51c2a82e-e792-4f56-84e8-12cc033e9e70+10:2354:x1870073673294336:12345-192.168.201.13@tcp:400:kworker.0 Request processed in 78us (260us total) trans 0 rc 0/0 00000100:00100000:2.0:1783441418.100518:0:5778:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.13@tcp, seq: 202 00000100:00100000:1.0:1783441418.100648:0:5786:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073673294464 00000100:00100000:1.0:1783441418.100653:0:5786:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073673294464 00000100:00100000:1.0:1783441418.100706:0:5786:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.13@tcp, seq: 57 00000100:00100000:1.0:1783441418.100714:0:5786:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a87d6f2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:65454767-383a-4679-a788-eba05c6e0989+6:2354:x1870073673294464:12345-192.168.201.13@tcp:400:kworker.0 00000100:00100000:0.0:1783441418.101012:0:5786:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a87d6f2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:65454767-383a-4679-a788-eba05c6e0989+6:2354:x1870073673294464:12345-192.168.201.13@tcp:400:kworker.0 Request processed in 297us (698us total) trans 0 rc 0/0 00000100:00100000:0.0:1783441418.101020:0:5786:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.13@tcp, seq: 57 00000100:00080000:2.0:1783441418.101373:0:5781:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:1.0:1783441418.354384:0:5773:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783441419.379918:0:5772:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783441420.397042:0:5773:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1783441420.657921:0:3306:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1783441420.657947:0:3306:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff91a87d80f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3306:1870073693251712:0@lo:400:kworker.0 00000100:00100000:3.0:1783441420.658026:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783441420.658101:0:5787:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073693251712 00000100:00100000:3.0:1783441420.658109:0:5787:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073693251712 00000100:00100000:3.0:1783441420.658166:0:5787:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 58 00000100:00100000:3.0:1783441420.658176:0:5787:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a87d80d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3306:x1870073693251712:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1783441420.658230:0:5787:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a87d80d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3306:x1870073693251712:12345-0@lo:400:kworker.0 Request processed in 55us (203us total) trans 0 rc 0/0 00000100:00100000:3.0:1783441420.658237:0:5787:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 58 00000100:00080000:3.0:1783441420.658259:0:5781:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1783441420.658287:0:3306:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff91a87d80f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3306:1870073693251712:0@lo:400:kworker.0 00000100:00100000:3.0:1783441420.658325:0:3306:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff91a87d80f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3306:1870073693251840:0@lo:400:kworker.0 00000100:00100000:3.0:1783441420.658353:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783441420.658386:0:6582:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073693251840 00000100:00100000:3.0:1783441420.658390:0:6582:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073693251840 00000100:00100000:3.0:1783441420.658421:0:6582:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:3.0:1783441420.658427:0:6582:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a87d80e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3306:x1870073693251840:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1783441420.658474:0:6582:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a87d80e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3306:x1870073693251840:12345-0@lo:400:kworker.0 Request processed in 34us (107us total) trans 0 rc 0/0 00000100:00100000:3.0:1783441420.658480:0:6582:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00000100:00080000:3.0:1783441420.658499:0:5781:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:3.0:1783441420.658525:0:3306:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff91a87d80f480 x1870073693251840/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1783441436 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1783441420.658552:0:3306:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff91a87d80f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3306:1870073693251840:0@lo:400:kworker.0 00000100:00100000:0.0:1783441420.658762:0:3303:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff91a8756a4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:6c1ddb50-5795-40c6-a2b6-8f58add9da62:3303:1870073693251456:0@lo:400:kworker.0 00000100:00100000:0.0:1783441420.658805:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783441420.658826:0:3303:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff91a87d80f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3303:1870073693251968:0@lo:400:kworker.0 00000100:00100000:0.0:1783441420.658849:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783441420.658914:0:3303:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:0.0:1783441420.658921:0:3303:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff91a8756a6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3303:1870073693251584:0@lo:400:kworker.0 00000100:00100000:0.0:1783441420.658943:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783441420.658959:0:3303:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff91a87d80fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3303:1870073693252096:0@lo:400:kworker.0 00000100:00100000:0.0:1783441420.658980:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783441420.659006:0:6605:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073693251968 00000100:00100000:0.0:1783441420.659010:0:6605:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073693251968 00000100:00100000:0.0:1783441420.659040:0:6605:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073693251584 00000100:00100000:0.0:1783441420.659043:0:6605:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073693251584 00000100:00100000:0.0:1783441420.659055:0:6605:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 59 00000100:00100000:0.0:1783441420.659061:0:6605:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a87d6f3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3303:x1870073693251968:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1783441420.659095:0:6605:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a87d6f3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3303:x1870073693251968:12345-0@lo:400:kworker.0 Request processed in 34us (245us total) trans 0 rc 0/0 00000100:00100000:0.0:1783441420.659101:0:6605:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 59 00000100:00100000:0.0:1783441420.659113:0:6605:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 60 00000100:00100000:0.0:1783441420.659119:0:6605:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a87d6f1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3303:x1870073693251584:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1783441420.659145:0:6605:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a87d6f1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3303:x1870073693251584:12345-0@lo:400:kworker.0 Request processed in 27us (201us total) trans 0 rc 0/0 00000100:00100000:0.0:1783441420.659151:0:6605:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 60 00000100:00100000:0.0:1783441420.659174:0:6583:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073693252096 00000100:00100000:0.0:1783441420.659178:0:6583:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073693252096 00000100:00100000:0.0:1783441420.659202:0:6583:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:0.0:1783441420.659209:0:6583:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a87d6f2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3303:x1870073693252096:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1783441420.659246:0:6583:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a87d6f2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3303:x1870073693252096:12345-0@lo:400:kworker.0 Request processed in 38us (265us total) trans 0 rc 0/0 00000100:00100000:0.0:1783441420.659252:0:6583:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00000100:00080000:0.0:1783441420.659268:0:5781:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1783441420.659271:0:5781:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1783441420.659289:0:3303:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff91a8756a6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3303:1870073693251584:0@lo:400:kworker.0 00010000:00080000:0.0:1783441420.659299:0:3303:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff91a87d80fb80 x1870073693252096/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1783441436 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1783441420.659306:0:3303:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff91a87d80fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3303:1870073693252096:0@lo:400:kworker.0 00000100:00100000:0.0:1783441420.659314:0:3303:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff91a87d80f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3303:1870073693251968:0@lo:400:kworker.0 00000100:00100000:3.0:1783441420.662412:0:5780:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073693251456 00000100:00100000:3.0:1783441420.662437:0:5780:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073693251456 00000100:00100000:3.0:1783441420.662511:0:5780:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 203 00000100:00100000:3.0:1783441420.662522:0:5780:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a848f77850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6c1ddb50-5795-40c6-a2b6-8f58add9da62+19:3303:x1870073693251456:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1783441420.662627:0:5780:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a848f77850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6c1ddb50-5795-40c6-a2b6-8f58add9da62+19:3303:x1870073693251456:12345-0@lo:400:kworker.0 Request processed in 106us (3820us total) trans 0 rc 0/0 00000100:00100000:3.0:1783441420.662634:0:5780:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 203 00000100:00100000:0.0:1783441420.663853:0:3303:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff91a8756a4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:6c1ddb50-5795-40c6-a2b6-8f58add9da62:3303:1870073693251456:0@lo:400:kworker.0 00000100:00100000:2.0:1783441421.165019:0:3305:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff91a87d6f0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3305:1870073693252224:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1783441421.165094:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783441421.165228:0:6585:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073693252224 00000100:00100000:0.0:1783441421.165236:0:6585:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073693252224 00000100:00100000:0.0:1783441421.165292:0:6585:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:0.0:1783441421.165303:0:6585:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a745904380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3305:x1870073693252224:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1783441421.165343:0:6585:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1783441421.167620:0:6585:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a745904380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3305:x1870073693252224:12345-0@lo:13:osp-pre-1-0.0 Request processed in 2308us (2514us total) trans 0 rc 0/0 00000100:00100000:0.0:1783441421.167637:0:6585:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00010000:00080000:3.0:1783441421.168682:0:3305:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff91a87d6f0a80 x1870073693252224/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1783441437 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1783441421.168711:0:3305:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff91a87d6f0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3305:1870073693252224:0@lo:13:osp-pre-1-0.0 00010000:00010000:3.0:1783441421.427831:0:5772:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1783441422.188965:0:3306:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff91a87d80d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3306:1870073693252352:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1783441422.189047:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783441422.189138:0:6585:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073693252352 00000100:00100000:3.0:1783441422.189147:0:6585:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073693252352 00000100:00100000:3.0:1783441422.189216:0:6585:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:3.0:1783441422.189225:0:6585:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a87d80ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3306:x1870073693252352:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1783441422.189259:0:6585:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1783441422.189302:0:6585:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a87d80ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3306:x1870073693252352:12345-0@lo:13:osp-pre-0-0.0 Request processed in 77us (255us total) trans 0 rc 0/0 00000100:00100000:3.0:1783441422.189310:0:6585:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00080000:3.0:1783441422.189331:0:5781:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:3.0:1783441422.189368:0:3306:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff91a87d80d180 x1870073693252352/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1783441438 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1783441422.189385:0:3306:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff91a87d80d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3306:1870073693252352:0@lo:13:osp-pre-0-0.0 00010000:00010000:3.0:1783441422.444908:0:5773:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1783441423.224971:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.13@tcp (source: 12345-192.168.201.13@tcp) 00000100:00100000:1.0:1783441423.225016:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.13@tcp (source: 12345-192.168.201.13@tcp) 00000100:00100000:1.0:1783441423.225046:0:5779:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073673294592 00000100:00100000:1.0:1783441423.225067:0:5779:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073673294592 00000100:00100000:1.0:1783441423.225114:0:5779:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.13@tcp, seq: 204 00000100:00100000:1.0:1783441423.225123:0:5779:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a848f76850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:51c2a82e-e792-4f56-84e8-12cc033e9e70+10:2354:x1870073673294592:12345-192.168.201.13@tcp:400:kworker.0 00000100:00100000:1.0:1783441423.225203:0:5779:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a848f76850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:51c2a82e-e792-4f56-84e8-12cc033e9e70+10:2354:x1870073673294592:12345-192.168.201.13@tcp:400:kworker.0 Request processed in 80us (239us total) trans 0 rc 0/0 00000100:00100000:1.0:1783441423.225211:0:5779:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.13@tcp, seq: 204 00000100:00100000:1.0:1783441423.225246:0:6605:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073673294720 00000100:00100000:1.0:1783441423.225250:0:6605:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073673294720 00000100:00100000:1.0:1783441423.225291:0:6605:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.13@tcp, seq: 61 00000100:00100000:1.0:1783441423.225297:0:6605:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a859084700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:65454767-383a-4679-a788-eba05c6e0989+6:2354:x1870073673294720:12345-192.168.201.13@tcp:400:kworker.0 00000100:00100000:1.0:1783441423.225328:0:6605:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a859084700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:65454767-383a-4679-a788-eba05c6e0989+6:2354:x1870073673294720:12345-192.168.201.13@tcp:400:kworker.0 Request processed in 31us (311us total) trans 0 rc 0/0 00000100:00100000:1.0:1783441423.225334:0:6605:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.13@tcp, seq: 61 00000100:00080000:1.0:1783441423.225464:0:5781:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:3.0:1783441423.471344:0:5772:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783441424.494077:0:5773:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783441425.517934:0:5772:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1783441425.775236:0:3303:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff91a87d80d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:6c1ddb50-5795-40c6-a2b6-8f58add9da62:3303:1870073693252480:0@lo:400:kworker.0 00000100:00100000:0.0:1783441425.775346:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783441425.775732:0:3305:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff91a87d80ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3305:1870073693252736:0@lo:400:kworker.0 00000100:00100000:3.0:1783441425.775801:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783441425.775863:0:3305:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1783441425.775870:0:3305:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff91a87d80df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3305:1870073693252864:0@lo:400:kworker.0 00000100:00100000:3.0:1783441425.775897:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783441425.775940:0:6582:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073693252864 00000100:00100000:3.0:1783441425.775949:0:6582:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073693252864 00000100:00100000:3.0:1783441425.776016:0:6582:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:0.0:1783441425.776143:0:3303:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff91a87d80c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3303:1870073693252992:0@lo:400:kworker.0 00000100:00100000:0.0:1783441425.776171:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783441425.776190:0:3303:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:0.0:1783441425.776212:0:3303:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff91a87d80ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3303:1870073693252608:0@lo:400:kworker.0 00000100:00100000:0.0:1783441425.776238:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783441425.776260:0:3303:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff91a87d80dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3303:1870073693253120:0@lo:400:kworker.0 00000100:00100000:0.0:1783441425.776282:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783441425.776311:0:5786:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073693252736 00000100:00100000:0.0:1783441425.776317:0:5786:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073693252736 00000100:00100000:0.0:1783441425.776350:0:5786:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073693252992 00000100:00100000:0.0:1783441425.776352:0:5786:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073693252992 00000100:00100000:0.0:1783441425.776367:0:5786:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073693252608 00000100:00100000:0.0:1783441425.776370:0:5786:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073693252608 00000100:00100000:0.0:1783441425.776400:0:5786:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 62 00000100:00100000:0.0:1783441425.776410:0:5786:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a87d80f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3305:x1870073693252736:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1783441425.776649:0:5786:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a87d80f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3305:x1870073693252736:12345-0@lo:400:kworker.0 Request processed in 238us (845us total) trans 0 rc 0/0 00000100:00100000:0.0:1783441425.776658:0:5786:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 62 00000100:00100000:0.0:1783441425.776683:0:5786:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 63 00000100:00100000:0.0:1783441425.776691:0:5786:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a87d6f2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3303:x1870073693252992:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1783441425.776723:0:5786:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a87d6f2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3303:x1870073693252992:12345-0@lo:400:kworker.0 Request processed in 34us (551us total) trans 0 rc 0/0 00000100:00100000:0.0:1783441425.776729:0:5786:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 63 00000100:00100000:0.0:1783441425.776762:0:5786:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 64 00000100:00100000:0.0:1783441425.776769:0:5786:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a87d6f1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3303:x1870073693252608:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1783441425.776797:0:5786:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a87d6f1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3303:x1870073693252608:12345-0@lo:400:kworker.0 Request processed in 29us (558us total) trans 0 rc 0/0 00000100:00100000:0.0:1783441425.776803:0:5786:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 64 00000100:00100000:0.0:1783441425.776831:0:6583:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073693253120 00000100:00100000:0.0:1783441425.776835:0:6583:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073693253120 00000100:00100000:3.0:1783441425.777118:0:6582:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a87d80ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3305:x1870073693252864:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1783441425.777159:0:6582:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a87d80ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3305:x1870073693252864:12345-0@lo:400:kworker.0 Request processed in 46us (1262us total) trans 0 rc 0/0 00000100:00100000:0.0:1783441425.777196:0:6583:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:0.0:1783441425.777203:0:6583:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a87d6f0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3303:x1870073693253120:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1783441425.777233:0:6583:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a87d6f0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3303:x1870073693253120:12345-0@lo:400:kworker.0 Request processed in 32us (949us total) trans 0 rc 0/0 00000100:00100000:0.0:1783441425.777239:0:6583:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00000100:00100000:0.0:1783441425.777289:0:3303:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff91a87d80ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3303:1870073693252608:0@lo:400:kworker.0 00010000:00080000:0.0:1783441425.777304:0:3303:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff91a87d80dc00 x1870073693253120/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1783441441 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1783441425.777316:0:3303:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff91a87d80dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3303:1870073693253120:0@lo:400:kworker.0 00000100:00100000:0.0:1783441425.777327:0:3303:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff91a87d80c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3303:1870073693252992:0@lo:400:kworker.0 00000100:00080000:1.0:1783441425.777665:0:5781:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1783441425.777672:0:5781:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1783441425.777675:0:5781:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1783441425.777713:0:6582:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00010000:00080000:0.0:1783441425.778223:0:3305:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff91a87d80df80 x1870073693252864/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1783441441 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1783441425.778238:0:3305:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff91a87d80df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3305:1870073693252864:0@lo:400:kworker.0 00000100:00100000:0.0:1783441425.778252:0:3305:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff91a87d80ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3305:1870073693252736:0@lo:400:kworker.0 00000100:00100000:2.0:1783441425.789946:0:5778:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073693252480 00000100:00100000:2.0:1783441425.789965:0:5778:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073693252480 00000100:00100000:2.0:1783441425.790138:0:5778:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 205 00000100:00100000:2.0:1783441425.790149:0:5778:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a848f75450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6c1ddb50-5795-40c6-a2b6-8f58add9da62+19:3303:x1870073693252480:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1783441425.790272:0:5778:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a848f75450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6c1ddb50-5795-40c6-a2b6-8f58add9da62+19:3303:x1870073693252480:12345-0@lo:400:kworker.0 Request processed in 126us (14927us total) trans 0 rc 0/0 00000100:00100000:2.0:1783441425.790281:0:5778:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 205 00000100:00100000:3.0:1783441425.790403:0:3303:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff91a87d80d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:6c1ddb50-5795-40c6-a2b6-8f58add9da62:3303:1870073693252480:0@lo:400:kworker.0 00000100:00100000:2.0:1783441426.285907:0:3306:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1783441426.285943:0:3306:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff91a87d6f1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3306:1870073693253248:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1783441426.286037:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783441426.286123:0:6585:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073693253248 00000100:00100000:2.0:1783441426.286133:0:6585:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073693253248 00000100:00100000:2.0:1783441426.286194:0:6585:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:2.0:1783441426.286204:0:6585:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a745907100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3306:x1870073693253248:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1783441426.286254:0:6585:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1783441426.286313:0:6585:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a745907100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3306:x1870073693253248:12345-0@lo:13:osp-pre-1-0.0 Request processed in 110us (275us total) trans 0 rc 0/0 00000100:00100000:2.0:1783441426.286321:0:6585:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00010000:00080000:2.0:1783441426.286372:0:3306:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff91a87d6f1c00 x1870073693253248/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1783441442 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1783441426.286393:0:3306:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff91a87d6f1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3306:1870073693253248:0@lo:13:osp-pre-1-0.0 00010000:00010000:3.0:1783441426.543728:0:5773:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1783441427.309240:0:3306:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff91a87d80d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3306:1870073693253376:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1783441427.309349:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783441427.310131:0:6585:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073693253376 00000100:00100000:3.0:1783441427.310153:0:6585:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073693253376 00000100:00100000:3.0:1783441427.310220:0:6585:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:3.0:1783441427.310230:0:6585:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a87d6f3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3306:x1870073693253376:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1783441427.310281:0:6585:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1783441427.310360:0:6585:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a87d6f3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3306:x1870073693253376:12345-0@lo:13:osp-pre-0-0.0 Request processed in 122us (1001us total) trans 0 rc 0/0 00000100:00100000:3.0:1783441427.310396:0:6585:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00080000:1.0:1783441427.311032:0:5781:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:1.0:1783441427.311105:0:3306:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff91a87d80d180 x1870073693253376/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1783441443 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1783441427.311140:0:3306:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff91a87d80d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3306:1870073693253376:0@lo:13:osp-pre-0-0.0 00010000:00010000:3.0:1783441427.566103:0:5772:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1783441428.349136:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.13@tcp (source: 12345-192.168.201.13@tcp) 00000100:00100000:3.0:1783441428.349178:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.13@tcp (source: 12345-192.168.201.13@tcp) 00000100:00100000:1.0:1783441428.349474:0:5780:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073673294848 00000100:00100000:1.0:1783441428.349488:0:5780:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073673294848 00000100:00100000:1.0:1783441428.349686:0:5780:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.13@tcp, seq: 206 00000100:00100000:1.0:1783441428.349699:0:5780:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a848f75850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:51c2a82e-e792-4f56-84e8-12cc033e9e70+10:2354:x1870073673294848:12345-192.168.201.13@tcp:400:kworker.0 00000100:00100000:1.0:1783441428.349818:0:5780:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a848f75850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:51c2a82e-e792-4f56-84e8-12cc033e9e70+10:2354:x1870073673294848:12345-192.168.201.13@tcp:400:kworker.0 Request processed in 121us (696us total) trans 0 rc 0/0 00000100:00100000:1.0:1783441428.349840:0:5780:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.13@tcp, seq: 206 00000100:00100000:0.0:1783441428.358298:0:5786:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073673294976 00000100:00100000:0.0:1783441428.358322:0:5786:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073673294976 00000100:00080000:2.0:1783441428.358455:0:5781:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1783441428.359393:0:5786:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.13@tcp, seq: 65 00000100:00100000:0.0:1783441428.359425:0:5786:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a87d80e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:65454767-383a-4679-a788-eba05c6e0989+6:2354:x1870073673294976:12345-192.168.201.13@tcp:400:kworker.0 00000100:00100000:0.0:1783441428.359544:0:5786:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a87d80e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:65454767-383a-4679-a788-eba05c6e0989+6:2354:x1870073673294976:12345-192.168.201.13@tcp:400:kworker.0 Request processed in 138us (10363us total) trans 0 rc 0/0 00000100:00100000:0.0:1783441428.359553:0:5786:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.13@tcp, seq: 65 00010000:00010000:3.0:1783441428.588910:0:5773:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783441429.613462:0:5772:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783441430.637117:0:5773:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1783441430.896064:0:3305:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff91a87d80c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3305:1870073693253760:0@lo:400:kworker.0 00000100:00100000:3.0:1783441430.896184:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783441430.896261:0:3305:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1783441430.896268:0:3305:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff91a87d80c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3305:1870073693253888:0@lo:400:kworker.0 00000100:00100000:0.0:1783441430.896506:0:3303:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff91a87d80f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:6c1ddb50-5795-40c6-a2b6-8f58add9da62:3303:1870073693253504:0@lo:400:kworker.0 00000100:00100000:2.0:1783441430.896597:0:3304:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff91a87d80d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3304:1870073693253632:0@lo:400:kworker.0 00000100:00100000:0.0:1783441430.901555:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783441430.901651:0:3303:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff91a87d80d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3303:1870073693254016:0@lo:400:kworker.0 00000100:00100000:0.0:1783441430.901701:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783441430.901791:0:5778:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073693253504 00000100:00100000:0.0:1783441430.901803:0:5778:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073693253504 00000100:00100000:0.0:1783441430.901879:0:5778:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 207 00000100:00100000:0.0:1783441430.901889:0:5778:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a848f77050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6c1ddb50-5795-40c6-a2b6-8f58add9da62+19:3303:x1870073693253504:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1783441430.901961:0:5778:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a848f77050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6c1ddb50-5795-40c6-a2b6-8f58add9da62+19:3303:x1870073693253504:12345-0@lo:400:kworker.0 Request processed in 71us (420us total) trans 0 rc 0/0 00000100:00100000:0.0:1783441430.901969:0:5778:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 207 00000100:00100000:0.0:1783441430.902010:0:5785:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073693253760 00000100:00100000:0.0:1783441430.902015:0:5785:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073693253760 00000100:00100000:0.0:1783441430.902068:0:5785:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073693254016 00000100:00100000:0.0:1783441430.902072:0:5785:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073693254016 00000100:00100000:0.0:1783441430.902095:0:5785:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 66 00000100:00100000:0.0:1783441430.902102:0:5785:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a87d80df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3305:x1870073693253760:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1783441430.902141:0:5785:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a87d80df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3305:x1870073693253760:12345-0@lo:400:kworker.0 Request processed in 39us (5958us total) trans 0 rc 0/0 00000100:00100000:0.0:1783441430.902148:0:5785:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 66 00000100:00100000:0.0:1783441430.902159:0:5785:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 67 00000100:00100000:0.0:1783441430.902164:0:5785:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a87d6f0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3303:x1870073693254016:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1783441430.902190:0:5785:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a87d6f0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3303:x1870073693254016:12345-0@lo:400:kworker.0 Request processed in 25us (489us total) trans 0 rc 0/0 00000100:00100000:0.0:1783441430.902196:0:5785:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 67 00000100:00080000:0.0:1783441430.902214:0:5781:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1783441430.902272:0:3303:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff91a87d80f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:6c1ddb50-5795-40c6-a2b6-8f58add9da62:3303:1870073693253504:0@lo:400:kworker.0 00000100:00100000:0.0:1783441430.902975:0:3303:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff91a87d80d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3303:1870073693254016:0@lo:400:kworker.0 00000100:00100000:3.0:1783441430.907169:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783441430.908067:0:3305:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff91a87d80c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3305:1870073693253760:0@lo:400:kworker.0 00000100:00100000:2.0:1783441430.908778:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783441430.908830:0:3304:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff91a87d80ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3304:1870073693254144:0@lo:400:kworker.0 00000100:00100000:2.0:1783441430.908870:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783441430.908991:0:5785:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073693253632 00000100:00100000:3.0:1783441430.909000:0:5785:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073693253632 00000100:00100000:3.0:1783441430.909075:0:5785:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 68 00000100:00100000:3.0:1783441430.909086:0:5785:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a745907480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3304:x1870073693253632:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1783441430.909152:0:5785:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a745907480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3304:x1870073693253632:12345-0@lo:400:kworker.0 Request processed in 68us (377us total) trans 0 rc 0/0 00000100:00100000:3.0:1783441430.909159:0:5785:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 68 00000100:00100000:2.0:1783441430.912131:0:3304:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff91a87d80d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3304:1870073693253632:0@lo:400:kworker.0 00000100:00100000:0.0:1783441430.912274:0:6583:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073693253888 00000100:00100000:0.0:1783441430.912484:0:6583:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073693253888 00000100:00100000:1.0:1783441430.912644:0:6583:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073693254144 00000100:00100000:1.0:1783441430.912650:0:6583:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073693254144 00000100:00100000:1.0:1783441430.912685:0:6583:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:1.0:1783441430.912770:0:6583:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a87d80c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3305:x1870073693253888:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1783441430.912882:0:6583:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a87d80c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3305:x1870073693253888:12345-0@lo:400:kworker.0 Request processed in 186us (5724us total) trans 0 rc 0/0 00000100:00100000:1.0:1783441430.912891:0:6583:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00000100:00100000:1.0:1783441430.912910:0:6583:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:1.0:1783441430.912918:0:6583:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a745907800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3304:x1870073693254144:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1783441430.912956:0:6583:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a745907800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3304:x1870073693254144:12345-0@lo:400:kworker.0 Request processed in 40us (4085us total) trans 0 rc 0/0 00000100:00100000:1.0:1783441430.912963:0:6583:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00010000:00080000:1.0:1783441430.913005:0:3305:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff91a87d80c380 x1870073693253888/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1783441446 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1783441430.913019:0:3305:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff91a87d80c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3305:1870073693253888:0@lo:400:kworker.0 00000100:00080000:0.0:1783441430.913113:0:5781:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1783441430.913119:0:5781:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:2.0:1783441430.913223:0:3304:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff91a87d80ea00 x1870073693254144/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1783441446 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1783441430.913234:0:3304:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff91a87d80ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3304:1870073693254144:0@lo:400:kworker.0 00000100:00100000:1.0:1783441431.407826:0:3305:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff91a87d6f2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3305:1870073693254272:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1783441431.407936:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783441431.408348:0:6585:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073693254272 00000100:00100000:0.0:1783441431.408367:0:6585:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073693254272 00000100:00100000:0.0:1783441431.408430:0:6585:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:0.0:1783441431.408442:0:6585:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a87d4ded80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3305:x1870073693254272:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1783441431.408481:0:6585:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1783441431.408551:0:6585:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a87d4ded80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3305:x1870073693254272:12345-0@lo:13:osp-pre-1-0.0 Request processed in 111us (615us total) trans 0 rc 0/0 00000100:00100000:0.0:1783441431.408558:0:6585:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00010000:00080000:1.0:1783441431.408872:0:3305:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff91a87d6f2300 x1870073693254272/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1783441447 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1783441431.408895:0:3305:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff91a87d6f2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3305:1870073693254272:0@lo:13:osp-pre-1-0.0 00000001:02000400:1.0:1783441431.547368:0:9968:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: === sanity-pcc: start setup 12:23:50 (1783441430) === 00010000:00010000:3.0:1783441431.665096:0:5772:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1783441432.241620:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.13@tcp (source: 12345-192.168.201.13@tcp) 00000100:00100000:3.0:1783441432.243480:0:5779:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073673295104 00000100:00100000:3.0:1783441432.243501:0:5779:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073673295104 00000100:00100000:3.0:1783441432.243580:0:5779:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.13@tcp, seq: 208 00000100:00100000:3.0:1783441432.243590:0:5779:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a848f74050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:51c2a82e-e792-4f56-84e8-12cc033e9e70+10:8095:x1870073673295104:12345-192.168.201.13@tcp:101:mount.lustre.0 00010000:00010000:3.0:1783441432.243607:0:5779:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1783441432.243639:0:5779:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff91a85eb3c600/0xa2426164df2c7807 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: local remote: 0x633a354aa4df4cb0 expref: -99 pid: 5779 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783441432.243674:0:5779:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff91a85eb3c600/0xa2426164df2c7807 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000000 nid: 192.168.201.13@tcp remote: 0x633a354aa4df4cb0 expref: 11 pid: 5779 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783441432.243685:0:5779:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff91a85eb3c600/0xa2426164df2c7807 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 192.168.201.13@tcp remote: 0x633a354aa4df4cb0 expref: 11 pid: 5779 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783441432.243695:0:5779:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91a85eb3c600, rc 0) 00000100:00100000:3.0:1783441432.243796:0:5779:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a848f74050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:51c2a82e-e792-4f56-84e8-12cc033e9e70+11:8095:x1870073673295104:12345-192.168.201.13@tcp:101:mount.lustre.0 Request processed in 207us (2192us total) trans 0 rc 0/0 00000100:00100000:3.0:1783441432.243803:0:5779:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.13@tcp, seq: 208 00000100:00100000:1.0:1783441432.250197:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.13@tcp (source: 12345-192.168.201.13@tcp) 00000100:00100000:0.0:1783441432.251467:0:5780:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073673295232 00000100:00100000:0.0:1783441432.251483:0:5780:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073673295232 00000100:00100000:0.0:1783441432.251564:0:5780:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.13@tcp, seq: 209 00000100:00100000:0.0:1783441432.251574:0:5780:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a848f74450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:51c2a82e-e792-4f56-84e8-12cc033e9e70+11:8095:x1870073673295232:12345-192.168.201.13@tcp:501:mount.lustre.0 00000100:00100000:0.0:1783441432.253472:0:5780:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a848f74450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:51c2a82e-e792-4f56-84e8-12cc033e9e70+11:8095:x1870073673295232:12345-192.168.201.13@tcp:501:mount.lustre.0 Request processed in 1883us (3270us total) trans 0 rc 0/0 00000100:00100000:0.0:1783441432.253487:0:5780:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.13@tcp, seq: 209 00000100:00100000:1.0:1783441432.261978:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.13@tcp (source: 12345-192.168.201.13@tcp) 00000100:00100000:0.0:1783441432.262077:0:5778:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073673295360 00000100:00100000:0.0:1783441432.262087:0:5778:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073673295360 00000100:00100000:0.0:1783441432.262147:0:5778:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.13@tcp, seq: 210 00000100:00100000:0.0:1783441432.262157:0:5778:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a848f77450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:51c2a82e-e792-4f56-84e8-12cc033e9e70+11:8095:x1870073673295360:12345-192.168.201.13@tcp:503:mount.lustre.0 00000100:00100000:0.0:1783441432.262560:0:5778:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a848f77450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:51c2a82e-e792-4f56-84e8-12cc033e9e70+11:8095:x1870073673295360:12345-192.168.201.13@tcp:503:mount.lustre.0 Request processed in 403us (726us total) trans 0 rc 0/0 00000100:00100000:0.0:1783441432.262576:0:5778:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.13@tcp, seq: 210 00000100:00100000:1.0:1783441432.265671:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.13@tcp (source: 12345-192.168.201.13@tcp) 00000100:00100000:0.0:1783441432.265771:0:5780:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073673295488 00000100:00100000:0.0:1783441432.265782:0:5780:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073673295488 00000100:00100000:0.0:1783441432.265854:0:5780:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.13@tcp, seq: 211 00000100:00100000:0.0:1783441432.265866:0:5780:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a848f75c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:51c2a82e-e792-4f56-84e8-12cc033e9e70+11:8099:x1870073673295488:12345-192.168.201.13@tcp:502:llog_process_th.0 00000100:00100000:0.0:1783441432.266193:0:5780:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a848f75c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:51c2a82e-e792-4f56-84e8-12cc033e9e70+11:8099:x1870073673295488:12345-192.168.201.13@tcp:502:llog_process_th.0 Request processed in 328us (533us total) trans 0 rc 0/0 00000100:00100000:0.0:1783441432.266201:0:5780:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.13@tcp, seq: 211 00000100:00100000:1.0:1783441432.303475:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.13@tcp (source: 12345-192.168.201.13@tcp) 00000100:00100000:0.0:1783441432.303708:0:5778:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073673295616 00000100:00100000:0.0:1783441432.303720:0:5778:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073673295616 00000100:00100000:0.0:1783441432.303813:0:5778:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.13@tcp, seq: 212 00000100:00100000:0.0:1783441432.303824:0:5778:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a848f71850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:51c2a82e-e792-4f56-84e8-12cc033e9e70+11:8099:x1870073673295616:12345-192.168.201.13@tcp:502:llog_process_th.0 00000100:00100000:0.0:1783441432.304144:0:5778:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a848f71850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:51c2a82e-e792-4f56-84e8-12cc033e9e70+11:8099:x1870073673295616:12345-192.168.201.13@tcp:502:llog_process_th.0 Request processed in 321us (679us total) trans 0 rc 0/0 00000100:00100000:0.0:1783441432.304151:0:5778:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.13@tcp, seq: 212 00000100:00100000:1.0:1783441432.307770:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.13@tcp (source: 12345-192.168.201.13@tcp) 00000100:00100000:3.0:1783441432.308187:0:5779:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073673295744 00000100:00100000:3.0:1783441432.308198:0:5779:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073673295744 00000100:00100000:3.0:1783441432.308262:0:5779:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.13@tcp, seq: 213 00000100:00100000:3.0:1783441432.308278:0:5779:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a848f73050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:51c2a82e-e792-4f56-84e8-12cc033e9e70+11:8095:x1870073673295744:12345-192.168.201.13@tcp:101:mount.lustre.0 00010000:00010000:3.0:1783441432.308295:0:5779:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1783441432.308324:0:5779:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff91a85eb3dc00/0xa2426164df2c780e lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x633a354aa4df4cda expref: -99 pid: 5779 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783441432.308369:0:5779:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff91a85eb3dc00/0xa2426164df2c780e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 192.168.201.13@tcp remote: 0x633a354aa4df4cda expref: 12 pid: 5779 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783441432.308382:0:5779:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff91a85eb3dc00/0xa2426164df2c780e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 192.168.201.13@tcp remote: 0x633a354aa4df4cda expref: 12 pid: 5779 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783441432.308392:0:5779:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91a85eb3dc00, rc 0) 00000100:00100000:3.0:1783441432.308455:0:5779:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a848f73050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:51c2a82e-e792-4f56-84e8-12cc033e9e70+12:8095:x1870073673295744:12345-192.168.201.13@tcp:101:mount.lustre.0 Request processed in 184us (724us total) trans 0 rc 0/0 00000100:00100000:3.0:1783441432.308476:0:5779:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.13@tcp, seq: 213 00000100:00100000:3.0:1783441432.313920:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.13@tcp (source: 12345-192.168.201.13@tcp) 00000100:00100000:1.0:1783441432.314145:0:5780:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073673295872 00000100:00100000:1.0:1783441432.314156:0:5780:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073673295872 00000100:00100000:1.0:1783441432.314210:0:5780:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.13@tcp, seq: 214 00000100:00100000:1.0:1783441432.314220:0:5780:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a848f70050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:51c2a82e-e792-4f56-84e8-12cc033e9e70+12:8095:x1870073673295872:12345-192.168.201.13@tcp:256:mount.lustre.0 20000000:01000000:1.0:1783441432.314249:0:5780:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-cliir bufsize 1048576. 20000000:01000000:1.0:1783441432.314291:0:5780:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/256/255. 20000000:01000000:1.0:1783441432.314296:0:5780:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4008/1/256/255. 20000000:01000000:1.0:1783441432.314300:0:5780:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3964/1/256/255. 20000000:01000000:1.0:1783441432.314303:0:5780:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 132, version 5 00000100:00100000:0.0:1783441432.321903:0:5780:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a848f70050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:51c2a82e-e792-4f56-84e8-12cc033e9e70+12:8095:x1870073673295872:12345-192.168.201.13@tcp:256:mount.lustre.0 Request processed in 7671us (7981us total) trans 0 rc 0/0 00000100:00100000:0.0:1783441432.321918:0:5780:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.13@tcp, seq: 214 00000100:00100000:2.0:1783441432.334171:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.13@tcp (source: 12345-192.168.201.13@tcp) 00000100:00100000:0.0:1783441432.334223:0:5778:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073673296000 00000100:00100000:0.0:1783441432.334234:0:5778:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073673296000 00000100:00100000:0.0:1783441432.334292:0:5778:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.13@tcp, seq: 215 00000100:00100000:0.0:1783441432.334302:0:5778:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a848f70450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:51c2a82e-e792-4f56-84e8-12cc033e9e70+12:8095:x1870073673296000:12345-192.168.201.13@tcp:101:mount.lustre.0 00010000:00010000:0.0:1783441432.334511:0:5778:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1783441432.334531:0:5778:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff91a85fe59a00/0xa2426164df2c7815 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0x633a354aa4df4ce1 expref: -99 pid: 5778 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783441432.334576:0:5778:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff91a85fe59a00/0xa2426164df2c7815 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 192.168.201.13@tcp remote: 0x633a354aa4df4ce1 expref: 13 pid: 5778 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783441432.334587:0:5778:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff91a85fe59a00/0xa2426164df2c7815 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 192.168.201.13@tcp remote: 0x633a354aa4df4ce1 expref: 13 pid: 5778 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783441432.334596:0:5778:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91a85fe59a00, rc 0) 00000100:00100000:0.0:1783441432.334662:0:5778:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a848f70450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:51c2a82e-e792-4f56-84e8-12cc033e9e70+13:8095:x1870073673296000:12345-192.168.201.13@tcp:101:mount.lustre.0 Request processed in 362us (501us total) trans 0 rc 0/0 00000100:00100000:0.0:1783441432.334670:0:5778:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.13@tcp, seq: 215 00000100:00100000:3.0:1783441432.340558:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.13@tcp (source: 12345-192.168.201.13@tcp) 00000100:00100000:0.0:1783441432.340769:0:5780:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073673296128 00000100:00100000:0.0:1783441432.340780:0:5780:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073673296128 00000100:00100000:0.0:1783441432.340847:0:5780:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.13@tcp, seq: 216 00000100:00100000:0.0:1783441432.340866:0:5780:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a848f73450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:51c2a82e-e792-4f56-84e8-12cc033e9e70+13:8095:x1870073673296128:12345-192.168.201.13@tcp:501:mount.lustre.0 00000100:00100000:0.0:1783441432.341173:0:5780:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a848f73450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:51c2a82e-e792-4f56-84e8-12cc033e9e70+13:8095:x1870073673296128:12345-192.168.201.13@tcp:501:mount.lustre.0 Request processed in 316us (624us total) trans 0 rc 0/0 00000100:00100000:0.0:1783441432.341181:0:5780:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.13@tcp, seq: 216 00000100:00100000:1.0:1783441432.347230:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.13@tcp (source: 12345-192.168.201.13@tcp) 00000100:00100000:3.0:1783441432.347314:0:5779:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073673296256 00000100:00100000:3.0:1783441432.347325:0:5779:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073673296256 00000100:00100000:3.0:1783441432.347399:0:5779:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.13@tcp, seq: 217 00000100:00100000:3.0:1783441432.347410:0:5779:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a848f71c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:51c2a82e-e792-4f56-84e8-12cc033e9e70+13:8095:x1870073673296256:12345-192.168.201.13@tcp:503:mount.lustre.0 00000100:00100000:3.0:1783441432.347712:0:5779:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a848f71c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:51c2a82e-e792-4f56-84e8-12cc033e9e70+13:8095:x1870073673296256:12345-192.168.201.13@tcp:503:mount.lustre.0 Request processed in 302us (491us total) trans 0 rc 0/0 00000100:00100000:3.0:1783441432.347720:0:5779:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.13@tcp, seq: 217 00000100:00100000:1.0:1783441432.357157:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.13@tcp (source: 12345-192.168.201.13@tcp) 00000100:00100000:2.0:1783441432.357260:0:5778:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073673296384 00000100:00100000:2.0:1783441432.357277:0:5778:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073673296384 00000100:00100000:2.0:1783441432.357335:0:5778:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.13@tcp, seq: 218 00000100:00100000:2.0:1783441432.357355:0:5778:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a848f71050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:51c2a82e-e792-4f56-84e8-12cc033e9e70+13:8104:x1870073673296384:12345-192.168.201.13@tcp:502:llog_process_th.0 00000100:00100000:2.0:1783441432.357618:0:5778:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a848f71050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:51c2a82e-e792-4f56-84e8-12cc033e9e70+13:8104:x1870073673296384:12345-192.168.201.13@tcp:502:llog_process_th.0 Request processed in 274us (472us total) trans 0 rc 0/0 00000100:00100000:2.0:1783441432.357625:0:5778:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.13@tcp, seq: 218 00000100:00100000:1.0:1783441432.369416:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.13@tcp (source: 12345-192.168.201.13@tcp) 00000100:00100000:0.0:1783441432.369542:0:5780:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073673296512 00000100:00100000:0.0:1783441432.369554:0:5780:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073673296512 00000100:00100000:0.0:1783441432.369619:0:5780:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.13@tcp, seq: 219 00000100:00100000:0.0:1783441432.369628:0:5780:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a848f70c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:51c2a82e-e792-4f56-84e8-12cc033e9e70+13:8104:x1870073673296512:12345-192.168.201.13@tcp:502:llog_process_th.0 00000100:00100000:0.0:1783441432.369932:0:5780:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a848f70c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:51c2a82e-e792-4f56-84e8-12cc033e9e70+13:8104:x1870073673296512:12345-192.168.201.13@tcp:502:llog_process_th.0 Request processed in 303us (525us total) trans 0 rc 0/0 00000100:00100000:0.0:1783441432.369941:0:5780:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.13@tcp, seq: 219 00000100:00100000:1.0:1783441432.377122:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.13@tcp (source: 12345-192.168.201.13@tcp) 00000100:00100000:1.0:1783441432.377171:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.13@tcp (source: 12345-192.168.201.13@tcp) 00000100:00100000:3.0:1783441432.377347:0:5787:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073673297024 00000100:00100000:3.0:1783441432.377357:0:5787:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073673297024 00000100:00100000:3.0:1783441432.377438:0:5787:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073673296640 00000100:00100000:3.0:1783441432.377442:0:5787:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073673296640 00000100:00100000:3.0:1783441432.377468:0:5787:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.13@tcp, seq: 69 00000100:00100000:3.0:1783441432.377479:0:5787:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a87d4dca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:65454767-383a-4679-a788-eba05c6e0989+6:2352:x1870073673297024:12345-192.168.201.13@tcp:400:kworker.0 00000100:00100000:3.0:1783441432.377562:0:5787:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a87d4dca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:65454767-383a-4679-a788-eba05c6e0989+6:2352:x1870073673297024:12345-192.168.201.13@tcp:400:kworker.0 Request processed in 86us (451us total) trans 0 rc 0/0 00000100:00100000:3.0:1783441432.377570:0:5787:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.13@tcp, seq: 69 00000100:00100000:3.0:1783441432.377589:0:5787:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.13@tcp, seq: 10 00000100:00100000:3.0:1783441432.377594:0:5787:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a87d4dea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:2351:x1870073673296640:12345-192.168.201.13@tcp:38:mount.lustre.0 00010000:00080000:3.0:1783441432.377622:0:5787:0:(ldlm_lib.c:1432:target_handle_connect()) lustre-MDT0000: connection from d5aa2a25-c618-49e9-a833-85b3b4747e53@192.168.201.13@tcp t0 exp 0000000000000000 cur 270 last 0 00000020:00000080:3.0:1783441432.377667:0:5787:0:(genops.c:1406:class_connect()) connect: client d5aa2a25-c618-49e9-a833-85b3b4747e53, cookie 0xa2426164df2c781c 00000004:00100000:3.0:1783441432.377701:0:5787:0:(mdt_handler.c:7282:mdt_connect_internal()) lustre-MDT0000: cli supports cksum type f7, return f7 00000100:00080000:3.0:1783441432.378028:0:5787:0:(import.c:65:import_set_state_nolock()) ffff91a8655b2800 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1783441432.378065:0:5787:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a87d4dea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d5aa2a25-c618-49e9-a833-85b3b4747e53+6:2351:x1870073673296640:12345-192.168.201.13@tcp:38:mount.lustre.0 Request processed in 468us (893us total) trans 0 rc 0/0 00000100:00100000:3.0:1783441432.378073:0:5787:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.13@tcp, seq: 10 00000100:00080000:2.0:1783441432.378291:0:5781:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1783441432.390563:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.13@tcp (source: 12345-192.168.201.13@tcp) 00000100:00100000:1.0:1783441432.390615:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.13@tcp (source: 12345-192.168.201.13@tcp) 00000100:00100000:2.0:1783441432.390727:0:5786:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073673296896 00000100:00100000:2.0:1783441432.390737:0:5786:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073673296896 00000100:00080000:0.0:1783441432.390813:0:5781:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1783441432.390839:0:5786:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073673296768 00000100:00100000:2.0:1783441432.390842:0:5786:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073673296768 00000100:00100000:2.0:1783441432.390871:0:5786:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.13@tcp, seq: 11 00000100:00100000:2.0:1783441432.390880:0:5786:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a87d4ddf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d5aa2a25-c618-49e9-a833-85b3b4747e53+7:8095:x1870073673296896:12345-192.168.201.13@tcp:41:mount.lustre.0 00000004:00000024:2.0:1783441432.390928:0:5786:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 6815744 pending 0 free 2261647360 avail 2259550208 00000100:00100000:0.0:1783441432.390933:0:6605:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.13@tcp, seq: 12 00000100:00100000:0.0:1783441432.390943:0:6605:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a87d4dc700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:d5aa2a25-c618-49e9-a833-85b3b4747e53+7:0:x1870073673296768:12345-192.168.201.13@tcp:41:mount.lustre.0 00000004:00000024:0.0:1783441432.390967:0:6605:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 6815744 pending 0 free 2261647360 avail 2259550208 00000100:00100000:0.0:1783441432.391158:0:6605:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a87d4dc700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:d5aa2a25-c618-49e9-a833-85b3b4747e53+7:0:x1870073673296768:12345-192.168.201.13@tcp:41:mount.lustre.0 Request processed in 216us (540us total) trans 0 rc 0/0 00000100:00100000:0.0:1783441432.391166:0:6605:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.13@tcp, seq: 12 00000100:00100000:2.0:1783441432.392440:0:5786:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a87d4ddf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d5aa2a25-c618-49e9-a833-85b3b4747e53+6:8095:x1870073673296896:12345-192.168.201.13@tcp:41:mount.lustre.0 Request processed in 1553us (1884us total) trans 0 rc 0/0 00000100:00100000:2.0:1783441432.392453:0:5786:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.13@tcp, seq: 11 00000100:00100000:3.0:1783441432.395953:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.13@tcp (source: 12345-192.168.201.13@tcp) 00000100:00100000:0.0:1783441432.396250:0:5787:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073673297152 00000100:00100000:0.0:1783441432.396260:0:5787:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073673297152 00000100:00100000:0.0:1783441432.396694:0:5787:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.13@tcp, seq: 13 00000100:00100000:0.0:1783441432.396704:0:5787:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a87d80c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d5aa2a25-c618-49e9-a833-85b3b4747e53+6:8095:x1870073673297152:12345-192.168.201.13@tcp:40:mount.lustre.0 00000100:00100000:0.0:1783441432.396829:0:5787:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a87d80c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d5aa2a25-c618-49e9-a833-85b3b4747e53+6:8095:x1870073673297152:12345-192.168.201.13@tcp:40:mount.lustre.0 Request processed in 125us (885us total) trans 0 rc 0/0 00000100:00100000:0.0:1783441432.396837:0:5787:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.13@tcp, seq: 13 00000100:00100000:1.0:1783441432.406141:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.13@tcp (source: 12345-192.168.201.13@tcp) 00000100:00100000:1.0:1783441432.406251:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.13@tcp (source: 12345-192.168.201.13@tcp) 00000100:00100000:1.0:1783441432.406289:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.13@tcp (source: 12345-192.168.201.13@tcp) 00000100:00100000:3.0:1783441432.406424:0:6581:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073673297280 00000100:00100000:3.0:1783441432.406436:0:6581:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073673297280 00000100:00100000:3.0:1783441432.406494:0:6581:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073673297408 00000100:00100000:3.0:1783441432.406498:0:6581:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073673297408 00000100:00100000:3.0:1783441432.406522:0:6581:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.13@tcp, seq: 13 00000100:00100000:3.0:1783441432.406531:0:6581:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a87d4df100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:2351:x1870073673297280:12345-192.168.201.13@tcp:8:mount.lustre.0 00010000:00080000:3.0:1783441432.406578:0:6581:0:(ldlm_lib.c:1432:target_handle_connect()) lustre-OST0000: connection from d5aa2a25-c618-49e9-a833-85b3b4747e53@192.168.201.13@tcp t0 exp 0000000000000000 cur 270 last 0 00000020:00000080:3.0:1783441432.406619:0:6581:0:(genops.c:1406:class_connect()) connect: client d5aa2a25-c618-49e9-a833-85b3b4747e53, cookie 0xa2426164df2c7823 00002000:00100000:3.0:1783441432.406630:0:6581:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli d5aa2a25-c618-49e9-a833-85b3b4747e53/ffff91a8655b7800 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113669 ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:3.0:1783441432.406654:0:6581:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0000: cli supports cksum type f7, return f7 00002000:00080000:3.0:1783441432.406953:0:6581:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:3.0:1783441432.406996:0:6581:0:(import.c:65:import_set_state_nolock()) ffff91a8655b4800 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1783441432.407062:0:6581:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a87d4df100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:d5aa2a25-c618-49e9-a833-85b3b4747e53+6:2351:x1870073673297280:12345-192.168.201.13@tcp:8:mount.lustre.0 Request processed in 531us (810us total) trans 0 rc 0/0 00000100:00100000:3.0:1783441432.407070:0:6581:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.13@tcp, seq: 13 00000100:00100000:3.0:1783441432.407090:0:6581:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.13@tcp, seq: 14 00000100:00100000:3.0:1783441432.407096:0:6581:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a87d4dce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:2351:x1870073673297408:12345-192.168.201.13@tcp:8:mount.lustre.0 00010000:00080000:3.0:1783441432.407113:0:6581:0:(ldlm_lib.c:1432:target_handle_connect()) lustre-OST0001: connection from d5aa2a25-c618-49e9-a833-85b3b4747e53@192.168.201.13@tcp t0 exp 0000000000000000 cur 270 last 0 00000020:00000080:3.0:1783441432.407129:0:6581:0:(genops.c:1406:class_connect()) connect: client d5aa2a25-c618-49e9-a833-85b3b4747e53, cookie 0xa2426164df2c782a 00002000:00100000:3.0:1783441432.407135:0:6581:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli d5aa2a25-c618-49e9-a833-85b3b4747e53/ffff91a8655b5800 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113669 ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:3.0:1783441432.407156:0:6581:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0001: cli supports cksum type f7, return f7 00002000:00080000:3.0:1783441432.407282:0:6581:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:3.0:1783441432.407297:0:6581:0:(import.c:65:import_set_state_nolock()) ffff91a8655b0800 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1783441432.407320:0:6581:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a87d4dce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:d5aa2a25-c618-49e9-a833-85b3b4747e53+6:2351:x1870073673297408:12345-192.168.201.13@tcp:8:mount.lustre.0 Request processed in 223us (1030us total) trans 0 rc 0/0 00000100:00100000:3.0:1783441432.407327:0:6581:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.13@tcp, seq: 14 00000100:00100000:2.0:1783441432.411040:0:5788:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073673297536 00000100:00100000:2.0:1783441432.411062:0:5788:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073673297536 00000100:00100000:2.0:1783441432.411350:0:5788:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.13@tcp, seq: 1 00000100:00100000:2.0:1783441432.411362:0:5788:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a87d4ddc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:d5aa2a25-c618-49e9-a833-85b3b4747e53+6:8095:x1870073673297536:12345-192.168.201.13@tcp:33:mount.lustre.0 00000004:00200000:2.0:1783441432.411628:0:5788:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 6656 00000100:00100000:2.0:1783441432.413759:0:5788:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a87d4ddc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:d5aa2a25-c618-49e9-a833-85b3b4747e53+6:8095:x1870073673297536:12345-192.168.201.13@tcp:33:mount.lustre.0 Request processed in 2378us (7608us total) trans 0 rc 0/0 00000100:00100000:2.0:1783441432.413771:0:5788:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.13@tcp, seq: 1 00000100:00100000:1.0:1783441432.429182:0:3305:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1783441432.429206:0:3305:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff91a87d80dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3305:1870073693254400:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1783441432.429280:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783441432.429418:0:6585:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073693254400 00000100:00100000:0.0:1783441432.429427:0:6585:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073693254400 00000100:00100000:0.0:1783441432.429522:0:6585:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:0.0:1783441432.429533:0:6585:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a87d4de300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3305:x1870073693254400:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1783441432.429565:0:6585:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1783441432.429610:0:6585:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a87d4de300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3305:x1870073693254400:12345-0@lo:13:osp-pre-0-0.0 Request processed in 79us (331us total) trans 0 rc 0/0 00000100:00100000:0.0:1783441432.429617:0:6585:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00010000:00080000:0.0:1783441432.429658:0:3305:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff91a87d80dc00 x1870073693254400/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1783441448 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1783441432.429685:0:3305:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff91a87d80dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3305:1870073693254400:0@lo:13:osp-pre-0-0.0 00000100:00080000:1.0:1783441432.431175:0:5781:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000001:00100000:3.0:1783441432.463465:0:5807:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of d5aa2a25-c618-49e9-a833-85b3b4747e53 00010000:00010000:3.0:1783441432.685101:0:5773:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:1.0:1783441433.018271:0:7492:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of d5aa2a25-c618-49e9-a833-85b3b4747e53 00010000:00010000:3.0:1783441433.711654:0:5772:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:2.0:1783441434.099530:0:6613:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of d5aa2a25-c618-49e9-a833-85b3b4747e53 00010000:00010000:3.0:1783441434.734407:0:5773:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783441435.757316:0:5772:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1783441436.014140:0:3305:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff91a87d80fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3305:1870073693254784:0@lo:400:kworker.0 00000100:00100000:0.0:1783441436.014231:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783441436.014309:0:3305:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1783441436.014316:0:3305:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff91a87d80dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3305:1870073693254912:0@lo:400:kworker.0 00000100:00100000:0.0:1783441436.014345:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783441436.014398:0:6581:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073693254912 00000100:00100000:0.0:1783441436.014408:0:6581:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073693254912 00000100:00100000:0.0:1783441436.014470:0:6581:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 39 00000100:00100000:0.0:1783441436.014480:0:6581:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a87d6f1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3305:x1870073693254912:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1783441436.014532:0:6581:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a87d6f1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3305:x1870073693254912:12345-0@lo:400:kworker.0 Request processed in 53us (186us total) trans 0 rc 0/0 00000100:00100000:0.0:1783441436.014540:0:6581:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 39 00000100:00080000:0.0:1783441436.014562:0:5781:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:0.0:1783441436.014595:0:3305:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff91a87d80dc00 x1870073693254912/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1783441452 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1783441436.014609:0:3305:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff91a87d80dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3305:1870073693254912:0@lo:400:kworker.0 00000100:00100000:2.0:1783441436.014705:0:3303:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff91a87d80ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:6c1ddb50-5795-40c6-a2b6-8f58add9da62:3303:1870073693254528:0@lo:400:kworker.0 00000100:00100000:2.0:1783441436.014769:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783441436.014807:0:3303:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff91a87d80ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3303:1870073693255040:0@lo:400:kworker.0 00000100:00100000:2.0:1783441436.014832:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783441436.014849:0:3303:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:2.0:1783441436.014855:0:3303:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff91a87d80f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3303:1870073693254656:0@lo:400:kworker.0 00000100:00100000:2.0:1783441436.014877:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783441436.014896:0:3303:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff91a87d80c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3303:1870073693255168:0@lo:400:kworker.0 00000100:00100000:2.0:1783441436.014920:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783441436.014952:0:5786:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073693254784 00000100:00100000:2.0:1783441436.014956:0:5786:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073693254784 00000100:00100000:2.0:1783441436.014988:0:5786:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073693255040 00000100:00100000:2.0:1783441436.014992:0:5786:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073693255040 00000100:00100000:2.0:1783441436.015006:0:5786:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073693254656 00000100:00100000:2.0:1783441436.015008:0:5786:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073693254656 00000100:00100000:2.0:1783441436.015151:0:5786:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 70 00000100:00100000:2.0:1783441436.015162:0:5786:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a87d6f3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3305:x1870073693254784:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1783441436.015206:0:5786:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a87d6f3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3305:x1870073693254784:12345-0@lo:400:kworker.0 Request processed in 46us (975us total) trans 0 rc 0/0 00000100:00100000:2.0:1783441436.015212:0:5786:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 70 00000100:00100000:2.0:1783441436.015228:0:5786:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 71 00000100:00100000:2.0:1783441436.015233:0:5786:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a745905f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3303:x1870073693255040:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1783441436.015264:0:5786:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a745905f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3303:x1870073693255040:12345-0@lo:400:kworker.0 Request processed in 31us (432us total) trans 0 rc 0/0 00000100:00100000:2.0:1783441436.015271:0:5786:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 71 00000100:00100000:2.0:1783441436.015296:0:5786:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 72 00000100:00100000:2.0:1783441436.015303:0:5786:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a875691c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3303:x1870073693254656:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1783441436.015338:0:5786:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a875691c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3303:x1870073693254656:12345-0@lo:400:kworker.0 Request processed in 36us (461us total) trans 0 rc 0/0 00000100:00100000:2.0:1783441436.015343:0:5786:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 72 00000100:00100000:2.0:1783441436.015364:0:8557:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073693255168 00000100:00100000:2.0:1783441436.015367:0:8557:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073693255168 00000100:00100000:2.0:1783441436.015393:0:8557:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:2.0:1783441436.015400:0:8557:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a867fb4850 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3303:x1870073693255168:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1783441436.015426:0:8557:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a867fb4850 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3303:x1870073693255168:12345-0@lo:400:kworker.0 Request processed in 28us (506us total) trans 0 rc 0/0 00000100:00100000:2.0:1783441436.015433:0:8557:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00000100:00080000:2.0:1783441436.015591:0:5781:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1783441436.015595:0:5781:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1783441436.015614:0:3303:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff91a87d80f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3303:1870073693254656:0@lo:400:kworker.0 00010000:00080000:2.0:1783441436.015625:0:3303:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff91a87d80c380 x1870073693255168/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1783441452 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1783441436.015636:0:3303:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff91a87d80c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3303:1870073693255168:0@lo:400:kworker.0 00000100:00100000:2.0:1783441436.015645:0:3303:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff91a87d80ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3303:1870073693255040:0@lo:400:kworker.0 00000100:00100000:2.0:1783441436.015671:0:3305:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff91a87d80fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3305:1870073693254784:0@lo:400:kworker.0 00000100:00100000:0.0:1783441436.015882:0:5779:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073693254528 00000100:00100000:0.0:1783441436.015887:0:5779:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073693254528 00000100:00100000:0.0:1783441436.015914:0:5779:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 220 00000100:00100000:0.0:1783441436.015921:0:5779:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a848f70850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6c1ddb50-5795-40c6-a2b6-8f58add9da62+19:3303:x1870073693254528:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1783441436.015966:0:5779:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a848f70850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6c1ddb50-5795-40c6-a2b6-8f58add9da62+19:3303:x1870073693254528:12345-0@lo:400:kworker.0 Request processed in 45us (1226us total) trans 0 rc 0/0 00000100:00100000:0.0:1783441436.015972:0:5779:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 220 00000100:00100000:3.0:1783441436.016105:0:3303:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff91a87d80ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:6c1ddb50-5795-40c6-a2b6-8f58add9da62:3303:1870073693254528:0@lo:400:kworker.0 00000100:00100000:3.0:1783441436.529180:0:3305:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff91a87d6f0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3305:1870073693255296:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1783441436.529267:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783441436.529673:0:6585:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073693255296 00000100:00100000:0.0:1783441436.529682:0:6585:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073693255296 00000100:00100000:0.0:1783441436.529729:0:6585:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:0.0:1783441436.529760:0:6585:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a87d80ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3305:x1870073693255296:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1783441436.529813:0:6585:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1783441436.529864:0:6585:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a87d80ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3305:x1870073693255296:12345-0@lo:13:osp-pre-1-0.0 Request processed in 127us (598us total) trans 0 rc 0/0 00000100:00100000:0.0:1783441436.529871:0:6585:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00010000:00080000:0.0:1783441436.529912:0:3305:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff91a87d6f0000 x1870073693255296/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1783441452 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1783441436.529930:0:3305:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff91a87d6f0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3305:1870073693255296:0@lo:13:osp-pre-1-0.0 00010000:00010000:2.0:1783441436.792896:0:5773:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1783441437.553445:0:3305:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1783441437.553482:0:3305:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff91a87d80d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3305:1870073693255424:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1783441437.553578:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783441437.553725:0:6585:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073693255424 00000100:00100000:2.0:1783441437.553735:0:6585:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073693255424 00000100:00100000:2.0:1783441437.553830:0:6585:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:2.0:1783441437.553841:0:6585:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a87d6f0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3305:x1870073693255424:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1783441437.553886:0:6585:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1783441437.553944:0:6585:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a87d6f0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3305:x1870073693255424:12345-0@lo:13:osp-pre-0-0.0 Request processed in 105us (366us total) trans 0 rc 0/0 00000100:00100000:2.0:1783441437.553971:0:6585:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00010000:00080000:3.0:1783441437.554479:0:3305:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff91a87d80d500 x1870073693255424/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1783441453 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1783441437.554505:0:3305:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff91a87d80d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3305:1870073693255424:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1783441437.560342:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.13@tcp (source: 12345-192.168.201.13@tcp) 00000100:00100000:0.0:1783441437.560627:0:5778:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073673297664 00000100:00100000:0.0:1783441437.560638:0:5778:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073673297664 00000100:00100000:0.0:1783441437.560852:0:5778:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.13@tcp, seq: 221 00000100:00100000:0.0:1783441437.560864:0:5778:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a848f72450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:51c2a82e-e792-4f56-84e8-12cc033e9e70+13:2354:x1870073673297664:12345-192.168.201.13@tcp:400:kworker.0 00000100:00100000:0.0:1783441437.560940:0:5778:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a848f72450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:51c2a82e-e792-4f56-84e8-12cc033e9e70+13:2354:x1870073673297664:12345-192.168.201.13@tcp:400:kworker.0 Request processed in 78us (608us total) trans 0 rc 0/0 00000100:00100000:0.0:1783441437.560948:0:5778:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.13@tcp, seq: 221 00000100:00100000:0.0:1783441437.565562:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.13@tcp (source: 12345-192.168.201.13@tcp) 00000100:00100000:0.0:1783441437.565606:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.13@tcp (source: 12345-192.168.201.13@tcp) 00000100:00100000:0.0:1783441437.565627:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.13@tcp (source: 12345-192.168.201.13@tcp) 00000100:00100000:0.0:1783441437.565647:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.13@tcp (source: 12345-192.168.201.13@tcp) 00000100:00100000:0.0:1783441437.565672:0:6581:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073673298048 00000100:00100000:0.0:1783441437.565680:0:6581:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073673298048 00000100:00100000:0.0:1783441437.565732:0:6581:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073673298176 00000100:00100000:0.0:1783441437.565735:0:6581:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073673298176 00000100:00100000:0.0:1783441437.565775:0:6581:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.13@tcp, seq: 41 00000100:00100000:0.0:1783441437.565798:0:6581:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a87d6f0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:d5aa2a25-c618-49e9-a833-85b3b4747e53+5:2355:x1870073673298048:12345-192.168.201.13@tcp:400:kworker.0 00000100:00100000:0.0:1783441437.565870:0:6581:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a87d6f0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:d5aa2a25-c618-49e9-a833-85b3b4747e53+5:2355:x1870073673298048:12345-192.168.201.13@tcp:400:kworker.0 Request processed in 75us (262us total) trans 0 rc 0/0 00000100:00100000:0.0:1783441437.565878:0:6581:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.13@tcp, seq: 41 00000100:00100000:0.0:1783441437.565893:0:6581:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.13@tcp, seq: 42 00000100:00100000:0.0:1783441437.565899:0:6581:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a87d6f2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:d5aa2a25-c618-49e9-a833-85b3b4747e53+5:2354:x1870073673298176:12345-192.168.201.13@tcp:400:kworker.0 00000100:00100000:0.0:1783441437.565922:0:6581:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a87d6f2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:d5aa2a25-c618-49e9-a833-85b3b4747e53+5:2354:x1870073673298176:12345-192.168.201.13@tcp:400:kworker.0 Request processed in 24us (274us total) trans 0 rc 0/0 00000100:00100000:0.0:1783441437.565928:0:6581:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.13@tcp, seq: 42 00000100:00080000:0.0:1783441437.565946:0:5781:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1783441437.565950:0:5781:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1783441437.566330:0:5787:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073673297792 00000100:00100000:0.0:1783441437.566334:0:5787:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073673297792 00000100:00100000:0.0:1783441437.566367:0:5787:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073673297920 00000100:00100000:0.0:1783441437.566371:0:5787:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073673297920 00000100:00100000:0.0:1783441437.566395:0:5787:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.13@tcp, seq: 73 00000100:00100000:0.0:1783441437.566401:0:5787:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a87d6f2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:65454767-383a-4679-a788-eba05c6e0989+6:2355:x1870073673297792:12345-192.168.201.13@tcp:400:kworker.0 00000100:00100000:0.0:1783441437.566549:0:5787:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a87d6f2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:65454767-383a-4679-a788-eba05c6e0989+6:2355:x1870073673297792:12345-192.168.201.13@tcp:400:kworker.0 Request processed in 147us (998us total) trans 0 rc 0/0 00000100:00100000:0.0:1783441437.566557:0:5787:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.13@tcp, seq: 73 00000100:00100000:0.0:1783441437.566570:0:5787:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.13@tcp, seq: 74 00000100:00100000:0.0:1783441437.566576:0:5787:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a87d6f1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d5aa2a25-c618-49e9-a833-85b3b4747e53+5:2354:x1870073673297920:12345-192.168.201.13@tcp:400:kworker.0 00000100:00100000:0.0:1783441437.566597:0:5787:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a87d6f1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d5aa2a25-c618-49e9-a833-85b3b4747e53+5:2354:x1870073673297920:12345-192.168.201.13@tcp:400:kworker.0 Request processed in 22us (969us total) trans 0 rc 0/0 00000100:00100000:0.0:1783441437.566603:0:5787:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.13@tcp, seq: 74 00000100:00080000:0.0:1783441437.566637:0:5781:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:3.0:1783441437.808391:0:5772:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783441438.829520:0:5773:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:0.0:1783441439.617033:0:10166:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg113-client.virtnet: executing check_config_client /mnt/lustre 00010000:00010000:3.0:1783441439.856167:0:5772:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783441440.876969:0:5773:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1783441441.146489:0:3305:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff91a87d80f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3305:1870073693255808:0@lo:400:kworker.0 00000100:00100000:0.0:1783441441.146598:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783441441.146721:0:5787:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073693255808 00000100:00100000:1.0:1783441441.146732:0:5787:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073693255808 00000100:00100000:1.0:1783441441.146859:0:5787:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 75 00000100:00100000:1.0:1783441441.146869:0:5787:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a87d6f1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3305:x1870073693255808:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1783441441.146979:0:3304:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff91a87d80d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3304:1870073693255680:0@lo:400:kworker.0 00000100:00100000:2.0:1783441441.147016:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783441441.147042:0:3304:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1783441441.147048:0:3304:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff91a87d80d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:6c1ddb50-5795-40c6-a2b6-8f58add9da62:3304:1870073693255552:0@lo:400:kworker.0 00000100:00100000:2.0:1783441441.147080:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783441441.147111:0:6605:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073693255680 00000100:00100000:2.0:1783441441.147116:0:6605:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073693255680 00000100:00100000:2.0:1783441441.147159:0:6605:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 76 00000100:00100000:2.0:1783441441.147166:0:6605:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a875690380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3304:x1870073693255680:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1783441441.147215:0:6605:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a875690380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3304:x1870073693255680:12345-0@lo:400:kworker.0 Request processed in 49us (197us total) trans 0 rc 0/0 00000100:00100000:2.0:1783441441.147223:0:6605:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 76 00000100:00100000:2.0:1783441441.147255:0:5780:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073693255552 00000100:00100000:2.0:1783441441.147259:0:5780:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073693255552 00000100:00100000:2.0:1783441441.147288:0:5780:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 222 00000100:00100000:2.0:1783441441.147295:0:5780:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a848f72c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6c1ddb50-5795-40c6-a2b6-8f58add9da62+19:3304:x1870073693255552:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1783441441.147327:0:5780:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a848f72c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6c1ddb50-5795-40c6-a2b6-8f58add9da62+19:3304:x1870073693255552:12345-0@lo:400:kworker.0 Request processed in 32us (246us total) trans 0 rc 0/0 00000100:00100000:2.0:1783441441.147333:0:5780:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 222 00000100:00100000:2.0:1783441441.147388:0:3304:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff91a87d80d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:6c1ddb50-5795-40c6-a2b6-8f58add9da62:3304:1870073693255552:0@lo:400:kworker.0 00000100:00100000:2.0:1783441441.147402:0:3304:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff91a87d80d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3304:1870073693255680:0@lo:400:kworker.0 00000100:00100000:2.0:1783441441.148706:0:3306:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff91a87d80d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3306:1870073693255936:0@lo:400:kworker.0 00000100:00100000:2.0:1783441441.148830:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783441441.148908:0:6581:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073693255936 00000100:00100000:2.0:1783441441.148917:0:6581:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073693255936 00000100:00100000:2.0:1783441441.148986:0:6581:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 43 00000100:00100000:2.0:1783441441.148998:0:6581:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a875692a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3306:x1870073693255936:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1783441441.149054:0:6581:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a875692a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3306:x1870073693255936:12345-0@lo:400:kworker.0 Request processed in 59us (225us total) trans 0 rc 0/0 00000100:00100000:2.0:1783441441.149061:0:6581:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 43 00010000:00080000:2.0:1783441441.149108:0:3306:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff91a87d80d180 x1870073693255936/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1783441457 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1783441441.149135:0:3306:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff91a87d80d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3306:1870073693255936:0@lo:400:kworker.0 00000100:00100000:1.0:1783441441.151472:0:5787:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a87d6f1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3305:x1870073693255808:12345-0@lo:400:kworker.0 Request processed in 4589us (4858us total) trans 0 rc 0/0 00000100:00100000:1.0:1783441441.151491:0:5787:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 75 00000100:00080000:1.0:1783441441.151557:0:5781:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1783441441.151564:0:5781:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1783441441.151736:0:3305:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff91a87d80f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3305:1870073693255808:0@lo:400:kworker.0 00000100:00100000:2.0:1783441441.153081:0:3303:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff91a87d80d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3303:1870073693256064:0@lo:400:kworker.0 00000100:00100000:2.0:1783441441.153190:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783441441.153856:0:6605:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073693256064 00000100:00100000:1.0:1783441441.153866:0:6605:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073693256064 00000100:00100000:1.0:1783441441.153945:0:6605:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 77 00000100:00100000:1.0:1783441441.153954:0:6605:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a875691180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3303:x1870073693256064:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1783441441.155592:0:3304:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff91a87d80fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3304:1870073693256192:0@lo:400:kworker.0 00000100:00100000:3.0:1783441441.155676:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783441441.155771:0:8557:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073693256192 00000100:00100000:3.0:1783441441.155780:0:8557:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073693256192 00000100:00100000:3.0:1783441441.155836:0:8557:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 44 00000100:00100000:3.0:1783441441.155845:0:8557:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a87d80ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3304:x1870073693256192:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1783441441.155921:0:8557:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a87d80ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3304:x1870073693256192:12345-0@lo:400:kworker.0 Request processed in 76us (245us total) trans 0 rc 0/0 00000100:00100000:3.0:1783441441.155929:0:8557:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 44 00010000:00080000:3.0:1783441441.155979:0:3304:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff91a87d80fb80 x1870073693256192/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1783441457 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1783441441.155997:0:3304:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff91a87d80fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3304:1870073693256192:0@lo:400:kworker.0 00000100:00100000:1.0:1783441441.156573:0:6605:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a875691180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3303:x1870073693256064:12345-0@lo:400:kworker.0 Request processed in 2615us (3379us total) trans 0 rc 0/0 00000100:00100000:1.0:1783441441.156585:0:6605:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 77 00000100:00080000:1.0:1783441441.156624:0:5781:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1783441441.156631:0:5781:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1783441441.156710:0:3303:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff91a87d80d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3303:1870073693256064:0@lo:400:kworker.0 00000100:00100000:1.0:1783441441.644945:0:3305:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff91a87d6f0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3305:1870073693256320:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1783441441.645052:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783441441.646421:0:6585:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073693256320 00000100:00100000:0.0:1783441441.646440:0:6585:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073693256320 00000100:00100000:0.0:1783441441.646520:0:6585:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:0.0:1783441441.646530:0:6585:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a87d4df800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3305:x1870073693256320:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1783441441.646582:0:6585:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1783441441.646683:0:6585:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a87d4df800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3305:x1870073693256320:12345-0@lo:13:osp-pre-1-0.0 Request processed in 153us (1631us total) trans 0 rc 0/0 00000100:00100000:0.0:1783441441.646690:0:6585:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00010000:00080000:2.0:1783441441.648455:0:3305:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff91a87d6f0a80 x1870073693256320/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1783441457 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1783441441.648487:0:3305:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff91a87d6f0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3305:1870073693256320:0@lo:13:osp-pre-1-0.0 00010000:00010000:3.0:1783441441.901946:0:5772:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1783441442.674404:0:3306:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff91a87d80fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3306:1870073693256448:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1783441442.674499:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783441442.675045:0:6585:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073693256448 00000100:00100000:0.0:1783441442.675053:0:6585:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073693256448 00000100:00100000:0.0:1783441442.675113:0:6585:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:0.0:1783441442.675123:0:6585:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a875690e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3306:x1870073693256448:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1783441442.675164:0:6585:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1783441442.675235:0:6585:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a875690e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3306:x1870073693256448:12345-0@lo:13:osp-pre-0-0.0 Request processed in 113us (736us total) trans 0 rc 0/0 00000100:00100000:0.0:1783441442.675243:0:6585:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00010000:00080000:0.0:1783441442.675292:0:3306:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff91a87d80fb80 x1870073693256448/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1783441458 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1783441442.675313:0:3306:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff91a87d80fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3306:1870073693256448:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1783441442.681357:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.13@tcp (source: 12345-192.168.201.13@tcp) 00000100:00100000:2.0:1783441442.681396:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.13@tcp (source: 12345-192.168.201.13@tcp) 00000100:00100000:2.0:1783441442.681542:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.13@tcp (source: 12345-192.168.201.13@tcp) 00000100:00100000:2.0:1783441442.681568:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.13@tcp (source: 12345-192.168.201.13@tcp) 00000100:00100000:2.0:1783441442.681596:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.13@tcp (source: 12345-192.168.201.13@tcp) 00000100:00100000:2.0:1783441442.681637:0:6581:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073673298816 00000100:00100000:2.0:1783441442.681646:0:6581:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073673298816 00000100:00100000:2.0:1783441442.681705:0:6581:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073673298688 00000100:00100000:2.0:1783441442.681709:0:6581:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073673298688 00000100:00100000:2.0:1783441442.681735:0:6581:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.13@tcp, seq: 45 00000100:00100000:2.0:1783441442.681859:0:6581:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a875691f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:d5aa2a25-c618-49e9-a833-85b3b4747e53+5:2355:x1870073673298816:12345-192.168.201.13@tcp:400:kworker.0 00000100:00100000:2.0:1783441442.681933:0:6581:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a875691f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:d5aa2a25-c618-49e9-a833-85b3b4747e53+5:2355:x1870073673298816:12345-192.168.201.13@tcp:400:kworker.0 Request processed in 79us (391us total) trans 0 rc 0/0 00000100:00100000:2.0:1783441442.681941:0:6581:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.13@tcp, seq: 45 00000100:00100000:2.0:1783441442.681958:0:6581:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.13@tcp, seq: 46 00000100:00100000:2.0:1783441442.681964:0:6581:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a867cd4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:d5aa2a25-c618-49e9-a833-85b3b4747e53+5:2355:x1870073673298688:12345-192.168.201.13@tcp:400:kworker.0 00000100:00100000:2.0:1783441442.681983:0:6581:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a867cd4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:d5aa2a25-c618-49e9-a833-85b3b4747e53+5:2355:x1870073673298688:12345-192.168.201.13@tcp:400:kworker.0 Request processed in 19us (386us total) trans 0 rc 0/0 00000100:00100000:2.0:1783441442.681988:0:6581:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.13@tcp, seq: 46 00000100:00100000:2.0:1783441442.682004:0:5785:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073673298560 00000100:00100000:2.0:1783441442.682007:0:5785:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073673298560 00000100:00100000:2.0:1783441442.682030:0:5785:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073673298432 00000100:00100000:2.0:1783441442.682032:0:5785:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073673298432 00000100:00100000:2.0:1783441442.682047:0:5785:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.13@tcp, seq: 78 00000100:00100000:2.0:1783441442.682052:0:5785:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a875693800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d5aa2a25-c618-49e9-a833-85b3b4747e53+5:2355:x1870073673298560:12345-192.168.201.13@tcp:400:kworker.0 00000100:00100000:2.0:1783441442.682079:0:5785:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a875693800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d5aa2a25-c618-49e9-a833-85b3b4747e53+5:2355:x1870073673298560:12345-192.168.201.13@tcp:400:kworker.0 Request processed in 27us (684us total) trans 0 rc 0/0 00000100:00100000:2.0:1783441442.682086:0:5785:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.13@tcp, seq: 78 00000100:00100000:2.0:1783441442.682097:0:5785:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.13@tcp, seq: 79 00000100:00100000:2.0:1783441442.682102:0:5785:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a875690700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:65454767-383a-4679-a788-eba05c6e0989+6:2355:x1870073673298432:12345-192.168.201.13@tcp:400:kworker.0 00000100:00100000:2.0:1783441442.682122:0:5785:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a875690700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:65454767-383a-4679-a788-eba05c6e0989+6:2355:x1870073673298432:12345-192.168.201.13@tcp:400:kworker.0 Request processed in 20us (554us total) trans 0 rc 0/0 00000100:00100000:2.0:1783441442.682135:0:5785:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.13@tcp, seq: 79 00000100:00080000:2.0:1783441442.682155:0:5781:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1783441442.682159:0:5781:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1783441442.682162:0:5781:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1783441442.682387:0:5778:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073673298304 00000100:00100000:0.0:1783441442.682393:0:5778:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073673298304 00000100:00100000:0.0:1783441442.682444:0:5778:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.13@tcp, seq: 223 00000100:00100000:0.0:1783441442.682451:0:5778:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a848f73c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:51c2a82e-e792-4f56-84e8-12cc033e9e70+13:2355:x1870073673298304:12345-192.168.201.13@tcp:400:kworker.0 00000100:00100000:0.0:1783441442.682481:0:5778:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a848f73c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:51c2a82e-e792-4f56-84e8-12cc033e9e70+13:2355:x1870073673298304:12345-192.168.201.13@tcp:400:kworker.0 Request processed in 31us (1135us total) trans 0 rc 0/0 00000100:00100000:0.0:1783441442.682489:0:5778:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.13@tcp, seq: 223 00010000:00010000:3.0:1783441442.926983:0:5773:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783441443.954312:0:5772:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783441444.975005:0:5773:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783441445.997842:0:5772:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1783441446.253024:0:3304:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff91a87d80f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3304:1870073693256704:0@lo:400:kworker.0 00000100:00100000:3.0:1783441446.253101:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783441446.253178:0:3304:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff91a87d80dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3304:1870073693257216:0@lo:400:kworker.0 00000100:00100000:3.0:1783441446.253206:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783441446.253235:0:3304:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:3.0:1783441446.253241:0:3304:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff91a87d80c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:6c1ddb50-5795-40c6-a2b6-8f58add9da62:3304:1870073693256576:0@lo:400:kworker.0 00000100:00100000:3.0:1783441446.253270:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783441446.253289:0:3304:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff91a87d80c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3304:1870073693257088:0@lo:400:kworker.0 00000100:00100000:0.0:1783441446.253464:0:3305:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff91a87d80e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3305:1870073693256832:0@lo:400:kworker.0 00000100:00100000:0.0:1783441446.253494:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783441446.253515:0:3305:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1783441446.253521:0:3305:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff91a87d80ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3305:1870073693256960:0@lo:400:kworker.0 00000100:00100000:0.0:1783441446.253543:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783441446.253574:0:5787:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073693256704 00000100:00100000:0.0:1783441446.253582:0:5787:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073693256704 00000100:00100000:0.0:1783441446.253622:0:5787:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073693256832 00000100:00100000:0.0:1783441446.253626:0:5787:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073693256832 00000100:00100000:0.0:1783441446.253654:0:5787:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 80 00000100:00100000:0.0:1783441446.253663:0:5787:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a87d80fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3304:x1870073693256704:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1783441446.253710:0:5787:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a87d80fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3304:x1870073693256704:12345-0@lo:400:kworker.0 Request processed in 48us (609us total) trans 0 rc 0/0 00000100:00100000:0.0:1783441446.253717:0:5787:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 80 00000100:00100000:0.0:1783441446.253733:0:5787:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 81 00000100:00100000:0.0:1783441446.253767:0:5787:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a87d6f3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3305:x1870073693256832:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1783441446.253799:0:5787:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a87d6f3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3305:x1870073693256832:12345-0@lo:400:kworker.0 Request processed in 60us (305us total) trans 0 rc 0/0 00000100:00100000:0.0:1783441446.253806:0:5787:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 81 00000100:00100000:0.0:1783441446.253824:0:6582:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073693257216 00000100:00100000:0.0:1783441446.253829:0:6582:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073693257216 00000100:00100000:0.0:1783441446.253867:0:6582:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073693256960 00000100:00100000:0.0:1783441446.253870:0:6582:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073693256960 00000100:00100000:0.0:1783441446.253891:0:6582:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 47 00000100:00100000:0.0:1783441446.253897:0:6582:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a87d80d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3304:x1870073693257216:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1783441446.253928:0:6582:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a87d80d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3304:x1870073693257216:12345-0@lo:400:kworker.0 Request processed in 31us (721us total) trans 0 rc 0/0 00000100:00100000:0.0:1783441446.253934:0:6582:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 47 00000100:00100000:0.0:1783441446.253944:0:6582:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 48 00000100:00100000:0.0:1783441446.253950:0:6582:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a87d6f0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3305:x1870073693256960:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1783441446.253974:0:6582:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a87d6f0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3305:x1870073693256960:12345-0@lo:400:kworker.0 Request processed in 25us (430us total) trans 0 rc 0/0 00000100:00100000:0.0:1783441446.253979:0:6582:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 48 00000100:00080000:0.0:1783441446.253996:0:5781:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1783441446.254000:0:5781:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1783441446.254002:0:5781:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:0.0:1783441446.254035:0:3305:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff91a87d80ce00 x1870073693256960/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1783441462 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1783441446.254048:0:3305:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff91a87d80ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3305:1870073693256960:0@lo:400:kworker.0 00000100:00100000:0.0:1783441446.254060:0:3305:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff91a87d80e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3305:1870073693256832:0@lo:400:kworker.0 00000100:00100000:3.0:1783441446.254164:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783441446.254196:0:3304:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff91a87d80f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3304:1870073693256704:0@lo:400:kworker.0 00010000:00080000:3.0:1783441446.254208:0:3304:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff91a87d80dc00 x1870073693257216/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1783441462 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1783441446.254217:0:3304:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff91a87d80dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3304:1870073693257216:0@lo:400:kworker.0 00000100:00100000:2.0:1783441446.254460:0:5785:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073693257088 00000100:00100000:2.0:1783441446.254464:0:5785:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073693257088 00000100:00100000:2.0:1783441446.254511:0:5785:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 82 00000100:00100000:2.0:1783441446.254518:0:5785:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a87d80f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3304:x1870073693257088:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1783441446.254559:0:5785:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a87d80f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3304:x1870073693257088:12345-0@lo:400:kworker.0 Request processed in 42us (395us total) trans 0 rc 0/0 00000100:00100000:2.0:1783441446.254565:0:5785:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 82 00000100:00100000:2.0:1783441446.254589:0:5779:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073693256576 00000100:00100000:2.0:1783441446.254593:0:5779:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073693256576 00000100:00100000:2.0:1783441446.254617:0:5779:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 224 00000100:00100000:2.0:1783441446.254623:0:5779:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a848f72050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6c1ddb50-5795-40c6-a2b6-8f58add9da62+19:3304:x1870073693256576:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1783441446.254652:0:5779:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a848f72050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6c1ddb50-5795-40c6-a2b6-8f58add9da62+19:3304:x1870073693256576:12345-0@lo:400:kworker.0 Request processed in 29us (1381us total) trans 0 rc 0/0 00000100:00100000:2.0:1783441446.254658:0:5779:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 224 00000100:00100000:2.0:1783441446.254693:0:3304:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff91a87d80c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:6c1ddb50-5795-40c6-a2b6-8f58add9da62:3304:1870073693256576:0@lo:400:kworker.0 00000100:00100000:2.0:1783441446.254703:0:3304:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff91a87d80c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3304:1870073693257088:0@lo:400:kworker.0 00000100:00080000:1.0:1783441446.254762:0:5781:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1783441446.766280:0:3306:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1783441446.766305:0:3306:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff91a8756a4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3306:1870073693257344:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1783441446.766389:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783441446.766454:0:6585:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073693257344 00000100:00100000:0.0:1783441446.766462:0:6585:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073693257344 00000100:00100000:0.0:1783441446.766504:0:6585:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:0.0:1783441446.766513:0:6585:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a8756a7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3306:x1870073693257344:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1783441446.766559:0:6585:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1783441446.766606:0:6585:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a8756a7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3306:x1870073693257344:12345-0@lo:13:osp-pre-1-0.0 Request processed in 94us (217us total) trans 0 rc 0/0 00000100:00100000:0.0:1783441446.766612:0:6585:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00010000:00080000:0.0:1783441446.766648:0:3306:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff91a8756a4a80 x1870073693257344/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1783441462 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1783441446.766667:0:3306:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff91a8756a4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3306:1870073693257344:0@lo:13:osp-pre-1-0.0 00010000:00010000:3.0:1783441447.021039:0:5773:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1783441447.791348:0:3306:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff91a87d80dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3306:1870073693257472:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1783441447.791417:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783441447.791494:0:6585:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073693257472 00000100:00100000:3.0:1783441447.791501:0:6585:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073693257472 00000100:00100000:3.0:1783441447.791560:0:6585:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 39 00000100:00100000:3.0:1783441447.791570:0:6585:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a87d80f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3306:x1870073693257472:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1783441447.791607:0:6585:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1783441447.791651:0:6585:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a87d80f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3306:x1870073693257472:12345-0@lo:13:osp-pre-0-0.0 Request processed in 83us (234us total) trans 0 rc 0/0 00000100:00100000:3.0:1783441447.791658:0:6585:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 39 00010000:00080000:3.0:1783441447.791699:0:3306:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff91a87d80dc00 x1870073693257472/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1783441463 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1783441447.791718:0:3306:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff91a87d80dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3306:1870073693257472:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1783441447.796161:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.13@tcp (source: 12345-192.168.201.13@tcp) 00000100:00100000:0.0:1783441447.796212:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.13@tcp (source: 12345-192.168.201.13@tcp) 00000100:00100000:0.0:1783441447.796241:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.13@tcp (source: 12345-192.168.201.13@tcp) 00000100:00100000:0.0:1783441447.796265:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.13@tcp (source: 12345-192.168.201.13@tcp) 00000100:00100000:0.0:1783441447.796347:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.13@tcp (source: 12345-192.168.201.13@tcp) 00000100:00100000:0.0:1783441447.796378:0:6582:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073673299328 00000100:00100000:0.0:1783441447.796388:0:6582:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073673299328 00000100:00100000:0.0:1783441447.796443:0:6582:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073673299456 00000100:00100000:0.0:1783441447.796445:0:6582:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073673299456 00000100:00100000:0.0:1783441447.796469:0:6582:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.13@tcp, seq: 49 00000100:00100000:0.0:1783441447.796479:0:6582:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a8756a5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:d5aa2a25-c618-49e9-a833-85b3b4747e53+5:2355:x1870073673299328:12345-192.168.201.13@tcp:400:kworker.0 00000100:00100000:0.0:1783441447.796563:0:6582:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a8756a5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:d5aa2a25-c618-49e9-a833-85b3b4747e53+5:2355:x1870073673299328:12345-192.168.201.13@tcp:400:kworker.0 Request processed in 86us (350us total) trans 0 rc 0/0 00000100:00100000:0.0:1783441447.796571:0:6582:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.13@tcp, seq: 49 00000100:00100000:0.0:1783441447.796587:0:6582:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.13@tcp, seq: 50 00000100:00100000:0.0:1783441447.796594:0:6582:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a8756a7100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:d5aa2a25-c618-49e9-a833-85b3b4747e53+5:2355:x1870073673299456:12345-192.168.201.13@tcp:400:kworker.0 00000100:00100000:0.0:1783441447.796620:0:6582:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a8756a7100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:d5aa2a25-c618-49e9-a833-85b3b4747e53+5:2355:x1870073673299456:12345-192.168.201.13@tcp:400:kworker.0 Request processed in 26us (272us total) trans 0 rc 0/0 00000100:00100000:0.0:1783441447.796642:0:6582:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.13@tcp, seq: 50 00000100:00100000:0.0:1783441447.796661:0:5780:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073673298944 00000100:00100000:0.0:1783441447.796664:0:5780:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073673298944 00000100:00100000:0.0:1783441447.796688:0:5780:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.13@tcp, seq: 225 00000100:00100000:0.0:1783441447.796695:0:5780:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a848f73850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:51c2a82e-e792-4f56-84e8-12cc033e9e70+13:2355:x1870073673298944:12345-192.168.201.13@tcp:400:kworker.0 00000100:00100000:0.0:1783441447.796722:0:5780:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a848f73850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:51c2a82e-e792-4f56-84e8-12cc033e9e70+13:2355:x1870073673298944:12345-192.168.201.13@tcp:400:kworker.0 Request processed in 27us (480us total) trans 0 rc 0/0 00000100:00100000:0.0:1783441447.796728:0:5780:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.13@tcp, seq: 225 00000100:00100000:0.0:1783441447.796775:0:5785:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073673299072 00000100:00100000:0.0:1783441447.796778:0:5785:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073673299072 00000100:00100000:0.0:1783441447.796803:0:5785:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073673299200 00000100:00100000:0.0:1783441447.796806:0:5785:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073673299200 00000100:00100000:0.0:1783441447.796828:0:5785:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.13@tcp, seq: 83 00000100:00100000:0.0:1783441447.796835:0:5785:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a8756a4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:65454767-383a-4679-a788-eba05c6e0989+6:2355:x1870073673299072:12345-192.168.201.13@tcp:400:kworker.0 00000100:00100000:0.0:1783441447.796863:0:5785:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a8756a4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:65454767-383a-4679-a788-eba05c6e0989+6:2355:x1870073673299072:12345-192.168.201.13@tcp:400:kworker.0 Request processed in 29us (712us total) trans 0 rc 0/0 00000100:00100000:0.0:1783441447.796869:0:5785:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.13@tcp, seq: 83 00000100:00100000:0.0:1783441447.796882:0:5785:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.13@tcp, seq: 84 00000100:00100000:0.0:1783441447.796888:0:5785:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a8756a5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d5aa2a25-c618-49e9-a833-85b3b4747e53+5:2355:x1870073673299200:12345-192.168.201.13@tcp:400:kworker.0 00000100:00100000:0.0:1783441447.796920:0:5785:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a8756a5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d5aa2a25-c618-49e9-a833-85b3b4747e53+5:2355:x1870073673299200:12345-192.168.201.13@tcp:400:kworker.0 Request processed in 32us (653us total) trans 0 rc 0/0 00000100:00100000:0.0:1783441447.796926:0:5785:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.13@tcp, seq: 84 00000100:00080000:0.0:1783441447.796947:0:5781:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1783441447.796952:0:5781:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1783441447.796954:0:5781:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:3.0:1783441448.045607:0:5772:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783441449.069207:0:5773:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783441450.093362:0:5772:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783441451.116924:0:5773:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1783441451.373944:0:3305:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff91a87d80c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3305:1870073693257856:0@lo:400:kworker.0 00000100:00100000:3.0:1783441451.374045:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783441451.374099:0:3305:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1783441451.374105:0:3305:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff91a87d80c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3305:1870073693257984:0@lo:400:kworker.0 00000100:00100000:3.0:1783441451.374131:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783441451.374401:0:3303:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff91a87d80dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:6c1ddb50-5795-40c6-a2b6-8f58add9da62:3303:1870073693257600:0@lo:400:kworker.0 00000100:00100000:2.0:1783441451.374434:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783441451.374466:0:3303:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff91a87d80e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3303:1870073693258112:0@lo:400:kworker.0 00000100:00100000:2.0:1783441451.374487:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783441451.374517:0:3303:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:2.0:1783441451.374523:0:3303:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff91a87d80d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3303:1870073693257728:0@lo:400:kworker.0 00000100:00100000:2.0:1783441451.374543:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783441451.374558:0:3303:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff91a87d80ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3303:1870073693258240:0@lo:400:kworker.0 00000100:00100000:2.0:1783441451.374577:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783441451.374603:0:5787:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073693257856 00000100:00100000:2.0:1783441451.374610:0:5787:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073693257856 00000100:00100000:2.0:1783441451.374657:0:5787:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073693258112 00000100:00100000:2.0:1783441451.374660:0:5787:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073693258112 00000100:00100000:2.0:1783441451.374673:0:5787:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073693257728 00000100:00100000:2.0:1783441451.374676:0:5787:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073693257728 00000100:00100000:2.0:1783441451.374688:0:5787:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 85 00000100:00100000:2.0:1783441451.374695:0:5787:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a8476b0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3305:x1870073693257856:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1783441451.374775:0:5787:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a8476b0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3305:x1870073693257856:12345-0@lo:400:kworker.0 Request processed in 79us (730us total) trans 0 rc 0/0 00000100:00100000:2.0:1783441451.374782:0:5787:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 85 00000100:00100000:2.0:1783441451.374798:0:5787:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 86 00000100:00100000:2.0:1783441451.374803:0:5787:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a867cd4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3303:x1870073693258112:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1783441451.374832:0:5787:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a867cd4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3303:x1870073693258112:12345-0@lo:400:kworker.0 Request processed in 29us (344us total) trans 0 rc 0/0 00000100:00100000:2.0:1783441451.374838:0:5787:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 86 00000100:00100000:2.0:1783441451.374849:0:5787:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 87 00000100:00100000:2.0:1783441451.374867:0:5787:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a867cd5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3303:x1870073693257728:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1783441451.374893:0:5787:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a867cd5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3303:x1870073693257728:12345-0@lo:400:kworker.0 Request processed in 39us (350us total) trans 0 rc 0/0 00000100:00100000:2.0:1783441451.374898:0:5787:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 87 00000100:00100000:2.0:1783441451.374918:0:8557:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073693257984 00000100:00100000:2.0:1783441451.374927:0:8557:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073693257984 00000100:00100000:2.0:1783441451.374964:0:8557:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073693258240 00000100:00100000:2.0:1783441451.374967:0:8557:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073693258240 00000100:00100000:2.0:1783441451.374988:0:8557:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 51 00000100:00100000:2.0:1783441451.374993:0:8557:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a8476b2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3305:x1870073693257984:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1783441451.375021:0:8557:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a8476b2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3305:x1870073693257984:12345-0@lo:400:kworker.0 Request processed in 28us (889us total) trans 0 rc 0/0 00000100:00100000:2.0:1783441451.375038:0:8557:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 51 00000100:00100000:2.0:1783441451.375050:0:8557:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 52 00000100:00100000:2.0:1783441451.375055:0:8557:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a867cd6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3303:x1870073693258240:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1783441451.375082:0:8557:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a867cd6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3303:x1870073693258240:12345-0@lo:400:kworker.0 Request processed in 27us (503us total) trans 0 rc 0/0 00000100:00100000:2.0:1783441451.375088:0:8557:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 52 00000100:00080000:2.0:1783441451.375103:0:5781:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1783441451.375106:0:5781:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1783441451.375109:0:5781:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1783441451.375144:0:3303:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff91a87d80d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3303:1870073693257728:0@lo:400:kworker.0 00010000:00080000:2.0:1783441451.375157:0:3303:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff91a87d80ce00 x1870073693258240/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1783441467 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1783441451.375167:0:3303:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff91a87d80ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3303:1870073693258240:0@lo:400:kworker.0 00000100:00100000:2.0:1783441451.375176:0:3303:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff91a87d80e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3303:1870073693258112:0@lo:400:kworker.0 00010000:00080000:2.0:1783441451.375210:0:3305:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff91a87d80c380 x1870073693257984/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1783441467 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1783441451.375219:0:3305:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff91a87d80c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3305:1870073693257984:0@lo:400:kworker.0 00000100:00100000:2.0:1783441451.375229:0:3305:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff91a87d80c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3305:1870073693257856:0@lo:400:kworker.0 00000100:00100000:3.0:1783441451.375427:0:5778:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073693257600 00000100:00100000:3.0:1783441451.375431:0:5778:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073693257600 00000100:00100000:3.0:1783441451.375457:0:5778:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 226 00000100:00100000:3.0:1783441451.375464:0:5778:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a848f72850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6c1ddb50-5795-40c6-a2b6-8f58add9da62+19:3303:x1870073693257600:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1783441451.375500:0:5778:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a848f72850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6c1ddb50-5795-40c6-a2b6-8f58add9da62+19:3303:x1870073693257600:12345-0@lo:400:kworker.0 Request processed in 37us (1066us total) trans 0 rc 0/0 00000100:00100000:3.0:1783441451.375507:0:5778:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 226 00000100:00100000:2.0:1783441451.376311:0:3303:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff91a87d80dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:6c1ddb50-5795-40c6-a2b6-8f58add9da62:3303:1870073693257600:0@lo:400:kworker.0 00000100:00100000:3.0:1783441451.888997:0:3305:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff91a8756a4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3305:1870073693258368:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1783441451.889093:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783441451.889549:0:6585:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073693258368 00000100:00100000:0.0:1783441451.889559:0:6585:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073693258368 00000100:00100000:0.0:1783441451.889611:0:6585:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:0.0:1783441451.889622:0:6585:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a8476b1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3305:x1870073693258368:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1783441451.889661:0:6585:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1783441451.889722:0:6585:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a8476b1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3305:x1870073693258368:12345-0@lo:13:osp-pre-1-0.0 Request processed in 102us (628us total) trans 0 rc 0/0 00000100:00100000:0.0:1783441451.889729:0:6585:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00010000:00080000:1.0:1783441451.889848:0:3305:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff91a8756a4e00 x1870073693258368/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1783441467 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1783441451.889866:0:3305:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff91a8756a4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3305:1870073693258368:0@lo:13:osp-pre-1-0.0 00010000:00010000:2.0:1783441452.144187:0:5772:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1783441452.910050:0:3306:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff91a8476b0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3306:1870073693258496:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1783441452.910130:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783441452.910255:0:6585:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073693258496 00000100:00100000:3.0:1783441452.910264:0:6585:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073693258496 00000100:00100000:3.0:1783441452.910316:0:6585:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:3.0:1783441452.910325:0:6585:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a8756a6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3306:x1870073693258496:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1783441452.910361:0:6585:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1783441452.910409:0:6585:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a8756a6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3306:x1870073693258496:12345-0@lo:13:osp-pre-0-0.0 Request processed in 85us (278us total) trans 0 rc 0/0 00000100:00100000:3.0:1783441452.910416:0:6585:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00010000:00080000:1.0:1783441452.910493:0:3306:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff91a8476b0700 x1870073693258496/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1783441468 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1783441452.910528:0:3306:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff91a8476b0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3306:1870073693258496:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1783441452.919481:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.13@tcp (source: 12345-192.168.201.13@tcp) 00000100:00100000:2.0:1783441452.919525:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.13@tcp (source: 12345-192.168.201.13@tcp) 00000100:00100000:2.0:1783441452.919567:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.13@tcp (source: 12345-192.168.201.13@tcp) 00000100:00100000:2.0:1783441452.919595:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.13@tcp (source: 12345-192.168.201.13@tcp) 00000100:00100000:3.0:1783441452.919600:0:5787:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073673299840 00000100:00100000:3.0:1783441452.919609:0:5787:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073673299840 00000100:00100000:2.0:1783441452.919619:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.13@tcp (source: 12345-192.168.201.13@tcp) 00000100:00100000:2.0:1783441452.919637:0:8557:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073673299968 00000100:00100000:2.0:1783441452.919640:0:8557:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073673299968 00000100:00100000:3.0:1783441452.919663:0:5787:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073673299712 00000100:00100000:2.0:1783441452.919663:0:8557:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073673300096 00000100:00100000:3.0:1783441452.919665:0:5787:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073673299712 00000100:00100000:2.0:1783441452.919665:0:8557:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073673300096 00000100:00100000:3.0:1783441452.919684:0:5787:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.13@tcp, seq: 88 00000100:00100000:2.0:1783441452.919684:0:8557:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.13@tcp, seq: 15 00000100:00100000:3.0:1783441452.919693:0:5787:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a867cd7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d5aa2a25-c618-49e9-a833-85b3b4747e53+5:2355:x1870073673299840:12345-192.168.201.13@tcp:400:kworker.0 00000100:00100000:2.0:1783441452.919693:0:8557:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a87d80c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:d5aa2a25-c618-49e9-a833-85b3b4747e53+5:2351:x1870073673299968:12345-192.168.201.13@tcp:9:kworker.0 00000020:00000080:2.0:1783441452.919726:0:8557:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xa2426164df2c7823 00000100:00080000:2.0:1783441452.919733:0:8557:0:(import.c:65:import_set_state_nolock()) ffff91a8655b4800 : changing import state from FULL to CLOSED 00000001:00000004:2.0:1783441452.919795:0:8557:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 4294967298 00000100:00100000:3.0:1783441452.919797:0:5787:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a867cd7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d5aa2a25-c618-49e9-a833-85b3b4747e53+5:2355:x1870073673299840:12345-192.168.201.13@tcp:400:kworker.0 Request processed in 106us (271us total) trans 0 rc 0/0 00000100:00100000:3.0:1783441452.919805:0:5787:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.13@tcp, seq: 88 00000100:00100000:3.0:1783441452.919820:0:5787:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.13@tcp, seq: 89 00000100:00100000:3.0:1783441452.919826:0:5787:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a87d80dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:65454767-383a-4679-a788-eba05c6e0989+6:2355:x1870073673299712:12345-192.168.201.13@tcp:400:kworker.0 00000100:00100000:3.0:1783441452.919850:0:5787:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a87d80dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:65454767-383a-4679-a788-eba05c6e0989+6:2355:x1870073673299712:12345-192.168.201.13@tcp:400:kworker.0 Request processed in 24us (282us total) trans 0 rc 0/0 00000100:00100000:3.0:1783441452.919867:0:5787:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.13@tcp, seq: 89 00000100:00080000:3.0:1783441452.919883:0:5781:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1783441452.919887:0:5781:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1783441452.919889:0:5781:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:3.0:1783441452.919901:0:5773:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1783441452.920269:0:5779:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073673299584 00000100:00100000:0.0:1783441452.920274:0:5779:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073673299584 00000100:00100000:0.0:1783441452.920313:0:5779:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.13@tcp, seq: 227 00000100:00100000:0.0:1783441452.920320:0:5779:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a848f71450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:51c2a82e-e792-4f56-84e8-12cc033e9e70+13:2355:x1870073673299584:12345-192.168.201.13@tcp:400:kworker.0 00000100:00100000:0.0:1783441452.920347:0:5779:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a848f71450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:51c2a82e-e792-4f56-84e8-12cc033e9e70+13:2355:x1870073673299584:12345-192.168.201.13@tcp:400:kworker.0 Request processed in 28us (875us total) trans 0 rc 0/0 00000100:00100000:0.0:1783441452.920353:0:5779:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.13@tcp, seq: 227 00000100:00100000:0.0:1783441452.920384:0:6582:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.13@tcp, seq: 16 00000100:00100000:0.0:1783441452.920390:0:6582:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a87d80c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:d5aa2a25-c618-49e9-a833-85b3b4747e53+5:2351:x1870073673300096:12345-192.168.201.13@tcp:9:kworker.0 00000020:00000080:0.0:1783441452.920403:0:6582:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xa2426164df2c782a 00000100:00080000:0.0:1783441452.920409:0:6582:0:(import.c:65:import_set_state_nolock()) ffff91a8655b0800 : changing import state from FULL to CLOSED 00000001:00000004:0.0:1783441452.920434:0:6582:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 4294967298 00000100:00100000:0.0:1783441452.920681:0:6582:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a87d80c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:d5aa2a25-c618-49e9-a833-85b3b4747e53+2:2351:x1870073673300096:12345-192.168.201.13@tcp:9:kworker.0 Request processed in 289us (1059us total) trans 0 rc 0/0 00000100:00100000:0.0:1783441452.920688:0:6582:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.13@tcp, seq: 16 00010000:00010000:0.0:1783441452.920705:0:5772:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1783441452.920939:0:8557:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a87d80c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:d5aa2a25-c618-49e9-a833-85b3b4747e53+2:2351:x1870073673299968:12345-192.168.201.13@tcp:9:kworker.0 Request processed in 1247us (1342us total) trans 0 rc 0/0 00000100:00100000:2.0:1783441452.920947:0:8557:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.13@tcp, seq: 15 00010000:00010000:3.0:1783441453.164892:0:5773:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:2.0:1783441453.576345:0:7492:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of d5aa2a25-c618-49e9-a833-85b3b4747e53 00000020:00000080:2.0:1783441453.576354:0:7492:0:(genops.c:906:class_export_put()) final put ffff91a8655b5800/d5aa2a25-c618-49e9-a833-85b3b4747e53 00000020:00000080:2.0:1783441453.576386:0:27:0:(genops.c:865:class_export_destroy()) destroying export ffff91a8655b5800/d5aa2a25-c618-49e9-a833-85b3b4747e53 for lustre-OST0001 00000020:00000080:2.0:1783441453.576422:0:27:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff91a8655b0800 for lustre-OST0001 00010000:00010000:0.0:1783441454.189162:0:5772:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:2.0:1783441454.504196:0:6613:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of d5aa2a25-c618-49e9-a833-85b3b4747e53 00000020:00000080:2.0:1783441454.504207:0:6613:0:(genops.c:906:class_export_put()) final put ffff91a8655b7800/d5aa2a25-c618-49e9-a833-85b3b4747e53 00000020:00000080:2.0:1783441454.504235:0:27:0:(genops.c:865:class_export_destroy()) destroying export ffff91a8655b7800/d5aa2a25-c618-49e9-a833-85b3b4747e53 for lustre-OST0000 00000020:00000080:2.0:1783441454.504287:0:27:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff91a8655b4800 for lustre-OST0000 00010000:00010000:3.0:1783441455.216068:0:5773:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783441456.240152:0:5772:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1783441456.492936:0:3303:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff91a8476b1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:6c1ddb50-5795-40c6-a2b6-8f58add9da62:3303:1870073693258624:0@lo:400:kworker.0 00000100:00100000:2.0:1783441456.492968:0:3305:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff91a8476b0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3305:1870073693258880:0@lo:400:kworker.0 00000100:00100000:2.0:1783441456.496374:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783441456.496449:0:3305:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1783441456.496460:0:3305:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff91a8476b2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3305:1870073693259008:0@lo:400:kworker.0 00000100:00100000:2.0:1783441456.496495:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783441456.496535:0:6582:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073693259008 00000100:00100000:1.0:1783441456.496535:0:5787:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073693258880 00000100:00100000:2.0:1783441456.496542:0:6582:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073693259008 00000100:00100000:1.0:1783441456.496542:0:5787:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073693258880 00000100:00100000:2.0:1783441456.496592:0:6582:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 53 00000100:00100000:2.0:1783441456.496600:0:6582:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a87d80ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3305:x1870073693259008:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1783441456.496654:0:6582:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a87d80ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3305:x1870073693259008:12345-0@lo:400:kworker.0 Request processed in 54us (156us total) trans 0 rc 0/0 00000100:00100000:1.0:1783441456.496655:0:5787:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 90 00000100:00100000:2.0:1783441456.496661:0:6582:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 53 00000100:00100000:1.0:1783441456.496663:0:5787:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a87d80e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3305:x1870073693258880:12345-0@lo:400:kworker.0 00000100:00080000:2.0:1783441456.496679:0:5781:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1783441456.496683:0:5781:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1783441456.496698:0:5787:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a87d80e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3305:x1870073693258880:12345-0@lo:400:kworker.0 Request processed in 37us (332us total) trans 0 rc 0/0 00000100:00100000:1.0:1783441456.496704:0:5787:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 90 00010000:00080000:2.0:1783441456.496711:0:3305:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff91a8476b2300 x1870073693259008/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1783441472 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1783441456.496725:0:3305:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff91a8476b2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3305:1870073693259008:0@lo:400:kworker.0 00000100:00100000:2.0:1783441456.496736:0:3305:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff91a8476b0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3305:1870073693258880:0@lo:400:kworker.0 00000100:00100000:3.0:1783441456.497087:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783441456.497122:0:3303:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff91a8476b3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3303:1870073693259136:0@lo:400:kworker.0 00000100:00100000:2.0:1783441456.497140:0:5780:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073693258624 00000100:00100000:2.0:1783441456.497144:0:5780:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073693258624 00000100:00100000:3.0:1783441456.497147:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783441456.497172:0:5780:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 228 00000100:00100000:3.0:1783441456.497173:0:3303:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:2.0:1783441456.497178:0:5780:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a848f34850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6c1ddb50-5795-40c6-a2b6-8f58add9da62+19:3303:x1870073693258624:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1783441456.497179:0:3303:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff91a8476b3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3303:1870073693258752:0@lo:400:kworker.0 00000100:00100000:3.0:1783441456.497200:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783441456.497205:0:5780:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a848f34850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6c1ddb50-5795-40c6-a2b6-8f58add9da62+19:3303:x1870073693258624:12345-0@lo:400:kworker.0 Request processed in 28us (119us total) trans 0 rc 0/0 00000100:00100000:2.0:1783441456.497211:0:5780:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 228 00000100:00100000:3.0:1783441456.497213:0:3303:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff91a8476b1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3303:1870073693259264:0@lo:400:kworker.0 00000100:00100000:3.0:1783441456.497232:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783441456.497252:0:3303:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff91a8476b1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:6c1ddb50-5795-40c6-a2b6-8f58add9da62:3303:1870073693258624:0@lo:400:kworker.0 00000100:00100000:1.0:1783441456.497581:0:5785:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073693259136 00000100:00100000:1.0:1783441456.497585:0:5785:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073693259136 00000100:00100000:1.0:1783441456.497623:0:5785:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073693258752 00000100:00100000:1.0:1783441456.497626:0:5785:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073693258752 00000100:00100000:1.0:1783441456.497640:0:5785:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 91 00000100:00100000:1.0:1783441456.497646:0:5785:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a8476b0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3303:x1870073693259136:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1783441456.497679:0:5785:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a8476b0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3303:x1870073693259136:12345-0@lo:400:kworker.0 Request processed in 33us (531us total) trans 0 rc 0/0 00000100:00100000:1.0:1783441456.497685:0:5785:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 91 00000100:00100000:1.0:1783441456.497697:0:5785:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 92 00000100:00100000:1.0:1783441456.497703:0:5785:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a8476b0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3303:x1870073693258752:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1783441456.497725:0:5785:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a8476b0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3303:x1870073693258752:12345-0@lo:400:kworker.0 Request processed in 23us (524us total) trans 0 rc 0/0 00000100:00100000:1.0:1783441456.497730:0:5785:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 92 00000100:00080000:0.0:1783441456.497807:0:5781:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1783441456.497862:0:3303:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff91a8476b3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3303:1870073693258752:0@lo:400:kworker.0 00000100:00100000:3.0:1783441456.498072:0:3303:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff91a8476b3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3303:1870073693259136:0@lo:400:kworker.0 00000100:00100000:3.0:1783441456.498108:0:6581:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073693259264 00000100:00100000:3.0:1783441456.498112:0:6581:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073693259264 00000100:00100000:3.0:1783441456.498190:0:6581:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 54 00000100:00100000:3.0:1783441456.498198:0:6581:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a8476b3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3303:x1870073693259264:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1783441456.498236:0:6581:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a8476b3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3303:x1870073693259264:12345-0@lo:400:kworker.0 Request processed in 39us (1002us total) trans 0 rc 0/0 00000100:00100000:3.0:1783441456.498250:0:6581:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 54 00010000:00080000:3.0:1783441456.498289:0:3303:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff91a8476b1500 x1870073693259264/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1783441472 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1783441456.498300:0:3303:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff91a8476b1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3303:1870073693259264:0@lo:400:kworker.0 00000100:00080000:0.0:1783441456.498432:0:5781:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1783441457.011454:0:3305:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff91a8756a4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3305:1870073693259392:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1783441457.011533:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783441457.011726:0:6585:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073693259392 00000100:00100000:0.0:1783441457.011735:0:6585:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073693259392 00000100:00100000:0.0:1783441457.011824:0:6585:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:0.0:1783441457.011833:0:6585:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a87d80d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3305:x1870073693259392:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1783441457.011870:0:6585:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3858759680 avail 3856662528 00000100:00100000:0.0:1783441457.011939:0:6585:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a87d80d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3305:x1870073693259392:12345-0@lo:13:osp-pre-1-0.0 Request processed in 97us (396us total) trans 0 rc 0/0 00000100:00100000:0.0:1783441457.011947:0:6585:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00010000:00080000:2.0:1783441457.012791:0:3305:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff91a8756a4e00 x1870073693259392/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1783441473 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1783441457.012814:0:3305:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff91a8756a4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3305:1870073693259392:0@lo:13:osp-pre-1-0.0 00010000:00010000:1.0:1783441457.261795:0:5773:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1783441458.031280:0:3306:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff91a87d4dd500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3306:1870073693259520:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1783441458.031351:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783441458.031439:0:6585:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073693259520 00000100:00100000:1.0:1783441458.031447:0:6585:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073693259520 00000100:00100000:1.0:1783441458.031494:0:6585:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 43 00000100:00100000:1.0:1783441458.031504:0:6585:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a87d4dc000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3306:x1870073693259520:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1783441458.031549:0:6585:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1783441458.031592:0:6585:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a87d4dc000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3306:x1870073693259520:12345-0@lo:13:osp-pre-0-0.0 Request processed in 90us (241us total) trans 0 rc 0/0 00000100:00100000:1.0:1783441458.031600:0:6585:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 43 00000100:00080000:1.0:1783441458.031621:0:5781:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:1.0:1783441458.031650:0:3306:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff91a87d4dd500 x1870073693259520/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1783441474 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1783441458.031668:0:3306:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff91a87d4dd500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3306:1870073693259520:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1783441458.035243:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.13@tcp (source: 12345-192.168.201.13@tcp) 00000100:00100000:3.0:1783441458.035281:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.13@tcp (source: 12345-192.168.201.13@tcp) 00000100:00100000:3.0:1783441458.035305:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.13@tcp (source: 12345-192.168.201.13@tcp) 00000100:00100000:3.0:1783441458.035334:0:5778:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073673300224 00000100:00100000:3.0:1783441458.035344:0:5778:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073673300224 00000100:00100000:3.0:1783441458.035524:0:5778:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.13@tcp, seq: 229 00000100:00100000:3.0:1783441458.035535:0:5778:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a848f36450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:51c2a82e-e792-4f56-84e8-12cc033e9e70+13:2354:x1870073673300224:12345-192.168.201.13@tcp:400:kworker.0 00000100:00100000:3.0:1783441458.035611:0:5778:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a848f36450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:51c2a82e-e792-4f56-84e8-12cc033e9e70+13:2354:x1870073673300224:12345-192.168.201.13@tcp:400:kworker.0 Request processed in 77us (375us total) trans 0 rc 0/0 00000100:00100000:3.0:1783441458.035617:0:5778:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.13@tcp, seq: 229 00000100:00100000:3.0:1783441458.035650:0:5785:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073673300480 00000100:00100000:3.0:1783441458.035654:0:5785:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073673300480 00000100:00100000:3.0:1783441458.035686:0:5785:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073673300352 00000100:00100000:3.0:1783441458.035689:0:5785:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073673300352 00000100:00100000:3.0:1783441458.035707:0:5785:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.13@tcp, seq: 93 00000100:00100000:3.0:1783441458.035714:0:5785:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a8476b1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d5aa2a25-c618-49e9-a833-85b3b4747e53+5:2354:x1870073673300480:12345-192.168.201.13@tcp:400:kworker.0 00000100:00100000:3.0:1783441458.035763:0:5785:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a8476b1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d5aa2a25-c618-49e9-a833-85b3b4747e53+5:2354:x1870073673300480:12345-192.168.201.13@tcp:400:kworker.0 Request processed in 49us (480us total) trans 0 rc 0/0 00000100:00100000:3.0:1783441458.035770:0:5785:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.13@tcp, seq: 93 00000100:00100000:3.0:1783441458.035782:0:5785:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.13@tcp, seq: 94 00000100:00100000:3.0:1783441458.035789:0:5785:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a8476b3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:65454767-383a-4679-a788-eba05c6e0989+6:2354:x1870073673300352:12345-192.168.201.13@tcp:400:kworker.0 00000100:00100000:3.0:1783441458.035830:0:5785:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a8476b3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:65454767-383a-4679-a788-eba05c6e0989+6:2354:x1870073673300352:12345-192.168.201.13@tcp:400:kworker.0 Request processed in 42us (524us total) trans 0 rc 0/0 00000100:00100000:3.0:1783441458.035836:0:5785:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.13@tcp, seq: 94 00000100:00080000:3.0:1783441458.036053:0:5781:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:0.0:1783441458.286865:0:5772:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783441459.309686:0:5773:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:0.0:1783441460.220403:0:10866:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: Using TIMEOUT=20 00010000:00010000:2.0:1783441460.333909:0:5772:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783441461.357315:0:5773:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1783441461.613079:0:3303:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff91a8476b3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:6c1ddb50-5795-40c6-a2b6-8f58add9da62:3303:1870073693259648:0@lo:400:kworker.0 00000100:00100000:3.0:1783441461.613155:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783441461.613205:0:3303:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff91a8476b3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3303:1870073693260160:0@lo:400:kworker.0 00000100:00100000:3.0:1783441461.613232:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783441461.613328:0:3303:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:3.0:1783441461.613335:0:3303:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff91a8476b1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3303:1870073693259776:0@lo:400:kworker.0 00000100:00100000:3.0:1783441461.613357:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783441461.613371:0:3303:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff91a8476b1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3303:1870073693260288:0@lo:400:kworker.0 00000100:00100000:3.0:1783441461.613392:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783441461.613474:0:5785:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073693260160 00000100:00100000:3.0:1783441461.613481:0:5785:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073693260160 00000100:00100000:3.0:1783441461.613527:0:5785:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073693259776 00000100:00100000:3.0:1783441461.613530:0:5785:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073693259776 00000100:00100000:3.0:1783441461.613547:0:5785:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 95 00000100:00100000:3.0:1783441461.613554:0:5785:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a8476b2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3303:x1870073693260160:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1783441461.613601:0:5785:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a8476b2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3303:x1870073693260160:12345-0@lo:400:kworker.0 Request processed in 47us (368us total) trans 0 rc 0/0 00000100:00100000:3.0:1783441461.613608:0:5785:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 95 00000100:00100000:3.0:1783441461.613624:0:5785:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 96 00000100:00100000:3.0:1783441461.613630:0:5785:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a8476b0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3303:x1870073693259776:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1783441461.613654:0:5785:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a8476b0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3303:x1870073693259776:12345-0@lo:400:kworker.0 Request processed in 25us (296us total) trans 0 rc 0/0 00000100:00100000:3.0:1783441461.613675:0:5785:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 96 00000100:00080000:3.0:1783441461.614541:0:5781:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1783441461.614599:0:3303:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff91a8476b1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3303:1870073693259776:0@lo:400:kworker.0 00000100:00100000:3.0:1783441461.614611:0:3303:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff91a8476b3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3303:1870073693260160:0@lo:400:kworker.0 00000100:00100000:2.0:1783441461.619681:0:3305:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff91a8476b1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3305:1870073693259904:0@lo:400:kworker.0 00000100:00100000:2.0:1783441461.619862:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783441461.619929:0:3305:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1783441461.619939:0:3305:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff91a8476b2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3305:1870073693260032:0@lo:400:kworker.0 00000100:00100000:2.0:1783441461.619973:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783441461.620027:0:5779:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073693259648 00000100:00100000:2.0:1783441461.620055:0:5779:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073693259648 00000100:00100000:2.0:1783441461.620125:0:5779:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 230 00000100:00100000:2.0:1783441461.620136:0:5779:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a848f36c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6c1ddb50-5795-40c6-a2b6-8f58add9da62+19:3303:x1870073693259648:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1783441461.620209:0:5779:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a848f36c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6c1ddb50-5795-40c6-a2b6-8f58add9da62+19:3303:x1870073693259648:12345-0@lo:400:kworker.0 Request processed in 73us (7052us total) trans 0 rc 0/0 00000100:00100000:2.0:1783441461.620217:0:5779:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 230 00000100:00100000:2.0:1783441461.620264:0:6582:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073693260288 00000100:00100000:2.0:1783441461.620270:0:6582:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073693260288 00000100:00100000:2.0:1783441461.620318:0:6582:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073693260032 00000100:00100000:2.0:1783441461.620322:0:6582:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073693260032 00000100:00100000:2.0:1783441461.620347:0:6582:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 55 00000100:00100000:2.0:1783441461.620354:0:6582:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a8476b2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3303:x1870073693260288:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1783441461.620399:0:6582:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a8476b2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3303:x1870073693260288:12345-0@lo:400:kworker.0 Request processed in 45us (7005us total) trans 0 rc 0/0 00000100:00100000:2.0:1783441461.620428:0:6582:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 55 00000100:00100000:2.0:1783441461.620452:0:6582:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 56 00000100:00100000:2.0:1783441461.620479:0:6582:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a87d6a0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3305:x1870073693260032:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1783441461.620484:0:5785:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073693259904 00000100:00100000:3.0:1783441461.620505:0:5785:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073693259904 00000100:00100000:2.0:1783441461.620524:0:6582:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a87d6a0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3305:x1870073693260032:12345-0@lo:400:kworker.0 Request processed in 49us (549us total) trans 0 rc 0/0 00000100:00100000:2.0:1783441461.620534:0:6582:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 56 00000100:00080000:2.0:1783441461.620562:0:5781:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1783441461.620569:0:5781:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1783441461.620571:0:5781:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1783441461.620588:0:5785:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 97 00000100:00100000:3.0:1783441461.620600:0:5785:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a87d6a1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3305:x1870073693259904:12345-0@lo:400:kworker.0 00010000:00080000:2.0:1783441461.620617:0:3305:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff91a8476b2680 x1870073693260032/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1783441477 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1783441461.620638:0:3305:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff91a8476b2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3305:1870073693260032:0@lo:400:kworker.0 00010000:00080000:2.0:1783441461.620687:0:3303:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff91a8476b1180 x1870073693260288/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1783441477 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1783441461.620700:0:3303:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff91a8476b1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3303:1870073693260288:0@lo:400:kworker.0 00000100:00100000:3.0:1783441461.620719:0:5785:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a87d6a1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3305:x1870073693259904:12345-0@lo:400:kworker.0 Request processed in 115us (862us total) trans 0 rc 0/0 00000100:00100000:2.0:1783441461.620724:0:3303:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff91a8476b3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:6c1ddb50-5795-40c6-a2b6-8f58add9da62:3303:1870073693259648:0@lo:400:kworker.0 00000100:00100000:3.0:1783441461.620814:0:5785:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 97 00000100:00100000:2.0:1783441461.620829:0:3305:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff91a8476b1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3305:1870073693259904:0@lo:400:kworker.0 00000100:00100000:1.0:1783441462.125891:0:3306:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1783441462.131300:0:3306:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff91a8756a4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3306:1870073693260416:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1783441462.131385:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783441462.131566:0:6585:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073693260416 00000100:00100000:2.0:1783441462.131574:0:6585:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073693260416 00000100:00100000:2.0:1783441462.131632:0:6585:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 44 00000100:00100000:2.0:1783441462.131642:0:6585:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a87d4dd500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3306:x1870073693260416:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1783441462.131687:0:6585:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3858759680 avail 3856662528 00000100:00100000:2.0:1783441462.131767:0:6585:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a87d4dd500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3306:x1870073693260416:12345-0@lo:13:osp-pre-1-0.0 Request processed in 126us (381us total) trans 0 rc 0/0 00000100:00100000:2.0:1783441462.131804:0:6585:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 44 00010000:00080000:2.0:1783441462.132170:0:3306:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff91a8756a4e00 x1870073693260416/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1783441478 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1783441462.132194:0:3306:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff91a8756a4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3306:1870073693260416:0@lo:13:osp-pre-1-0.0 00010000:00010000:3.0:1783441462.384135:0:5772:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1783441463.151894:0:3306:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff91a8476b3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3306:1870073693260544:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1783441463.152010:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783441463.152112:0:6585:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073693260544 00000100:00100000:3.0:1783441463.152122:0:6585:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073693260544 00000100:00100000:3.0:1783441463.152204:0:6585:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 45 00000100:00100000:3.0:1783441463.152214:0:6585:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a8476b1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3306:x1870073693260544:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1783441463.152263:0:6585:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1783441463.152321:0:6585:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a8476b1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3306:x1870073693260544:12345-0@lo:13:osp-pre-0-0.0 Request processed in 108us (311us total) trans 0 rc 0/0 00000100:00100000:3.0:1783441463.152329:0:6585:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 45 00010000:00080000:3.0:1783441463.152383:0:3306:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff91a8476b3b80 x1870073693260544/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1783441479 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1783441463.152404:0:3306:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff91a8476b3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3306:1870073693260544:0@lo:13:osp-pre-0-0.0 00000100:00080000:1.0:1783441463.152490:0:5781:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1783441463.155093:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.13@tcp (source: 12345-192.168.201.13@tcp) 00000100:00100000:1.0:1783441463.155135:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.13@tcp (source: 12345-192.168.201.13@tcp) 00000100:00100000:1.0:1783441463.155171:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.13@tcp (source: 12345-192.168.201.13@tcp) 00000100:00100000:1.0:1783441463.155207:0:5780:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073673300608 00000100:00100000:1.0:1783441463.155218:0:5780:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073673300608 00000100:00100000:1.0:1783441463.155285:0:5780:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.13@tcp, seq: 231 00000100:00100000:1.0:1783441463.155298:0:5780:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a848f37c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:51c2a82e-e792-4f56-84e8-12cc033e9e70+13:2354:x1870073673300608:12345-192.168.201.13@tcp:400:kworker.0 00000100:00100000:1.0:1783441463.155388:0:5780:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a848f37c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:51c2a82e-e792-4f56-84e8-12cc033e9e70+13:2354:x1870073673300608:12345-192.168.201.13@tcp:400:kworker.0 Request processed in 91us (250us total) trans 0 rc 0/0 00000100:00100000:1.0:1783441463.155411:0:5780:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.13@tcp, seq: 231 00000100:00100000:3.0:1783441463.155606:0:5787:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073673300736 00000100:00100000:3.0:1783441463.155611:0:5787:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073673300736 00000100:00100000:3.0:1783441463.155668:0:5787:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073673300864 00000100:00100000:3.0:1783441463.155672:0:5787:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073673300864 00000100:00100000:3.0:1783441463.155696:0:5787:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.13@tcp, seq: 98 00000100:00100000:3.0:1783441463.155704:0:5787:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a87d4dc380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:65454767-383a-4679-a788-eba05c6e0989+6:2354:x1870073673300736:12345-192.168.201.13@tcp:400:kworker.0 00000100:00100000:3.0:1783441463.155777:0:5787:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a87d4dc380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:65454767-383a-4679-a788-eba05c6e0989+6:2354:x1870073673300736:12345-192.168.201.13@tcp:400:kworker.0 Request processed in 74us (710us total) trans 0 rc 0/0 00000100:00100000:3.0:1783441463.155785:0:5787:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.13@tcp, seq: 98 00000100:00100000:3.0:1783441463.155800:0:5787:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.13@tcp, seq: 99 00000100:00100000:3.0:1783441463.155807:0:5787:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a87d4df480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d5aa2a25-c618-49e9-a833-85b3b4747e53+5:2354:x1870073673300864:12345-192.168.201.13@tcp:400:kworker.0 00000100:00100000:3.0:1783441463.155881:0:5787:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a87d4df480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d5aa2a25-c618-49e9-a833-85b3b4747e53+5:2354:x1870073673300864:12345-192.168.201.13@tcp:400:kworker.0 Request processed in 74us (709us total) trans 0 rc 0/0 00000100:00100000:3.0:1783441463.155889:0:5787:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.13@tcp, seq: 99 00000100:00080000:1.0:1783441463.156654:0:5781:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:3.0:1783441463.404915:0:5773:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783441464.429525:0:5772:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:0.0:1783441464.691031:0:11013:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007ffc21245b40 20000000:00000080:0.0:1783441464.691048:0:11013:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff91a746e28c00 uarg=0000000000000000 20000000:01000000:0.0:1783441464.691084:0:11013:0:(mgs_llog.c:6188:mgs_set_param2()) set_param2 fs='' device='general' param='lod.*.mdt_hash=crush' 20000000:01000000:0.0:1783441464.691091:0:11013:0:(mgs_llog.c:4643:mgs_write_log_param2()) next param 'lod.*.mdt_hash=crush' 20000000:01000000:0.0:1783441464.691095:0:11013:0:(mgs_llog.c:1379:mgs_modify_param()) modify params/general/lod.*.mdt_hash=crush del=0 00000040:00080000:1.0:1783441464.692674:0:11014:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 5 count 7 20000000:00000400:0.0:1783441464.692866:0:11013:0:(mgs_llog.c:1450:mgs_modify_param()) MGS: modify general/lod.*.mdt_hash=crush (mode = 0) failed: rc = -17 10000000:01000000:0.0:1783441464.704546:0:11013:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 00010000:00010000:0.0:1783441464.704584:0:11013:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff91a85fe58c00/0xa2426164df2c7831 lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 11013 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783441464.704607:0:11013:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff91a87da47400/0xa2426164df2c77d6 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 192.168.201.13@tcp remote: 0x633a354aa4df4ca9 expref: 12 pid: 5778 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783441464.704615:0:11013:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff91a85eb3d600/0xa2426164df2c77e4 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xa2426164df2c77dd expref: 18 pid: 5780 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783441464.704622:0:11013:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff91a85fe59600/0xa2426164df2c77f2 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xa2426164df2c77eb expref: 18 pid: 5778 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783441464.704646:0:11013:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff91a85fe58000/0xa2426164df2c7800 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xa2426164df2c77f9 expref: 18 pid: 5779 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783441464.704654:0:11013:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff91a85fe59a00/0xa2426164df2c7815 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 192.168.201.13@tcp remote: 0x633a354aa4df4ce1 expref: 12 pid: 5778 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783441464.704663:0:11013:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff91a85fe58c00/0xa2426164df2c7831 lrc: 8/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 11013 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783441464.704718:0:11013:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff91a85fe59a00/0xa2426164df2c7815 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 192.168.201.13@tcp remote: 0x633a354aa4df4ce1 expref: 12 pid: 5778 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783441464.704736:0:11013:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff91a85fe59a00/0xa2426164df2c7815 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 192.168.201.13@tcp remote: 0x633a354aa4df4ce1 expref: 12 pid: 5778 timeout: 402 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783441464.704781:0:11013:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff91a8756a4e00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11013:1870073693260672:192.168.201.13@tcp:104: 00010000:00010000:0.0:1783441464.704934:0:11013:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff91a85fe58000/0xa2426164df2c7800 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xa2426164df2c77f9 expref: 18 pid: 5779 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783441464.704944:0:11013:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff91a85fe58000/0xa2426164df2c7800 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xa2426164df2c77f9 expref: 18 pid: 5779 timeout: 452 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783441464.704954:0:11013:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff91a87d804000 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11013:1870073693260800:0@lo:104: 00000100:00100000:0.0:1783441464.704999:0:11013:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1783441464.705038:0:11013:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff91a85fe59600/0xa2426164df2c77f2 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xa2426164df2c77eb expref: 18 pid: 5778 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783441464.705046:0:11013:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff91a85fe59600/0xa2426164df2c77f2 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xa2426164df2c77eb expref: 18 pid: 5778 timeout: 452 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783441464.705064:0:11013:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff91a87d807480 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11013:1870073693260928:0@lo:104: 00000100:00100000:1.0:1783441464.705086:0:5768:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073693260800 00000100:00100000:0.0:1783441464.705092:0:11013:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783441464.705097:0:5768:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073693260800 00010000:00010000:0.0:1783441464.705117:0:11013:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff91a85eb3d600/0xa2426164df2c77e4 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xa2426164df2c77dd expref: 18 pid: 5780 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783441464.705127:0:11013:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff91a85eb3d600/0xa2426164df2c77e4 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xa2426164df2c77dd expref: 18 pid: 5780 timeout: 452 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783441464.705135:0:11013:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff91a87d806680 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11013:1870073693261056:0@lo:104: 00000100:00100000:1.0:1783441464.705141:0:5768:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073693260928 00000100:00100000:1.0:1783441464.705145:0:5768:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073693260928 00000100:00100000:0.0:1783441464.705160:0:11013:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783441464.705165:0:5768:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:1.0:1783441464.705176:0:5768:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a87d804380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:6c1ddb50-5795-40c6-a2b6-8f58add9da62+4:11013:x1870073693260800:12345-0@lo:104: 00010000:00010000:0.0:1783441464.705182:0:11013:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff91a87da47400/0xa2426164df2c77d6 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 192.168.201.13@tcp remote: 0x633a354aa4df4ca9 expref: 12 pid: 5778 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783441464.705191:0:5768:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.113@tcp lock: ffff91a85fe58800/0xa2426164df2c77f9 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xa2426164df2c7800 expref: -99 pid: 5783 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783441464.705192:0:11013:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff91a87da47400/0xa2426164df2c77d6 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 192.168.201.13@tcp remote: 0x633a354aa4df4ca9 expref: 12 pid: 5778 timeout: 402 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783441464.705216:0:11013:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff91a87d805180 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11013:1870073693261184:192.168.201.13@tcp:104: 00010000:00010000:1.0:1783441464.705410:0:5768:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:1.0:1783441464.705417:0:5768:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a87d804380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:6c1ddb50-5795-40c6-a2b6-8f58add9da62+4:11013:x1870073693260800:12345-0@lo:104: Request processed in 243us (418us total) trans 0 rc 0/0 00000100:00100000:1.0:1783441464.705425:0:5768:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:1.0:1783441464.705446:0:5768:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073693261056 00000100:00100000:1.0:1783441464.705449:0:5768:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073693261056 00000100:00100000:1.0:1783441464.705463:0:5768:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:1.0:1783441464.705469:0:5768:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a87d805880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:6c1ddb50-5795-40c6-a2b6-8f58add9da62+4:11013:x1870073693260928:12345-0@lo:104: 00010000:00010000:1.0:1783441464.705478:0:5768:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.113@tcp lock: ffff91a840030200/0xa2426164df2c77eb lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xa2426164df2c77f2 expref: -99 pid: 5783 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783441464.705517:0:5768:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:1.0:1783441464.705522:0:5768:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a87d805880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:6c1ddb50-5795-40c6-a2b6-8f58add9da62+4:11013:x1870073693260928:12345-0@lo:104: Request processed in 54us (432us total) trans 0 rc 0/0 00000100:00100000:1.0:1783441464.705529:0:5768:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00100000:1.0:1783441464.705543:0:5768:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:1.0:1783441464.705557:0:5768:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a87d807b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:6c1ddb50-5795-40c6-a2b6-8f58add9da62+3:11013:x1870073693261056:12345-0@lo:104: 00010000:00010000:1.0:1783441464.705565:0:5768:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.113@tcp lock: ffff91a840031a00/0xa2426164df2c77dd lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xa2426164df2c77e4 expref: -99 pid: 5783 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783441464.705595:0:5768:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to priority blp list, 3 blwis in pool 00000100:00100000:1.0:1783441464.705600:0:5768:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a87d807b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:6c1ddb50-5795-40c6-a2b6-8f58add9da62+3:11013:x1870073693261056:12345-0@lo:104: Request processed in 45us (441us total) trans 0 rc 0/0 00000100:00100000:1.0:1783441464.705606:0:5768:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00010000:00010000:1.0:1783441464.705623:0:5773:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:1.0:1783441464.705630:0:5773:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.113@tcp lock: ffff91a85fe58800/0xa2426164df2c77f9 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xa2426164df2c7800 expref: -99 pid: 5783 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783441464.705637:0:5773:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91a85fe58800 already unused, calling callback (ffffffffc1b78c20) 10000000:00010000:1.0:1783441464.705642:0:5773:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.113@tcp lock: ffff91a85fe58800/0xa2426164df2c77f9 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0xa2426164df2c7800 expref: -99 pid: 5783 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783441464.705650:0:5773:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.113@tcp lock: ffff91a85fe58800/0xa2426164df2c77f9 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0xa2426164df2c7800 expref: -99 pid: 5783 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1783441464.705658:0:5773:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.113@tcp lock: ffff91a85fe58800/0xa2426164df2c77f9 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0xa2426164df2c7800 expref: -99 pid: 5783 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1783441464.705663:0:5773:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:1.0:1783441464.705872:0:5773:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.113@tcp lock: ffff91a85fe58800/0xa2426164df2c77f9 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xa2426164df2c7800 expref: -99 pid: 5783 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783441464.705881:0:5773:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1783441464.705904:0:5773:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.113@tcp lock: ffff91a85fe58800/0xa2426164df2c77f9 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xa2426164df2c7800 expref: -99 pid: 5783 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783441464.705923:0:5773:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.113@tcp lock: ffff91a85fe58800/0xa2426164df2c77f9 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xa2426164df2c7800 expref: -99 pid: 5783 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783441464.705938:0:5773:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1783441464.705941:0:5773:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.113@tcp lock: ffff91a840030200/0xa2426164df2c77eb lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xa2426164df2c77f2 expref: -99 pid: 5783 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783441464.705947:0:5773:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91a840030200 already unused, calling callback (ffffffffc1b78c20) 10000000:00010000:1.0:1783441464.705951:0:5773:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.113@tcp lock: ffff91a840030200/0xa2426164df2c77eb lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0xa2426164df2c77f2 expref: -99 pid: 5783 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783441464.705958:0:5773:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.113@tcp lock: ffff91a840030200/0xa2426164df2c77eb lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0xa2426164df2c77f2 expref: -99 pid: 5783 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1783441464.705965:0:5773:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.113@tcp lock: ffff91a840030200/0xa2426164df2c77eb lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0xa2426164df2c77f2 expref: -99 pid: 5783 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1783441464.705971:0:5773:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00000100:00100000:3.0:1783441464.706086:0:3303:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff91a87d4dd880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:6c1ddb50-5795-40c6-a2b6-8f58add9da62:3303:1870073693261312:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1783441464.706130:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783441464.707003:0:11013:0:(client.c:2702:ptlrpc_set_wait()) set ffff91a848552540 going to sleep for 11 seconds 00000100:00100000:0.0:1783441464.707028:0:11013:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff91a87d804000 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11013:1870073693260800:0@lo:104: 00000100:00100000:0.0:1783441464.707036:0:11013:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff91a87d807480 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11013:1870073693260928:0@lo:104: 00000100:00100000:0.0:1783441464.707043:0:11013:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff91a87d806680 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11013:1870073693261056:0@lo:104: 00000100:00100000:2.0:1783441464.707863:0:5771:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073693261312 00000100:00100000:2.0:1783441464.707873:0:5771:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073693261312 00010000:00010000:2.0:1783441464.707910:0:5771:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff91a85fe58000/0xa2426164df2c7800 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xa2426164df2c77f9 expref: 19 pid: 5779 timeout: 452 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783441464.707950:0:5771:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:2.0:1783441464.707959:0:5771:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a84545a850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:6c1ddb50-5795-40c6-a2b6-8f58add9da62+19:3303:x1870073693261312:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1783441464.707974:0:5771:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1783441464.707980:0:5771:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff91a85fe58000/0xa2426164df2c7800 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xa2426164df2c77f9 expref: 19 pid: 5779 timeout: 452 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783441464.707991:0:5771:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff91a85fe58000/0xa2426164df2c7800 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xa2426164df2c77f9 expref: 19 pid: 5779 timeout: 452 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783441464.707999:0:5773:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.113@tcp lock: ffff91a840030200/0xa2426164df2c77eb lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xa2426164df2c77f2 expref: -99 pid: 5783 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783441464.708007:0:5771:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff91a85fe58000/0xa2426164df2c7800 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xa2426164df2c77f9 expref: 19 pid: 5779 timeout: 452 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783441464.708011:0:5773:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1783441464.708025:0:5771:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1783441464.708035:0:5773:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.113@tcp lock: ffff91a840030200/0xa2426164df2c77eb lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xa2426164df2c77f2 expref: -99 pid: 5783 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783441464.708045:0:5773:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.113@tcp lock: ffff91a840030200/0xa2426164df2c77eb lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xa2426164df2c77f2 expref: -99 pid: 5783 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783441464.708060:0:5773:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1783441464.708075:0:5773:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.113@tcp lock: ffff91a840031a00/0xa2426164df2c77dd lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xa2426164df2c77e4 expref: -99 pid: 5783 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783441464.708082:0:5773:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91a840031a00 already unused, calling callback (ffffffffc1b78c20) 10000000:00010000:1.0:1783441464.708086:0:5773:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.113@tcp lock: ffff91a840031a00/0xa2426164df2c77dd lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xa2426164df2c77e4 expref: -99 pid: 5783 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783441464.708095:0:5773:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.113@tcp lock: ffff91a840031a00/0xa2426164df2c77dd lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xa2426164df2c77e4 expref: -99 pid: 5783 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1783441464.708102:0:5773:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.113@tcp lock: ffff91a840031a00/0xa2426164df2c77dd lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xa2426164df2c77e4 expref: -99 pid: 5783 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1783441464.708108:0:5773:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00000100:00100000:2.0:1783441464.708154:0:5771:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a84545a850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:6c1ddb50-5795-40c6-a2b6-8f58add9da62+18:3303:x1870073693261312:12345-0@lo:103:ldlm_bl.0 Request processed in 195us (2023us total) trans 0 rc 0/0 00000100:00100000:2.0:1783441464.708162:0:5771:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00010000:00010000:2.0:1783441464.709041:0:5772:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1783441464.709149:0:3304:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff91a87d4de680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:6c1ddb50-5795-40c6-a2b6-8f58add9da62:3304:1870073693261440:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1783441464.709219:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783441464.711144:0:3303:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff91a87d4dd880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:6c1ddb50-5795-40c6-a2b6-8f58add9da62:3303:1870073693261312:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1783441464.711572:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.13@tcp (source: 12345-192.168.201.13@tcp) 00000100:00100000:2.0:1783441464.711622:0:5770:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073693261440 00000100:00100000:2.0:1783441464.711629:0:5770:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073693261440 00010000:00010000:2.0:1783441464.711674:0:5770:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff91a85fe59600/0xa2426164df2c77f2 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xa2426164df2c77eb expref: 18 pid: 5778 timeout: 452 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783441464.711701:0:5770:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073673300992 00000100:00100000:2.0:1783441464.711703:0:5770:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073673300992 00010000:00010000:2.0:1783441464.711713:0:5770:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff91a85fe59a00/0xa2426164df2c7815 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 192.168.201.13@tcp remote: 0x633a354aa4df4ce1 expref: 13 pid: 5778 timeout: 402 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783441464.711719:0:11013:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff91a8756a4e00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11013:1870073693260672:192.168.201.13@tcp:104: 00000100:00100000:2.0:1783441464.711727:0:5770:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00010000:00010000:1.0:1783441464.711733:0:5773:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.113@tcp lock: ffff91a840031a00/0xa2426164df2c77dd lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xa2426164df2c77e4 expref: -99 pid: 5783 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783441464.711734:0:5770:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a87d806d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:6c1ddb50-5795-40c6-a2b6-8f58add9da62+18:3304:x1870073693261440:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1783441464.711766:0:5770:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1783441464.711770:0:5773:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1783441464.711773:0:5770:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff91a85fe59600/0xa2426164df2c77f2 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xa2426164df2c77eb expref: 18 pid: 5778 timeout: 452 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783441464.711784:0:5770:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff91a85fe59600/0xa2426164df2c77f2 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xa2426164df2c77eb expref: 18 pid: 5778 timeout: 452 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783441464.711798:0:5770:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff91a85fe59600/0xa2426164df2c77f2 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xa2426164df2c77eb expref: 18 pid: 5778 timeout: 452 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783441464.711800:0:5773:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.113@tcp lock: ffff91a840031a00/0xa2426164df2c77dd lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xa2426164df2c77e4 expref: -99 pid: 5783 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783441464.711823:0:5773:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.113@tcp lock: ffff91a840031a00/0xa2426164df2c77dd lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xa2426164df2c77e4 expref: -99 pid: 5783 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783441464.711828:0:5770:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1783441464.711832:0:11013:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff91a87d805180 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11013:1870073693261184:192.168.201.13@tcp:104: 00000100:00100000:1.0:1783441464.711852:0:3305:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff91a87d4dfb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:6c1ddb50-5795-40c6-a2b6-8f58add9da62:3305:1870073693261568:0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1783441464.711874:0:11013:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff91a85fe58c00/0xa2426164df2c7831 lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 11013 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783441464.711885:0:5770:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a87d806d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:6c1ddb50-5795-40c6-a2b6-8f58add9da62+17:3304:x1870073693261440:12345-0@lo:103:ldlm_bl.0 Request processed in 149us (2665us total) trans 0 rc 0/0 00000100:00100000:2.0:1783441464.711896:0:5770:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:1.0:1783441464.711897:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783441464.711918:0:5770:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073693261568 00000100:00100000:2.0:1783441464.711923:0:5770:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073693261568 00010000:00010000:2.0:1783441464.711938:0:5770:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff91a85eb3d600/0xa2426164df2c77e4 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xa2426164df2c77dd expref: 17 pid: 5780 timeout: 452 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783441464.711949:0:5769:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.13@tcp, seq: 27 00000100:00100000:2.0:1783441464.711962:0:5770:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 3 min 3 max 56 00000100:00100000:2.0:1783441464.711971:0:5770:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cn00_003' 00000100:00100000:1.0:1783441464.711972:0:5769:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a8476b3b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:51c2a82e-e792-4f56-84e8-12cc033e9e70+13:2354:x1870073673300992:12345-192.168.201.13@tcp:103:ldlm_bl.0 00000100:00100000:2.0:1783441464.712003:0:5771:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 3 min 3 max 56 00000100:00100000:2.0:1783441464.712015:0:5771:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:2.0:1783441464.712023:0:5771:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a87d4dd180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:6c1ddb50-5795-40c6-a2b6-8f58add9da62+17:3305:x1870073693261568:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1783441464.712032:0:5771:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1783441464.712037:0:5771:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff91a85eb3d600/0xa2426164df2c77e4 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xa2426164df2c77dd expref: 17 pid: 5780 timeout: 452 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783441464.712055:0:5771:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff91a85eb3d600/0xa2426164df2c77e4 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xa2426164df2c77dd expref: 17 pid: 5780 timeout: 452 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783441464.712064:0:5771:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff91a85eb3d600/0xa2426164df2c77e4 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xa2426164df2c77dd expref: 17 pid: 5780 timeout: 452 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783441464.712071:0:5771:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1783441464.712096:0:5771:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a87d4dd180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:6c1ddb50-5795-40c6-a2b6-8f58add9da62+16:3305:x1870073693261568:12345-0@lo:103:ldlm_bl.0 Request processed in 74us (204us total) trans 0 rc 0/0 00000100:00100000:2.0:1783441464.712101:0:5771:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00100000:2.0:1783441464.712124:0:3304:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff91a87d4de680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:6c1ddb50-5795-40c6-a2b6-8f58add9da62:3304:1870073693261440:0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1783441464.712142:0:5769:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1783441464.712155:0:5769:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff91a85fe59a00/0xa2426164df2c7815 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 192.168.201.13@tcp remote: 0x633a354aa4df4ce1 expref: 13 pid: 5778 timeout: 402 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783441464.712166:0:5769:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff91a85fe59a00/0xa2426164df2c7815 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 192.168.201.13@tcp remote: 0x633a354aa4df4ce1 expref: 13 pid: 5778 timeout: 402 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783441464.712177:0:5769:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff91a85fe59a00/0xa2426164df2c7815 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 192.168.201.13@tcp remote: 0x633a354aa4df4ce1 expref: 13 pid: 5778 timeout: 402 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783441464.712185:0:5769:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1783441464.712227:0:5769:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a8476b3b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:51c2a82e-e792-4f56-84e8-12cc033e9e70+12:2354:x1870073673300992:12345-192.168.201.13@tcp:103:ldlm_bl.0 Request processed in 270us (658us total) trans 0 rc 0/0 00000100:00100000:1.0:1783441464.712234:0:5769:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.13@tcp, seq: 27 00000100:00100000:1.0:1783441464.712267:0:3305:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff91a87d4dfb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:6c1ddb50-5795-40c6-a2b6-8f58add9da62:3305:1870073693261568:0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1783441464.712282:0:5773:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783441464.712284:0:5773:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783441464.712286:0:5773:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1783441464.719163:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.13@tcp (source: 12345-192.168.201.13@tcp) 00000100:00100000:2.0:1783441464.722140:0:5771:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073673301120 00000100:00100000:2.0:1783441464.722155:0:5771:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073673301120 00010000:00010000:2.0:1783441464.722204:0:5771:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff91a87da47400/0xa2426164df2c77d6 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 192.168.201.13@tcp remote: 0x633a354aa4df4ca9 expref: 12 pid: 5778 timeout: 402 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783441464.722299:0:5771:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.13@tcp, seq: 29 00000100:00100000:2.0:1783441464.722310:0:5771:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a87d4dfb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:51c2a82e-e792-4f56-84e8-12cc033e9e70+12:2355:x1870073673301120:12345-192.168.201.13@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1783441464.722327:0:5771:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1783441464.722333:0:5771:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff91a87da47400/0xa2426164df2c77d6 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.201.13@tcp remote: 0x633a354aa4df4ca9 expref: 12 pid: 5778 timeout: 402 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783441464.722366:0:5771:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff91a87da47400/0xa2426164df2c77d6 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 192.168.201.13@tcp remote: 0x633a354aa4df4ca9 expref: 12 pid: 5778 timeout: 402 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783441464.722384:0:5771:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff91a87da47400/0xa2426164df2c77d6 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 192.168.201.13@tcp remote: 0x633a354aa4df4ca9 expref: 12 pid: 5778 timeout: 402 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783441464.722403:0:5771:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff91a85fe58c00/0xa2426164df2c7831 lrc: 3/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 11013 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783441464.722412:0:5771:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff91a85fe58c00/0xa2426164df2c7831 lrc: 4/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 11013 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783441464.722429:0:5771:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff91a85fe58c00/0xa2426164df2c7831 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 11013 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783441464.722437:0:5771:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff91a85fe58c00/0xa2426164df2c7831 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 11013 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783441464.722444:0:5771:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff91a85fe58c00/0xa2426164df2c7831 lrc: 4/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 11013 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783441464.722451:0:5771:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff91a85fe58c00/0xa2426164df2c7831 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 11013 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783441464.722457:0:5771:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91a85fe58c00 already unused, calling callback (ffffffffc155ff90) 00010000:00010000:2.0:1783441464.722462:0:5771:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff91a85fe58c00/0xa2426164df2c7831 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 11013 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783441464.722471:0:5771:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff91a85fe58c00/0xa2426164df2c7831 lrc: 6/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 11013 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783441464.722502:0:5771:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff91a85fe58c00/0xa2426164df2c7831 lrc: 4/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 11013 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783441464.722514:0:5771:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1783441464.722584:0:5771:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a87d4dfb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:51c2a82e-e792-4f56-84e8-12cc033e9e70+11:2355:x1870073673301120:12345-192.168.201.13@tcp:103:ldlm_bl.0 Request processed in 275us (3431us total) trans 0 rc 0/0 00000100:00100000:2.0:1783441464.722592:0:5771:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.13@tcp, seq: 29 00010000:00010000:0.0:1783441464.722732:0:11013:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff91a85fe58c00/0xa2426164df2c7831 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 11013 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783441464.722765:0:11013:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff91a85fe58c00/0xa2426164df2c7831 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 11013 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783441464.722772:0:11013:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff91a85fe58c00/0xa2426164df2c7831 lrc: 0/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 11013 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783441465.453046:0:5772:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783441466.483015:0:5773:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:0.0:1783441466.607225:0:5783:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:0.0:1783441466.607233:0:5783:0:(mgc_request.c:1801:mgc_process_log()) Process log params-ffff91a875566000 from 7 10000000:01000000:0.0:1783441466.607238:0:5783:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:0.0:1783441466.607289:0:5783:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.113@tcp lock: ffff91a85fe58e00/0xa2426164df2c7838 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5783 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783441466.607302:0:5783:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.113@tcp lock: ffff91a85fe58e00/0xa2426164df2c7838 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5783 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783441466.607315:0:5783:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.113@tcp lock: ffff91a85fe58e00/0xa2426164df2c7838 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5783 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783441466.607339:0:5783:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff91a87d805180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6c1ddb50-5795-40c6-a2b6-8f58add9da62:5783:1870073693261696:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1783441466.607418:0:5783:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783441466.607464:0:5783:0:(client.c:2702:ptlrpc_set_wait()) set ffff91a8485529c0 going to sleep for 11 seconds 00000100:00100000:0.0:1783441466.607497:0:5778:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073693261696 00000100:00100000:0.0:1783441466.607504:0:5778:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073693261696 00000100:00100000:0.0:1783441466.607560:0:5778:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 232 00000100:00100000:0.0:1783441466.607568:0:5778:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a848f36050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6c1ddb50-5795-40c6-a2b6-8f58add9da62+16:5783:x1870073693261696:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1783441466.607581:0:5778:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1783441466.607594:0:5778:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff91a85fe58c00/0xa2426164df2c783f lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xa2426164df2c7838 expref: -99 pid: 5778 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783441466.607616:0:5778:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff91a85fe58c00/0xa2426164df2c783f lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xa2426164df2c7838 expref: 17 pid: 5778 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783441466.607627:0:5778:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff91a85fe58c00/0xa2426164df2c783f lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xa2426164df2c7838 expref: 17 pid: 5778 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783441466.607636:0:5778:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91a85fe58c00, rc 0) 00000100:00100000:0.0:1783441466.607669:0:5778:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a848f36050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6c1ddb50-5795-40c6-a2b6-8f58add9da62+17:5783:x1870073693261696:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 102us (252us total) trans 0 rc 0/0 00000100:00100000:0.0:1783441466.607675:0:5778:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 232 00000100:00100000:0.0:1783441466.607729:0:5783:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff91a87d805180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6c1ddb50-5795-40c6-a2b6-8f58add9da62:5783:1870073693261696:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1783441466.607756:0:5783:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.113@tcp lock: ffff91a85fe58e00/0xa2426164df2c7838 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xa2426164df2c783f expref: -99 pid: 5783 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783441466.607766:0:5783:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.113@tcp lock: ffff91a85fe58e00/0xa2426164df2c7838 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xa2426164df2c783f expref: -99 pid: 5783 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783441466.608072:0:5783:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff91a87d805180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6c1ddb50-5795-40c6-a2b6-8f58add9da62:5783:1870073693261824:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1783441466.608098:0:5783:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783441466.608116:0:5783:0:(client.c:2702:ptlrpc_set_wait()) set ffff91a8485529c0 going to sleep for 11 seconds 00000100:00100000:0.0:1783441466.608130:0:5779:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073693261824 00000100:00100000:0.0:1783441466.608133:0:5779:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073693261824 00000100:00100000:0.0:1783441466.608163:0:5779:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 233 00000100:00100000:0.0:1783441466.608169:0:5779:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a848f37850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6c1ddb50-5795-40c6-a2b6-8f58add9da62+17:5783:x1870073693261824:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1783441466.608457:0:5779:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a848f37850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6c1ddb50-5795-40c6-a2b6-8f58add9da62+17:5783:x1870073693261824:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 286us (357us total) trans 0 rc 0/0 00000100:00100000:0.0:1783441466.608464:0:5779:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 233 00000100:00100000:0.0:1783441466.608496:0:5783:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff91a87d805180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6c1ddb50-5795-40c6-a2b6-8f58add9da62:5783:1870073693261824:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1783441466.608522:0:5783:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff91a87d805180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6c1ddb50-5795-40c6-a2b6-8f58add9da62:5783:1870073693261952:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1783441466.608555:0:5783:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783441466.608565:0:5783:0:(client.c:2702:ptlrpc_set_wait()) set ffff91a8485529c0 going to sleep for 11 seconds 00000100:00100000:0.0:1783441466.608577:0:5780:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073693261952 00000100:00100000:0.0:1783441466.608580:0:5780:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073693261952 00000100:00100000:0.0:1783441466.608598:0:5780:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 234 00000100:00100000:0.0:1783441466.608604:0:5780:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a848f36850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6c1ddb50-5795-40c6-a2b6-8f58add9da62+17:5783:x1870073693261952:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1783441466.608758:0:5780:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a848f36850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6c1ddb50-5795-40c6-a2b6-8f58add9da62+17:5783:x1870073693261952:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 135us (184us total) trans 0 rc 0/0 00000100:00100000:0.0:1783441466.608765:0:5780:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 234 00000100:00100000:0.0:1783441466.609026:0:5783:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff91a87d805180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6c1ddb50-5795-40c6-a2b6-8f58add9da62:5783:1870073693261952:0@lo:503:ll_cfg_requeue.0 00000040:00080000:3.0:1783441466.615505:0:11071:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 7 00000020:01000000:2.0:1783441466.616039:0:5783:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 7-6 (rc=0) 10000000:01000000:2.0:1783441466.616062:0:5783:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.201.113@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:2.0:1783441466.616073:0:5783:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.113@tcp lock: ffff91a85fe58e00/0xa2426164df2c7838 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xa2426164df2c783f expref: -99 pid: 5783 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783441466.616085:0:5783:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.113@tcp lock: ffff91a85fe58e00/0xa2426164df2c7838 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xa2426164df2c783f expref: -99 pid: 5783 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1783441466.616108:0:5783:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:2.0:1783441466.616111:0:5783:0:(mgc_request.c:1801:mgc_process_log()) Process log params-ffff91a867cf2000 from 7 10000000:01000000:2.0:1783441466.616114:0:5783:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:2.0:1783441466.616158:0:5783:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.113@tcp lock: ffff91a85f83ca00/0xa2426164df2c7846 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5783 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783441466.616165:0:5783:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.113@tcp lock: ffff91a85f83ca00/0xa2426164df2c7846 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5783 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783441466.616176:0:5783:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.113@tcp lock: ffff91a85f83ca00/0xa2426164df2c7846 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5783 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783441466.616200:0:5783:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff91a87d6a3100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6c1ddb50-5795-40c6-a2b6-8f58add9da62:5783:1870073693262080:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1783441466.616279:0:5783:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783441466.616323:0:5783:0:(client.c:2702:ptlrpc_set_wait()) set ffff91a875345c00 going to sleep for 11 seconds 00000100:00100000:0.0:1783441466.616329:0:5778:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073693262080 00000100:00100000:0.0:1783441466.616336:0:5778:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073693262080 00000100:00100000:0.0:1783441466.616402:0:5778:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 235 00000100:00100000:0.0:1783441466.616412:0:5778:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a848f35450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6c1ddb50-5795-40c6-a2b6-8f58add9da62+17:5783:x1870073693262080:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1783441466.616428:0:5778:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1783441466.616449:0:5778:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff91a85fe59600/0xa2426164df2c784d lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xa2426164df2c7846 expref: -99 pid: 5778 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783441466.616483:0:5778:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff91a85fe59600/0xa2426164df2c784d lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xa2426164df2c7846 expref: 18 pid: 5778 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783441466.616494:0:5778:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff91a85fe59600/0xa2426164df2c784d lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xa2426164df2c7846 expref: 18 pid: 5778 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783441466.616504:0:5778:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91a85fe59600, rc 0) 00000100:00100000:0.0:1783441466.616550:0:5778:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a848f35450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6c1ddb50-5795-40c6-a2b6-8f58add9da62+18:5783:x1870073693262080:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 140us (271us total) trans 0 rc 0/0 00000100:00100000:0.0:1783441466.616557:0:5778:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 235 00000100:00100000:2.0:1783441466.616799:0:5783:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff91a87d6a3100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6c1ddb50-5795-40c6-a2b6-8f58add9da62:5783:1870073693262080:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1783441466.616813:0:5783:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.113@tcp lock: ffff91a85f83ca00/0xa2426164df2c7846 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xa2426164df2c784d expref: -99 pid: 5783 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783441466.616821:0:5783:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.113@tcp lock: ffff91a85f83ca00/0xa2426164df2c7846 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xa2426164df2c784d expref: -99 pid: 5783 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783441466.616881:0:5783:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff91a87d6a3100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6c1ddb50-5795-40c6-a2b6-8f58add9da62:5783:1870073693262208:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1783441466.616916:0:5783:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783441466.616925:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.13@tcp (source: 12345-192.168.201.13@tcp) 00000100:00100000:2.0:1783441466.616933:0:5783:0:(client.c:2702:ptlrpc_set_wait()) set ffff91a875345c00 going to sleep for 11 seconds 00000100:00100000:2.0:1783441466.616946:0:5780:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073693262208 00000100:00100000:2.0:1783441466.616950:0:5780:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073693262208 00000100:00100000:2.0:1783441466.616981:0:5780:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073673301248 00000100:00100000:2.0:1783441466.616984:0:5780:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073673301248 00000100:00100000:2.0:1783441466.617000:0:5780:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 236 00000100:00100000:2.0:1783441466.617006:0:5780:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a848f37050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6c1ddb50-5795-40c6-a2b6-8f58add9da62+18:5783:x1870073693262208:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1783441466.617036:0:5778:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.13@tcp, seq: 237 00000100:00100000:3.0:1783441466.617044:0:5778:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a848f35850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:51c2a82e-e792-4f56-84e8-12cc033e9e70+11:5571:x1870073673301248:12345-192.168.201.13@tcp:101:ll_cfg_requeue.0 00010000:00010000:3.0:1783441466.617051:0:5778:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1783441466.617059:0:5778:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff91a85eb3da00/0xa2426164df2c7854 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x633a354aa4df4d0b expref: -99 pid: 5778 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783441466.617080:0:5778:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff91a85eb3da00/0xa2426164df2c7854 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 192.168.201.13@tcp remote: 0x633a354aa4df4d0b expref: 12 pid: 5778 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783441466.617088:0:5778:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff91a85eb3da00/0xa2426164df2c7854 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 192.168.201.13@tcp remote: 0x633a354aa4df4d0b expref: 12 pid: 5778 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783441466.617095:0:5778:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91a85eb3da00, rc 0) 00000100:00100000:3.0:1783441466.617139:0:5778:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a848f35850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:51c2a82e-e792-4f56-84e8-12cc033e9e70+12:5571:x1870073673301248:12345-192.168.201.13@tcp:101:ll_cfg_requeue.0 Request processed in 96us (215us total) trans 0 rc 0/0 00000100:00100000:3.0:1783441466.617146:0:5778:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.13@tcp, seq: 237 00000100:00100000:2.0:1783441466.617420:0:5780:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a848f37050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6c1ddb50-5795-40c6-a2b6-8f58add9da62+18:5783:x1870073693262208:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 414us (503us total) trans 0 rc 0/0 00000100:00100000:2.0:1783441466.617427:0:5780:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 236 00000100:00100000:3.0:1783441466.620492:0:5783:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff91a87d6a3100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6c1ddb50-5795-40c6-a2b6-8f58add9da62:5783:1870073693262208:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1783441466.620561:0:5783:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff91a8476b0700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6c1ddb50-5795-40c6-a2b6-8f58add9da62:5783:1870073693262336:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1783441466.620628:0:5783:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783441466.620663:0:5783:0:(client.c:2702:ptlrpc_set_wait()) set ffff91a848897d80 going to sleep for 11 seconds 00000100:00100000:3.0:1783441466.620682:0:5778:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073693262336 00000100:00100000:3.0:1783441466.620688:0:5778:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073693262336 00000100:00100000:3.0:1783441466.620730:0:5778:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 238 00000100:00100000:3.0:1783441466.620738:0:5778:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a848f34050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6c1ddb50-5795-40c6-a2b6-8f58add9da62+18:5783:x1870073693262336:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1783441466.620969:0:5778:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a848f34050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6c1ddb50-5795-40c6-a2b6-8f58add9da62+18:5783:x1870073693262336:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 231us (340us total) trans 0 rc 0/0 00000100:00100000:3.0:1783441466.620977:0:5778:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 238 00000100:00100000:3.0:1783441466.621027:0:5783:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff91a8476b0700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6c1ddb50-5795-40c6-a2b6-8f58add9da62:5783:1870073693262336:0@lo:503:ll_cfg_requeue.0 00000040:00080000:1.0:1783441466.623555:0:11072:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 7 00000020:01000000:3.0:1783441466.624645:0:5783:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 7-6 (rc=0) 10000000:01000000:3.0:1783441466.624675:0:5783:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.201.113@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:3.0:1783441466.624711:0:5783:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.113@tcp lock: ffff91a85f83ca00/0xa2426164df2c7846 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xa2426164df2c784d expref: -99 pid: 5783 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783441466.624724:0:5783:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.113@tcp lock: ffff91a85f83ca00/0xa2426164df2c7846 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xa2426164df2c784d expref: -99 pid: 5783 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1783441466.624734:0:5783:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:3.0:1783441466.624738:0:5783:0:(mgc_request.c:1801:mgc_process_log()) Process log params-ffff91a84869e800 from 7 10000000:01000000:3.0:1783441466.624762:0:5783:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:3.0:1783441466.624822:0:5783:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.113@tcp lock: ffff91a85eb3d000/0xa2426164df2c785b lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5783 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783441466.624830:0:5783:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.113@tcp lock: ffff91a85eb3d000/0xa2426164df2c785b lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5783 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783441466.624842:0:5783:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.113@tcp lock: ffff91a85eb3d000/0xa2426164df2c785b lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5783 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783441466.624868:0:5783:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff91a8476b0700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6c1ddb50-5795-40c6-a2b6-8f58add9da62:5783:1870073693262464:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1783441466.624939:0:5783:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783441466.627305:0:5779:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073693262464 00000100:00100000:1.0:1783441466.627321:0:5779:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073693262464 00000100:00100000:1.0:1783441466.627384:0:5779:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 239 00000100:00100000:1.0:1783441466.627395:0:5779:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a848f34450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6c1ddb50-5795-40c6-a2b6-8f58add9da62+18:5783:x1870073693262464:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1783441466.627412:0:5779:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1783441466.627429:0:5779:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff91a87da46400/0xa2426164df2c7862 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0xa2426164df2c785b expref: -99 pid: 5779 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783441466.627457:0:5779:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff91a87da46400/0xa2426164df2c7862 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xa2426164df2c785b expref: 19 pid: 5779 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783441466.627477:0:5779:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff91a87da46400/0xa2426164df2c7862 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xa2426164df2c785b expref: 19 pid: 5779 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783441466.627487:0:5779:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91a87da46400, rc 0) 00000100:00100000:1.0:1783441466.627554:0:5779:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a848f34450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6c1ddb50-5795-40c6-a2b6-8f58add9da62+19:5783:x1870073693262464:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 161us (2616us total) trans 0 rc 0/0 00000100:00100000:1.0:1783441466.627561:0:5779:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 239 00000100:00100000:3.0:1783441466.632328:0:5783:0:(client.c:2702:ptlrpc_set_wait()) set ffff91a842bd2000 going to sleep for 11 seconds 00000100:00100000:3.0:1783441466.632379:0:5783:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff91a8476b0700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6c1ddb50-5795-40c6-a2b6-8f58add9da62:5783:1870073693262464:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1783441466.632405:0:5783:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.113@tcp lock: ffff91a85eb3d000/0xa2426164df2c785b lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xa2426164df2c7862 expref: -99 pid: 5783 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783441466.632418:0:5783:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.113@tcp lock: ffff91a85eb3d000/0xa2426164df2c785b lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0xa2426164df2c7862 expref: -99 pid: 5783 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783441466.632504:0:5783:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff91a8476b0700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6c1ddb50-5795-40c6-a2b6-8f58add9da62:5783:1870073693262592:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1783441466.632592:0:5783:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783441466.632629:0:5783:0:(client.c:2702:ptlrpc_set_wait()) set ffff91a842bd2000 going to sleep for 11 seconds 00000100:00100000:0.0:1783441466.633022:0:5780:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073693262592 00000100:00100000:0.0:1783441466.633030:0:5780:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073693262592 00000100:00100000:0.0:1783441466.633085:0:5780:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 240 00000100:00100000:0.0:1783441466.633097:0:5780:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a848f37450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6c1ddb50-5795-40c6-a2b6-8f58add9da62+19:5783:x1870073693262592:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1783441466.633389:0:5780:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a848f37450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6c1ddb50-5795-40c6-a2b6-8f58add9da62+19:5783:x1870073693262592:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 294us (796us total) trans 0 rc 0/0 00000100:00100000:0.0:1783441466.633398:0:5780:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 240 00000100:00100000:1.0:1783441466.633817:0:5783:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff91a8476b0700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6c1ddb50-5795-40c6-a2b6-8f58add9da62:5783:1870073693262592:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1783441466.633859:0:5783:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff91a87d4de680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6c1ddb50-5795-40c6-a2b6-8f58add9da62:5783:1870073693262720:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1783441466.633910:0:5783:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783441466.633934:0:5783:0:(client.c:2702:ptlrpc_set_wait()) set ffff91a87563b9c0 going to sleep for 11 seconds 00000100:00100000:0.0:1783441466.634048:0:5778:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073693262720 00000100:00100000:0.0:1783441466.634054:0:5778:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073693262720 00000100:00100000:0.0:1783441466.634101:0:5778:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 241 00000100:00100000:0.0:1783441466.634110:0:5778:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a848f35c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6c1ddb50-5795-40c6-a2b6-8f58add9da62+19:5783:x1870073693262720:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1783441466.634266:0:5778:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a848f35c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6c1ddb50-5795-40c6-a2b6-8f58add9da62+19:5783:x1870073693262720:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 157us (355us total) trans 0 rc 0/0 00000100:00100000:0.0:1783441466.634273:0:5778:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 241 00000100:00100000:0.0:1783441466.634446:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.13@tcp (source: 12345-192.168.201.13@tcp) 00000100:00100000:1.0:1783441466.634513:0:5779:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073673301376 00000100:00100000:1.0:1783441466.634517:0:5779:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073673301376 00000100:00100000:1.0:1783441466.634554:0:5779:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.13@tcp, seq: 242 00000100:00100000:1.0:1783441466.634561:0:5779:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a848f35050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:51c2a82e-e792-4f56-84e8-12cc033e9e70+12:5571:x1870073673301376:12345-192.168.201.13@tcp:501:ll_cfg_requeue.0 00000100:00100000:1.0:1783441466.634795:0:5779:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a848f35050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:51c2a82e-e792-4f56-84e8-12cc033e9e70+12:5571:x1870073673301376:12345-192.168.201.13@tcp:501:ll_cfg_requeue.0 Request processed in 233us (350us total) trans 0 rc 0/0 00000100:00100000:1.0:1783441466.634802:0:5779:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.13@tcp, seq: 242 00000100:00100000:1.0:1783441466.634999:0:5783:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff91a87d4de680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6c1ddb50-5795-40c6-a2b6-8f58add9da62:5783:1870073693262720:0@lo:503:ll_cfg_requeue.0 00000040:00080000:1.0:1783441466.636293:0:11073:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 7 00000020:01000000:0.0:1783441466.639878:0:5783:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 7-6 (rc=0) 10000000:01000000:0.0:1783441466.639993:0:5783:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.201.113@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:0.0:1783441466.640006:0:5783:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.113@tcp lock: ffff91a85eb3d000/0xa2426164df2c785b lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xa2426164df2c7862 expref: -99 pid: 5783 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783441466.640019:0:5783:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.113@tcp lock: ffff91a85eb3d000/0xa2426164df2c785b lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xa2426164df2c7862 expref: -99 pid: 5783 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783441466.640500:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.13@tcp (source: 12345-192.168.201.13@tcp) 00000100:00100000:0.0:1783441466.643033:0:5779:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073673301504 00000100:00100000:0.0:1783441466.643046:0:5779:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073673301504 00000100:00100000:0.0:1783441466.643118:0:5779:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.13@tcp, seq: 243 00000100:00100000:0.0:1783441466.643129:0:5779:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a848f34c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:51c2a82e-e792-4f56-84e8-12cc033e9e70+12:5571:x1870073673301504:12345-192.168.201.13@tcp:503:ll_cfg_requeue.0 00000100:00100000:0.0:1783441466.643355:0:5779:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a848f34c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:51c2a82e-e792-4f56-84e8-12cc033e9e70+12:5571:x1870073673301504:12345-192.168.201.13@tcp:503:ll_cfg_requeue.0 Request processed in 227us (2860us total) trans 0 rc 0/0 00000100:00100000:0.0:1783441466.643364:0:5779:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.13@tcp, seq: 243 00000100:00100000:1.0:1783441466.674878:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.13@tcp (source: 12345-192.168.201.13@tcp) 00000100:00100000:3.0:1783441466.675823:0:5780:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073673301632 00000100:00100000:3.0:1783441466.675834:0:5780:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073673301632 00000100:00100000:3.0:1783441466.675899:0:5780:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.13@tcp, seq: 244 00000100:00100000:3.0:1783441466.675909:0:5780:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a8655e5450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:51c2a82e-e792-4f56-84e8-12cc033e9e70+12:5571:x1870073673301632:12345-192.168.201.13@tcp:101:ll_cfg_requeue.0 00010000:00010000:3.0:1783441466.675927:0:5780:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1783441466.675943:0:5780:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff91a85eb3c200/0xa2426164df2c7869 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0x633a354aa4df4d12 expref: -99 pid: 5780 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783441466.675972:0:5780:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff91a85eb3c200/0xa2426164df2c7869 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 192.168.201.13@tcp remote: 0x633a354aa4df4d12 expref: 13 pid: 5780 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783441466.675984:0:5780:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff91a85eb3c200/0xa2426164df2c7869 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 192.168.201.13@tcp remote: 0x633a354aa4df4d12 expref: 13 pid: 5780 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783441466.675994:0:5780:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91a85eb3c200, rc 0) 00000100:00100000:3.0:1783441466.676060:0:5780:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a8655e5450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:51c2a82e-e792-4f56-84e8-12cc033e9e70+13:5571:x1870073673301632:12345-192.168.201.13@tcp:101:ll_cfg_requeue.0 Request processed in 152us (1192us total) trans 0 rc 0/0 00000100:00100000:3.0:1783441466.676069:0:5780:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.13@tcp, seq: 244 00000100:00100000:3.0:1783441466.687316:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.13@tcp (source: 12345-192.168.201.13@tcp) 00000100:00100000:0.0:1783441466.687424:0:5779:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073673301760 00000100:00100000:0.0:1783441466.687434:0:5779:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073673301760 00000100:00100000:0.0:1783441466.687530:0:5779:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.13@tcp, seq: 245 00000100:00100000:0.0:1783441466.687569:0:5779:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a8655e5850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:51c2a82e-e792-4f56-84e8-12cc033e9e70+13:5571:x1870073673301760:12345-192.168.201.13@tcp:501:ll_cfg_requeue.0 00000100:00100000:0.0:1783441466.687904:0:5779:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a8655e5850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:51c2a82e-e792-4f56-84e8-12cc033e9e70+13:5571:x1870073673301760:12345-192.168.201.13@tcp:501:ll_cfg_requeue.0 Request processed in 363us (596us total) trans 0 rc 0/0 00000100:00100000:0.0:1783441466.687912:0:5779:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.13@tcp, seq: 245 00000100:00100000:1.0:1783441466.695356:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.13@tcp (source: 12345-192.168.201.13@tcp) 00000100:00100000:0.0:1783441466.695451:0:5778:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073673301888 00000100:00100000:0.0:1783441466.695461:0:5778:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073673301888 00000100:00100000:0.0:1783441466.695519:0:5778:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.13@tcp, seq: 246 00000100:00100000:0.0:1783441466.695529:0:5778:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a8655e7050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:51c2a82e-e792-4f56-84e8-12cc033e9e70+13:5571:x1870073673301888:12345-192.168.201.13@tcp:503:ll_cfg_requeue.0 00000100:00100000:0.0:1783441466.696667:0:5778:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a8655e7050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:51c2a82e-e792-4f56-84e8-12cc033e9e70+13:5571:x1870073673301888:12345-192.168.201.13@tcp:503:ll_cfg_requeue.0 Request processed in 265us (449us total) trans 0 rc 0/0 00000100:00100000:0.0:1783441466.696689:0:5778:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.13@tcp, seq: 246 00000100:00100000:2.0:1783441466.733050:0:3305:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff91a8476b1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3305:1870073693263232:0@lo:400:kworker.0 00000100:00100000:2.0:1783441466.733125:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783441466.733195:0:3305:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:2.0:1783441466.733201:0:3305:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff91a8476b0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3305:1870073693262848:0@lo:400:kworker.0 00000100:00100000:2.0:1783441466.733225:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783441466.733256:0:3305:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff91a8476b2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3305:1870073693263360:0@lo:400:kworker.0 00000100:00100000:2.0:1783441466.733281:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783441466.733316:0:3304:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff91a8476b3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3304:1870073693263104:0@lo:400:kworker.0 00000100:00100000:2.0:1783441466.733338:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783441466.733357:0:3304:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1783441466.733362:0:3304:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff91a8476b1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3304:1870073693262976:0@lo:400:kworker.0 00000100:00100000:2.0:1783441466.733381:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783441466.733410:0:6605:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073693263232 00000100:00100000:2.0:1783441466.733417:0:6605:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073693263232 00000100:00100000:2.0:1783441466.733478:0:6605:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073693262848 00000100:00100000:2.0:1783441466.733481:0:6605:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073693262848 00000100:00100000:2.0:1783441466.733495:0:6605:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073693262976 00000100:00100000:2.0:1783441466.733497:0:6605:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073693262976 00000100:00100000:2.0:1783441466.733515:0:6605:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 100 00000100:00100000:2.0:1783441466.733523:0:6605:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a87d6a3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3305:x1870073693263232:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1783441466.733573:0:6605:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a87d6a3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3305:x1870073693263232:12345-0@lo:400:kworker.0 Request processed in 51us (448us total) trans 0 rc 0/0 00000100:00100000:2.0:1783441466.733579:0:6605:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 100 00000100:00100000:2.0:1783441466.733596:0:6605:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 101 00000100:00100000:2.0:1783441466.733601:0:6605:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a87d6a3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3305:x1870073693262848:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1783441466.733626:0:6605:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a87d6a3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3305:x1870073693262848:12345-0@lo:400:kworker.0 Request processed in 25us (400us total) trans 0 rc 0/0 00000100:00100000:2.0:1783441466.733631:0:6605:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 101 00000100:00100000:2.0:1783441466.733643:0:6605:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 102 00000100:00100000:2.0:1783441466.733649:0:6605:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a87d4eaa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3304:x1870073693262976:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1783441466.733680:0:6605:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a87d4eaa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3304:x1870073693262976:12345-0@lo:400:kworker.0 Request processed in 31us (297us total) trans 0 rc 0/0 00000100:00100000:2.0:1783441466.733706:0:6605:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 102 00000100:00100000:2.0:1783441466.733727:0:8557:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073693263360 00000100:00100000:2.0:1783441466.733731:0:8557:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073693263360 00000100:00100000:2.0:1783441466.733786:0:8557:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073693263104 00000100:00100000:2.0:1783441466.733789:0:8557:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073693263104 00000100:00100000:2.0:1783441466.733809:0:8557:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 57 00000100:00100000:2.0:1783441466.733815:0:8557:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a867cd7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3305:x1870073693263360:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1783441466.733845:0:8557:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a867cd7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3305:x1870073693263360:12345-0@lo:400:kworker.0 Request processed in 30us (562us total) trans 0 rc 0/0 00000100:00100000:2.0:1783441466.733851:0:8557:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 57 00000100:00100000:2.0:1783441466.733862:0:8557:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 58 00000100:00100000:2.0:1783441466.733867:0:8557:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a867cd6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3304:x1870073693263104:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1783441466.733894:0:8557:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a867cd6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3304:x1870073693263104:12345-0@lo:400:kworker.0 Request processed in 27us (555us total) trans 0 rc 0/0 00000100:00100000:2.0:1783441466.733900:0:8557:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 58 00000100:00080000:2.0:1783441466.733921:0:5781:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1783441466.733926:0:5781:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1783441466.733928:0:5781:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1783441466.733962:0:3304:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff91a8476b1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3304:1870073693262976:0@lo:400:kworker.0 00010000:00080000:2.0:1783441466.733974:0:3304:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff91a8476b3100 x1870073693263104/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1783441482 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1783441466.733985:0:3304:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff91a8476b3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3304:1870073693263104:0@lo:400:kworker.0 00000100:00100000:2.0:1783441466.734017:0:3305:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff91a8476b0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3305:1870073693262848:0@lo:400:kworker.0 00010000:00080000:2.0:1783441466.734026:0:3305:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff91a8476b2680 x1870073693263360/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1783441482 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1783441466.734045:0:3305:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff91a8476b2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3305:1870073693263360:0@lo:400:kworker.0 00000100:00100000:2.0:1783441466.734055:0:3305:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff91a8476b1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3305:1870073693263232:0@lo:400:kworker.0 00000100:00100000:3.0:1783441467.248069:0:3304:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1783441467.248095:0:3304:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff91a87d805180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3304:1870073693263488:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1783441467.248167:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783441467.248447:0:6585:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073693263488 00000100:00100000:0.0:1783441467.248455:0:6585:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073693263488 00000100:00100000:0.0:1783441467.248555:0:6585:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 46 00000100:00100000:0.0:1783441467.248566:0:6585:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a8476b1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3304:x1870073693263488:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1783441467.248657:0:6585:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3858759680 avail 3856662528 00000100:00100000:1.0:1783441467.249040:0:6585:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a8476b1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3304:x1870073693263488:12345-0@lo:13:osp-pre-1-0.0 Request processed in 475us (872us total) trans 0 rc 0/0 00000100:00100000:1.0:1783441467.249054:0:6585:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 46 00010000:00080000:3.0:1783441467.249152:0:3304:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff91a87d805180 x1870073693263488/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1783441483 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1783441467.249183:0:3304:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff91a87d805180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3304:1870073693263488:0@lo:13:osp-pre-1-0.0 00010000:00010000:3.0:1783441467.501062:0:5772:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1783441468.268915:0:3303:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1783441468.268940:0:3303:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff91a8476b2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3303:1870073693263616:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1783441468.269016:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783441468.269077:0:6584:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073693263616 00000100:00100000:3.0:1783441468.269085:0:6584:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073693263616 00000100:00100000:3.0:1783441468.269142:0:6584:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 47 00000100:00100000:3.0:1783441468.269151:0:6584:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a8476b0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3303:x1870073693263616:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1783441468.269184:0:6584:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1783441468.269228:0:6584:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a8476b0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3303:x1870073693263616:12345-0@lo:13:osp-pre-0-0.0 Request processed in 78us (211us total) trans 0 rc 0/0 00000100:00100000:3.0:1783441468.269235:0:6584:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 47 00000100:00080000:3.0:1783441468.269256:0:5781:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:3.0:1783441468.269286:0:3303:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff91a8476b2680 x1870073693263616/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1783441484 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1783441468.269303:0:3303:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff91a8476b2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3303:1870073693263616:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1783441468.283167:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.13@tcp (source: 12345-192.168.201.13@tcp) 00000100:00100000:3.0:1783441468.283236:0:5779:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073673302016 00000100:00100000:3.0:1783441468.283250:0:5779:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073673302016 00000100:00100000:3.0:1783441468.283323:0:5779:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.13@tcp, seq: 247 00000100:00100000:3.0:1783441468.283335:0:5779:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a8655e4050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:51c2a82e-e792-4f56-84e8-12cc033e9e70+13:2354:x1870073673302016:12345-192.168.201.13@tcp:400:kworker.0 00000100:00100000:3.0:1783441468.283427:0:5779:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a8655e4050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:51c2a82e-e792-4f56-84e8-12cc033e9e70+13:2354:x1870073673302016:12345-192.168.201.13@tcp:400:kworker.0 Request processed in 94us (273us total) trans 0 rc 0/0 00000100:00100000:3.0:1783441468.283436:0:5779:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.13@tcp, seq: 247 00000100:00100000:1.0:1783441468.302045:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.13@tcp (source: 12345-192.168.201.13@tcp) 00000100:00100000:1.0:1783441468.302087:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.13@tcp (source: 12345-192.168.201.13@tcp) 00000100:00100000:0.0:1783441468.302172:0:5785:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073673302144 00000100:00100000:0.0:1783441468.302183:0:5785:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073673302144 00000100:00100000:0.0:1783441468.302254:0:5785:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073673302272 00000100:00100000:0.0:1783441468.302259:0:5785:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073673302272 00000100:00100000:0.0:1783441468.302285:0:5785:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.13@tcp, seq: 103 00000100:00100000:0.0:1783441468.302294:0:5785:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a87d4de680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:65454767-383a-4679-a788-eba05c6e0989+6:2354:x1870073673302144:12345-192.168.201.13@tcp:400:kworker.0 00000100:00100000:0.0:1783441468.302371:0:5785:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a87d4de680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:65454767-383a-4679-a788-eba05c6e0989+6:2354:x1870073673302144:12345-192.168.201.13@tcp:400:kworker.0 Request processed in 78us (336us total) trans 0 rc 0/0 00000100:00100000:0.0:1783441468.302378:0:5785:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.13@tcp, seq: 103 00000100:00100000:0.0:1783441468.302395:0:5785:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.13@tcp, seq: 104 00000100:00100000:0.0:1783441468.302401:0:5785:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a87d4dd880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d5aa2a25-c618-49e9-a833-85b3b4747e53+5:2355:x1870073673302272:12345-192.168.201.13@tcp:400:kworker.0 00000100:00100000:0.0:1783441468.302426:0:5785:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a87d4dd880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d5aa2a25-c618-49e9-a833-85b3b4747e53+5:2355:x1870073673302272:12345-192.168.201.13@tcp:400:kworker.0 Request processed in 26us (338us total) trans 0 rc 0/0 00000100:00100000:0.0:1783441468.302432:0:5785:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.13@tcp, seq: 104 00000100:00080000:1.0:1783441468.302721:0:5781:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:1.0:1783441468.526873:0:5773:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:0.0:1783441469.333600:0:11212:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg113-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00010000:00010000:2.0:1783441469.549038:0:5772:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783441470.573312:0:5773:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783441471.608481:0:5772:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1783441471.853362:0:3305:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff91a8476b2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:6c1ddb50-5795-40c6-a2b6-8f58add9da62:3305:1870073693263744:0@lo:400:kworker.0 00000100:00100000:2.0:1783441471.853469:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783441471.853701:0:3306:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff91a8476b3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3306:1870073693263872:0@lo:400:kworker.0 00000100:00100000:1.0:1783441471.853775:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783441471.853833:0:5785:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073693263872 00000100:00100000:1.0:1783441471.853843:0:5785:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073693263872 00000100:00100000:1.0:1783441471.853983:0:5785:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 105 00000100:00100000:1.0:1783441471.853994:0:5785:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a87d4df100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3306:x1870073693263872:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1783441471.854059:0:5785:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a87d4df100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3306:x1870073693263872:12345-0@lo:400:kworker.0 Request processed in 67us (317us total) trans 0 rc 0/0 00000100:00100000:1.0:1783441471.854067:0:5785:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 105 00000100:00100000:1.0:1783441471.854133:0:3306:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff91a8476b3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3306:1870073693263872:0@lo:400:kworker.0 00000100:00100000:0.0:1783441471.854281:0:5780:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073693263744 00000100:00100000:0.0:1783441471.854287:0:5780:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073693263744 00000100:00100000:0.0:1783441471.854329:0:5780:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 248 00000100:00100000:0.0:1783441471.854338:0:5780:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a8655e4450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6c1ddb50-5795-40c6-a2b6-8f58add9da62+19:3305:x1870073693263744:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1783441471.863145:0:3303:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff91a8476b1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3303:1870073693264000:0@lo:400:kworker.0 00000100:00100000:1.0:1783441471.863249:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783441471.863311:0:3303:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1783441471.863319:0:3303:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff91a8476b3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3303:1870073693264128:0@lo:400:kworker.0 00000100:00100000:1.0:1783441471.863368:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783441471.863423:0:5787:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073693264000 00000100:00100000:1.0:1783441471.863433:0:5787:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073693264000 00000100:00100000:1.0:1783441471.863502:0:5787:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 106 00000100:00100000:1.0:1783441471.863514:0:5787:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a87d4dce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3303:x1870073693264000:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1783441471.863576:0:5787:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a87d4dce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3303:x1870073693264000:12345-0@lo:400:kworker.0 Request processed in 65us (327us total) trans 0 rc 0/0 00000100:00100000:1.0:1783441471.863591:0:5787:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 106 00000100:00080000:1.0:1783441471.863619:0:5781:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1783441471.863639:0:3306:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff91a877faf100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3306:1870073693264384:0@lo:400:kworker.0 00000100:00100000:1.0:1783441471.863667:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783441471.863702:0:3306:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1783441471.863709:0:3306:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff91a877fadc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3306:1870073693264256:0@lo:400:kworker.0 00000100:00100000:1.0:1783441471.863733:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783441471.863796:0:5785:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073693264256 00000100:00100000:1.0:1783441471.863800:0:5785:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073693264256 00000100:00100000:1.0:1783441471.863829:0:5785:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 107 00000100:00100000:1.0:1783441471.863834:0:5785:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a87d7c5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3306:x1870073693264256:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1783441471.863868:0:5785:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a87d7c5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3306:x1870073693264256:12345-0@lo:400:kworker.0 Request processed in 34us (135us total) trans 0 rc 0/0 00000100:00100000:1.0:1783441471.864043:0:5785:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 107 00000100:00080000:1.0:1783441471.864064:0:5781:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1783441471.864111:0:3303:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff91a8476b1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3303:1870073693264000:0@lo:400:kworker.0 00000100:00100000:1.0:1783441471.864145:0:3306:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff91a877fadc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3306:1870073693264256:0@lo:400:kworker.0 00000100:00100000:0.0:1783441471.864306:0:5780:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a8655e4450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6c1ddb50-5795-40c6-a2b6-8f58add9da62+19:3305:x1870073693263744:12345-0@lo:400:kworker.0 Request processed in 9968us (10836us total) trans 0 rc 0/0 00000100:00100000:0.0:1783441471.864318:0:5780:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 248 00000100:00100000:2.0:1783441471.864618:0:3305:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff91a8476b2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:6c1ddb50-5795-40c6-a2b6-8f58add9da62:3305:1870073693263744:0@lo:400:kworker.0 00000100:00100000:2.0:1783441471.864653:0:8557:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073693264128 00000100:00100000:2.0:1783441471.864657:0:8557:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073693264128 00000100:00100000:2.0:1783441471.864723:0:8557:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073693264384 00000100:00100000:2.0:1783441471.864727:0:8557:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073693264384 00000100:00100000:2.0:1783441471.864778:0:8557:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 59 00000100:00100000:2.0:1783441471.864788:0:8557:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a87d7c6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3303:x1870073693264128:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1783441471.864844:0:8557:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a87d7c6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3303:x1870073693264128:12345-0@lo:400:kworker.0 Request processed in 58us (1475us total) trans 0 rc 0/0 00000100:00100000:2.0:1783441471.864851:0:8557:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 59 00000100:00100000:2.0:1783441471.864864:0:8557:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 60 00000100:00100000:2.0:1783441471.864870:0:8557:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a87d7c7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3306:x1870073693264384:12345-0@lo:400:kworker.0 00000100:00080000:1.0:1783441471.865034:0:5781:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1783441471.865038:0:5781:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:1.0:1783441471.865066:0:3303:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff91a8476b3100 x1870073693264128/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1783441487 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1783441471.865169:0:3303:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff91a8476b3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3303:1870073693264128:0@lo:400:kworker.0 00000100:00100000:2.0:1783441471.866104:0:8557:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a87d7c7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3306:x1870073693264384:12345-0@lo:400:kworker.0 Request processed in 1231us (2433us total) trans 0 rc 0/0 00000100:00100000:2.0:1783441471.866114:0:8557:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 60 00010000:00080000:1.0:1783441471.866364:0:3306:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff91a877faf100 x1870073693264384/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1783441487 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1783441471.866378:0:3306:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff91a877faf100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3306:1870073693264384:0@lo:400:kworker.0 00000100:00100000:2.0:1783441472.370132:0:3304:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1783441472.370167:0:3304:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff91a87d4e8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3304:1870073693264512:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1783441472.370265:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783441472.370350:0:6584:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073693264512 00000100:00100000:2.0:1783441472.370367:0:6584:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073693264512 00000100:00100000:2.0:1783441472.370429:0:6584:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 48 00000100:00100000:2.0:1783441472.370438:0:6584:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a87d4eb100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3304:x1870073693264512:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1783441472.370488:0:6584:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3858759680 avail 3856662528 00000100:00100000:2.0:1783441472.370539:0:6584:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a87d4eb100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3304:x1870073693264512:12345-0@lo:13:osp-pre-1-0.0 Request processed in 101us (275us total) trans 0 rc 0/0 00000100:00100000:2.0:1783441472.370546:0:6584:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 48 00010000:00080000:2.0:1783441472.370594:0:3304:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff91a87d4e8a80 x1870073693264512/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1783441488 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1783441472.370703:0:3304:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff91a87d4e8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3304:1870073693264512:0@lo:13:osp-pre-1-0.0 00010000:00010000:1.0:1783441472.621058:0:5773:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1783441473.392682:0:3304:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff91a877face00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3304:1870073693264640:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1783441473.392773:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783441473.392873:0:6584:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073693264640 00000100:00100000:0.0:1783441473.392882:0:6584:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073693264640 00000100:00100000:0.0:1783441473.392942:0:6584:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 49 00000100:00100000:0.0:1783441473.392952:0:6584:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a87d4e8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3304:x1870073693264640:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1783441473.392985:0:6584:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00080000:1.0:1783441473.393057:0:5781:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1783441473.393382:0:6584:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a87d4e8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3304:x1870073693264640:12345-0@lo:13:osp-pre-0-0.0 Request processed in 430us (607us total) trans 0 rc 0/0 00000100:00100000:0.0:1783441473.393391:0:6584:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 49 00010000:00080000:2.0:1783441473.393562:0:3304:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff91a877face00 x1870073693264640/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1783441489 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1783441473.393810:0:3304:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff91a877face00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3304:1870073693264640:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1783441473.404385:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.13@tcp (source: 12345-192.168.201.13@tcp) 00000100:00100000:1.0:1783441473.404537:0:5779:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073673302400 00000100:00100000:1.0:1783441473.404547:0:5779:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073673302400 00000100:00100000:1.0:1783441473.404764:0:5779:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.13@tcp, seq: 249 00000100:00100000:1.0:1783441473.404777:0:5779:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a8655e7450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:51c2a82e-e792-4f56-84e8-12cc033e9e70+13:2355:x1870073673302400:12345-192.168.201.13@tcp:400:kworker.0 00000100:00100000:1.0:1783441473.404855:0:5779:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a8655e7450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:51c2a82e-e792-4f56-84e8-12cc033e9e70+13:2355:x1870073673302400:12345-192.168.201.13@tcp:400:kworker.0 Request processed in 81us (480us total) trans 0 rc 0/0 00000100:00100000:1.0:1783441473.404863:0:5779:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.13@tcp, seq: 249 00000100:00100000:0.0:1783441473.405354:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.13@tcp (source: 12345-192.168.201.13@tcp) 00000100:00100000:0.0:1783441473.405396:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.13@tcp (source: 12345-192.168.201.13@tcp) 00000100:00100000:2.0:1783441473.409780:0:6605:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073673302656 00000100:00100000:2.0:1783441473.409798:0:6605:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073673302656 00000100:00100000:2.0:1783441473.409873:0:6605:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073673302528 00000100:00100000:2.0:1783441473.409877:0:6605:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073673302528 00000100:00100000:2.0:1783441473.409906:0:6605:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.13@tcp, seq: 108 00000100:00100000:2.0:1783441473.409917:0:6605:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a87d806680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:d5aa2a25-c618-49e9-a833-85b3b4747e53+5:2355:x1870073673302656:12345-192.168.201.13@tcp:400:kworker.0 00000100:00100000:2.0:1783441473.410009:0:6605:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a87d806680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:d5aa2a25-c618-49e9-a833-85b3b4747e53+5:2355:x1870073673302656:12345-192.168.201.13@tcp:400:kworker.0 Request processed in 94us (5565us total) trans 0 rc 0/0 00000100:00100000:2.0:1783441473.410017:0:6605:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.13@tcp, seq: 108 00000100:00100000:2.0:1783441473.410034:0:6605:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.13@tcp, seq: 109 00000100:00100000:2.0:1783441473.410055:0:6605:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a87d807480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:65454767-383a-4679-a788-eba05c6e0989+6:2355:x1870073673302528:12345-192.168.201.13@tcp:400:kworker.0 00000100:00100000:2.0:1783441473.410084:0:6605:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a87d807480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:65454767-383a-4679-a788-eba05c6e0989+6:2355:x1870073673302528:12345-192.168.201.13@tcp:400:kworker.0 Request processed in 30us (4687us total) trans 0 rc 0/0 00000100:00100000:2.0:1783441473.410090:0:6605:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.13@tcp, seq: 109 00000100:00080000:2.0:1783441473.410110:0:5781:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:2.0:1783441473.644932:0:5772:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:0.0:1783441473.933621:0:11312:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: === sanity-pcc: finish setup 12:24:33 (1783441473) === 00000100:00100000:1.0:1783441474.342156:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.13@tcp (source: 12345-192.168.201.13@tcp) 00000100:00100000:0.0:1783441474.342362:0:5794:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073673302912 00000100:00100000:0.0:1783441474.342377:0:5794:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073673302912 00000100:00100000:0.0:1783441474.342457:0:5794:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.13@tcp, seq: 0 00000100:00100000:0.0:1783441474.342469:0:5794:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a87d7c6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqm_0000:65454767-383a-4679-a788-eba05c6e0989+6:9650:x1870073673302912:12345-192.168.201.13@tcp:700:mkdir.0 00000100:00100000:0.0:1783441474.342608:0:5794:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a87d7c6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqm_0000:65454767-383a-4679-a788-eba05c6e0989+6:9650:x1870073673302912:12345-192.168.201.13@tcp:700:mkdir.0 Request processed in 141us (467us total) trans 0 rc 0/0 00000100:00100000:0.0:1783441474.342616:0:5794:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.13@tcp, seq: 0 00000100:00100000:2.0:1783441474.345055:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.13@tcp (source: 12345-192.168.201.13@tcp) 00000100:00100000:1.0:1783441474.345182:0:6605:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073673302784 00000100:00100000:1.0:1783441474.345195:0:6605:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073673302784 00000100:00100000:1.0:1783441474.345284:0:6605:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.13@tcp, seq: 14 00000100:00100000:1.0:1783441474.345296:0:6605:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a87d4e9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:65454767-383a-4679-a788-eba05c6e0989+6:2352:x1870073673302784:12345-192.168.201.13@tcp:41:mkdir.0 00000004:00000024:1.0:1783441474.345356:0:6605:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 6815744 pending 0 free 2261647360 avail 2259550208 00000100:00100000:1.0:1783441474.345713:0:6605:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a87d4e9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:65454767-383a-4679-a788-eba05c6e0989+6:2352:x1870073673302784:12345-192.168.201.13@tcp:41:mkdir.0 Request processed in 418us (669us total) trans 0 rc 0/0 00000100:00100000:1.0:1783441474.345732:0:6605:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.13@tcp, seq: 14 00000100:00100000:2.0:1783441474.353435:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.13@tcp (source: 12345-192.168.201.13@tcp) 00000100:00100000:3.0:1783441474.353614:0:5786:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073673303168 00000100:00100000:3.0:1783441474.353627:0:5786:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073673303168 00000100:00100000:3.0:1783441474.353712:0:5786:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.13@tcp, seq: 15 00000100:00100000:3.0:1783441474.353733:0:5786:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a87d4e9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:65454767-383a-4679-a788-eba05c6e0989+6:9650:x1870073673303168:12345-192.168.201.13@tcp:36:mkdir.0 00010000:00010000:3.0:1783441474.354018:0:5786:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1783441474.354832:0:5786:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91a87da47200/0xa2426164df2c7751 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.13@tcp remote: 0x633a354aa4df4c94 expref: 6 pid: 5787 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783441474.354863:0:5786:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff91a858b90200) 00010000:00010000:3.0:1783441474.354876:0:5786:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1783441474.355235:0:5786:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff91a85eb3d600/0xa2426164df2c7870 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783441474.355249:0:5786:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91a85eb3d600/0xa2426164df2c7870 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783441474.355259:0:5786:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91a85eb3d600/0xa2426164df2c7870 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783441474.355302:0:5786:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff91a85eb3ce00/0xa2426164df2c7877 lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783441474.355310:0:5786:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91a85eb3ce00/0xa2426164df2c7877 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783441474.355317:0:5786:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91a85eb3ce00/0xa2426164df2c7877 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1783441474.370954:0:5786:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x1:0x0]: returning size 512 00010000:00010000:0.0:1783441474.370994:0:5786:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff91a85eb3d600/0xa2426164df2c7870 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783441474.371008:0:5786:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff91a85eb3d600/0xa2426164df2c7870 lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783441474.371031:0:5786:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff91a85eb3d600/0xa2426164df2c7870 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783441474.371037:0:5786:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91a85eb3d600 already unused, calling callback (ffffffffc1f9b4f0) 00010000:00010000:0.0:1783441474.371042:0:5786:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91a85eb3d600/0xa2426164df2c7870 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783441474.371050:0:5786:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91a85eb3d600/0xa2426164df2c7870 lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783441474.371072:0:5786:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff91a85faee800) 00010000:00010000:0.0:1783441474.371076:0:5786:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1783441474.371081:0:5786:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff91a85eb3d600/0xa2426164df2c7870 lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783441474.371088:0:5786:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91a85eb3d600/0xa2426164df2c7870 lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1783441474.371119:0:5786:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000a0fd7372 reply state 000000003175178f transno 4294967297 ns: mdt-lustre-MDT0000_UUID lock: ffff91a85eb3ce00/0xa2426164df2c7877 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783441474.371130:0:5786:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1783441474.371279:0:5786:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a87d4e9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:65454767-383a-4679-a788-eba05c6e0989+7:9650:x1870073673303168:12345-192.168.201.13@tcp:36:mkdir.0 Request processed in 17551us (17851us total) trans 4294967297 rc 0/0 00000100:00100000:0.0:1783441474.371290:0:5786:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.13@tcp, seq: 15 00010000:00010000:3.0:1783441474.377151:0:3289:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff91a85eb3ce00/0xa2426164df2c7877 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783441474.377195:0:3289:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff91a85eb3ce00/0xa2426164df2c7877 lrc: 2/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783441474.377203:0:3289:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff91a85eb3ce00/0xa2426164df2c7877 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783441474.377209:0:3289:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91a85eb3ce00 already unused, calling callback (ffffffffc1f9b4f0) 00010000:00010000:3.0:1783441474.377215:0:3289:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91a85eb3ce00/0xa2426164df2c7877 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783441474.377231:0:3289:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91a85eb3ce00/0xa2426164df2c7877 lrc: 4/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783441474.377251:0:3289:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x792b1d9 (ffff91a85faeee00) 00010000:00010000:3.0:1783441474.377255:0:3289:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1783441474.377260:0:3289:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff91a85eb3ce00/0xa2426164df2c7877 lrc: 2/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783441474.377268:0:3289:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91a85eb3ce00/0xa2426164df2c7877 lrc: 0/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783441474.400255:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.13@tcp (source: 12345-192.168.201.13@tcp) 00000100:00100000:2.0:1783441474.400678:0:5785:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073673303296 00000100:00100000:2.0:1783441474.400691:0:5785:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073673303296 00000100:00100000:2.0:1783441474.400809:0:5785:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.13@tcp, seq: 16 00000100:00100000:2.0:1783441474.400820:0:5785:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a87d7c4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:65454767-383a-4679-a788-eba05c6e0989+6:9651:x1870073673303296:12345-192.168.201.13@tcp:101:chmod.0 00010000:00010000:2.0:1783441474.400847:0:5785:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1783441474.400878:0:5785:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91a85f83c000/0xa2426164df2c787e lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x633a354aa4df4d19 expref: -99 pid: 5785 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783441474.400956:0:5785:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff91a85f83d600/0xa2426164df2c7885 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783441474.400972:0:5785:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91a85f83d600/0xa2426164df2c7885 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783441474.400986:0:5785:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91a85f83d600/0xa2426164df2c7885 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1783441474.401059:0:5785:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 6656 00000004:00200000:2.0:1783441474.401062:0:5785:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 2 stripe count 1 MDT count 1 00000004:00010000:2.0:1783441474.401116:0:5785:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff91a85f83d600/0xa2426164df2c7885 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783441474.401166:0:5785:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91a85f83c000/0xa2426164df2c787e lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.13@tcp remote: 0x633a354aa4df4d19 expref: 8 pid: 5785 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783441474.401186:0:5785:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff91a85f83d600/0xa2426164df2c7885 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.13@tcp remote: 0x633a354aa4df4d19 expref: 7 pid: 5785 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783441474.401196:0:5785:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff91a8429bd200) 00010000:00010000:2.0:1783441474.401199:0:5785:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1783441474.401203:0:5785:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91a85f83d600, rc 0) 00000100:00100000:2.0:1783441474.401272:0:5785:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a87d7c4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:65454767-383a-4679-a788-eba05c6e0989+7:9651:x1870073673303296:12345-192.168.201.13@tcp:101:chmod.0 Request processed in 455us (1033us total) trans 0 rc 0/0 00000100:00100000:2.0:1783441474.401279:0:5785:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.13@tcp, seq: 16 00000100:00100000:2.0:1783441474.411983:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.13@tcp (source: 12345-192.168.201.13@tcp) 00000100:00100000:1.0:1783441474.412225:0:5787:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073673303552 00000100:00100000:1.0:1783441474.412239:0:5787:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073673303552 00000100:00100000:1.0:1783441474.412316:0:5787:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.13@tcp, seq: 17 00000100:00100000:1.0:1783441474.412328:0:5787:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a87d4eb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:65454767-383a-4679-a788-eba05c6e0989+7:9651:x1870073673303552:12345-192.168.201.13@tcp:36:chmod.0 00010000:00010000:1.0:1783441474.412402:0:5787:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1783441474.412438:0:5787:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91a85f83d600/0xa2426164df2c7885 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.13@tcp remote: 0x633a354aa4df4d19 expref: 7 pid: 5785 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783441474.412484:0:5787:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff91a8429bd200) 00010000:00010000:1.0:1783441474.412500:0:5787:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1783441474.412535:0:5787:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff91a87da47e00/0xa2426164df2c788c lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783441474.412550:0:5787:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91a87da47e00/0xa2426164df2c788c lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783441474.412562:0:5787:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91a87da47e00/0xa2426164df2c788c lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1783441474.413073:0:5787:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000babfd97f reply state 00000000647751ae transno 4294967298 ns: mdt-lustre-MDT0000_UUID lock: ffff91a87da47e00/0xa2426164df2c788c lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783441474.413086:0:5787:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000004:00200000:1.0:1783441474.413103:0:5787:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 6656 00000100:00100000:1.0:1783441474.413228:0:5787:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a87d4eb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:65454767-383a-4679-a788-eba05c6e0989+8:9651:x1870073673303552:12345-192.168.201.13@tcp:36:chmod.0 Request processed in 899us (1504us total) trans 4294967298 rc 0/0 00000100:00100000:1.0:1783441474.413236:0:5787:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.13@tcp, seq: 17 00010000:00010000:1.0:1783441474.419492:0:3290:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff91a87da47e00/0xa2426164df2c788c lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783441474.419516:0:3290:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff91a87da47e00/0xa2426164df2c788c lrc: 2/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783441474.419525:0:3290:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff91a87da47e00/0xa2426164df2c788c lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783441474.419532:0:3290:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91a87da47e00 already unused, calling callback (ffffffffc1f9b4f0) 00010000:00010000:1.0:1783441474.419538:0:3290:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91a87da47e00/0xa2426164df2c788c lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783441474.419565:0:3290:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91a87da47e00/0xa2426164df2c788c lrc: 4/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783441474.425155:0:3290:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff91a858b90d00) 00010000:00010000:1.0:1783441474.425170:0:3290:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:1.0:1783441474.425182:0:3290:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff91a87da47e00/0xa2426164df2c788c lrc: 2/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783441474.425196:0:3290:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91a87da47e00/0xa2426164df2c788c lrc: 0/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783441474.441370:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.13@tcp (source: 12345-192.168.201.13@tcp) 00000100:00100000:1.0:1783441474.442271:0:5785:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073673303680 00000100:00100000:1.0:1783441474.442288:0:5785:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073673303680 00000100:00100000:2.0:1783441474.443014:0:5785:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.13@tcp, seq: 18 00000100:00100000:2.0:1783441474.443028:0:5785:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a87d4ea680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:65454767-383a-4679-a788-eba05c6e0989+7:9652:x1870073673303680:12345-192.168.201.13@tcp:101:chown.0 00010000:00010000:2.0:1783441474.443059:0:5785:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1783441474.443089:0:5785:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91a85f83c000/0xa2426164df2c7893 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x633a354aa4df4d20 expref: -99 pid: 5785 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783441474.443181:0:5785:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff91a85f83d800/0xa2426164df2c789a lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783441474.443196:0:5785:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91a85f83d800/0xa2426164df2c789a lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783441474.443217:0:5785:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91a85f83d800/0xa2426164df2c789a lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1783441474.443590:0:5785:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 6656 00000004:00200000:2.0:1783441474.443594:0:5785:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 2 stripe count 1 MDT count 1 00000004:00010000:2.0:1783441474.443656:0:5785:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff91a85f83d800/0xa2426164df2c789a lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783441474.443690:0:5785:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91a85f83c000/0xa2426164df2c7893 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.13@tcp remote: 0x633a354aa4df4d20 expref: 9 pid: 5785 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783441474.443712:0:5785:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff91a85f83d800/0xa2426164df2c789a lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.13@tcp remote: 0x633a354aa4df4d20 expref: 8 pid: 5785 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783441474.443731:0:5785:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff91a8429bd600) 00010000:00010000:2.0:1783441474.443735:0:5785:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1783441474.443799:0:5785:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91a85f83d800, rc 0) 00000100:00100000:2.0:1783441474.443881:0:5785:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a87d4ea680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:65454767-383a-4679-a788-eba05c6e0989+8:9652:x1870073673303680:12345-192.168.201.13@tcp:101:chown.0 Request processed in 855us (2525us total) trans 0 rc 0/0 00000100:00100000:2.0:1783441474.443889:0:5785:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.13@tcp, seq: 18 00000100:00100000:0.0:1783441474.447153:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.13@tcp (source: 12345-192.168.201.13@tcp) 00000100:00100000:1.0:1783441474.447276:0:5787:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073673303808 00000100:00100000:1.0:1783441474.447289:0:5787:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073673303808 00000100:00100000:1.0:1783441474.447363:0:5787:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.13@tcp, seq: 19 00000100:00100000:1.0:1783441474.447375:0:5787:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a87d804000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:65454767-383a-4679-a788-eba05c6e0989+8:9652:x1870073673303808:12345-192.168.201.13@tcp:101:chown.0 00010000:00010000:1.0:1783441474.447401:0:5787:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1783441474.447428:0:5787:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91a87da47e00/0xa2426164df2c78a1 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x633a354aa4df4d27 expref: -99 pid: 5787 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783441474.447515:0:5787:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff91a87da46000/0xa2426164df2c78a8 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783441474.447531:0:5787:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91a87da46000/0xa2426164df2c78a8 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783441474.447544:0:5787:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91a87da46000/0xa2426164df2c78a8 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783441474.447662:0:5787:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff91a87da47000/0xa2426164df2c78af lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783441474.447671:0:5787:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91a87da47000/0xa2426164df2c78af lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783441474.447678:0:5787:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91a87da47000/0xa2426164df2c78af lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783441474.448351:0:5787:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff91a87da46600/0xa2426164df2c78b6 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783441474.448362:0:5787:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91a87da46600/0xa2426164df2c78b6 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783441474.448370:0:5787:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91a87da46600/0xa2426164df2c78b6 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1783441474.448426:0:5787:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x1:0x0]: returning size 512 00000004:00200000:1.0:1783441474.448430:0:5787:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:1.0:1783441474.448460:0:5787:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff91a87da46600/0xa2426164df2c78b6 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783441474.448473:0:5787:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff91a87da46000/0xa2426164df2c78a8 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783441474.448479:0:5787:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff91a87da46000/0xa2426164df2c78a8 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783441474.448486:0:5787:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff91a87da46000/0xa2426164df2c78a8 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783441474.448507:0:5787:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91a87da46000 already unused, calling callback (ffffffffc1f9b4f0) 00010000:00010000:1.0:1783441474.448511:0:5787:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91a87da46000/0xa2426164df2c78a8 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783441474.448519:0:5787:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91a87da46000/0xa2426164df2c78a8 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783441474.448534:0:5787:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff91a8429bd600) 00010000:00010000:1.0:1783441474.448537:0:5787:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1783441474.448542:0:5787:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff91a87da46000/0xa2426164df2c78a8 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783441474.448549:0:5787:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91a87da46000/0xa2426164df2c78a8 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783441474.448579:0:5787:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff91a87da47000/0xa2426164df2c78af lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783441474.448585:0:5787:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff91a87da47000/0xa2426164df2c78af lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783441474.448590:0:5787:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff91a87da47000/0xa2426164df2c78af lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783441474.448596:0:5787:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91a87da47000 already unused, calling callback (ffffffffc1f9b4f0) 00010000:00010000:1.0:1783441474.448598:0:5787:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91a87da47000/0xa2426164df2c78af lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783441474.448604:0:5787:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91a87da47000/0xa2426164df2c78af lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783441474.448622:0:5787:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x792b1d9 (ffff91a858b90d00) 00010000:00010000:1.0:1783441474.448625:0:5787:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1783441474.448628:0:5787:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff91a87da47000/0xa2426164df2c78af lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783441474.448633:0:5787:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91a87da47000/0xa2426164df2c78af lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783441474.448697:0:5787:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91a87da47e00/0xa2426164df2c78a1 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.13@tcp remote: 0x633a354aa4df4d27 expref: 10 pid: 5787 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783441474.448713:0:5787:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff91a87da46600/0xa2426164df2c78b6 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.13@tcp remote: 0x633a354aa4df4d27 expref: 9 pid: 5787 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783441474.448721:0:5787:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff91a858b90f00) 00010000:00010000:1.0:1783441474.448724:0:5787:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1783441474.448726:0:5787:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91a87da46600, rc 0) 00000100:00100000:1.0:1783441474.449045:0:5787:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a87d804000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:65454767-383a-4679-a788-eba05c6e0989+9:9652:x1870073673303808:12345-192.168.201.13@tcp:101:chown.0 Request processed in 1670us (1907us total) trans 0 rc 0/0 00000100:00100000:1.0:1783441474.449056:0:5787:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.13@tcp, seq: 19 00000100:00100000:0.0:1783441474.453030:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.13@tcp (source: 12345-192.168.201.13@tcp) 00000100:00100000:1.0:1783441474.453258:0:6605:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073673304064 00000100:00100000:1.0:1783441474.453271:0:6605:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073673304064 00000100:00100000:1.0:1783441474.453407:0:6605:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.13@tcp, seq: 20 00000100:00100000:1.0:1783441474.453421:0:6605:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a87d804a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:65454767-383a-4679-a788-eba05c6e0989+9:9652:x1870073673304064:12345-192.168.201.13@tcp:36:chown.0 00010000:00010000:1.0:1783441474.453494:0:6605:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1783441474.453527:0:6605:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91a87da46600/0xa2426164df2c78b6 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.13@tcp remote: 0x633a354aa4df4d27 expref: 9 pid: 5787 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783441474.453589:0:6605:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff91a858b90f00) 00010000:00010000:1.0:1783441474.453606:0:6605:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1783441474.453651:0:6605:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff91a87da47200/0xa2426164df2c78bd lrc: 3/0,1 mode: --/PW res: [0x200000401:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6605 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783441474.453673:0:6605:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91a87da47200/0xa2426164df2c78bd lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6605 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783441474.453684:0:6605:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91a87da47200/0xa2426164df2c78bd lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6605 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1783441474.497283:0:6605:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 000000003d2528d1 reply state 000000005ca61087 transno 4294967299 ns: mdt-lustre-MDT0000_UUID lock: ffff91a87da47200/0xa2426164df2c78bd lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6605 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783441474.497306:0:6605:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000004:00200000:1.0:1783441474.497556:0:6605:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x1:0x0]: returning size 7680 00000100:00100000:1.0:1783441474.497730:0:6605:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a87d804a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:65454767-383a-4679-a788-eba05c6e0989+10:9652:x1870073673304064:12345-192.168.201.13@tcp:36:chown.0 Request processed in 44305us (44708us total) trans 4294967299 rc 0/0 00000100:00100000:1.0:1783441474.497766:0:6605:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.13@tcp, seq: 20 00000001:00080000:3.0:1783441474.502395:0:5807:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967299 is committed 00010000:00010000:0.0:1783441474.502784:0:3289:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff91a87da47200/0xa2426164df2c78bd lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6605 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783441474.502836:0:3289:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff91a87da47200/0xa2426164df2c78bd lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6605 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783441474.502845:0:3289:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff91a87da47200/0xa2426164df2c78bd lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6605 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783441474.502852:0:3289:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91a87da47200 already unused, calling callback (ffffffffc1f9b4f0) 00010000:00010000:0.0:1783441474.502857:0:3289:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91a87da47200/0xa2426164df2c78bd lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6605 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783441474.502866:0:3289:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91a87da47200/0xa2426164df2c78bd lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6605 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783441474.502887:0:3289:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff91a858b90100) 00010000:00010000:0.0:1783441474.502891:0:3289:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:0.0:1783441474.502896:0:3289:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff91a87da47200/0xa2426164df2c78bd lrc: 2/0,0 mode: --/PW res: [0x200000401:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6605 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783441474.502902:0:3289:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91a87da47200/0xa2426164df2c78bd lrc: 0/0,0 mode: --/PW res: [0x200000401:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6605 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783441474.516530:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.13@tcp (source: 12345-192.168.201.13@tcp) 00000100:00100000:0.0:1783441474.517445:0:5786:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073673304192 00000100:00100000:0.0:1783441474.517462:0:5786:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073673304192 00000100:00100000:0.0:1783441474.517594:0:5786:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.13@tcp, seq: 21 00000100:00100000:0.0:1783441474.517606:0:5786:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a87d7c6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:65454767-383a-4679-a788-eba05c6e0989+6:9653:x1870073673304192:12345-192.168.201.13@tcp:101:touch.500 00010000:00010000:0.0:1783441474.517672:0:5786:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1783441474.517701:0:5786:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91a85fe59400/0xa2426164df2c78c4 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x633a354aa4df4d2e expref: -99 pid: 5786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:0.0:1783441474.520927:0:5786:0:(mdt_identity.c:119:mdt_identity_do_upcall()) lustre-MDT0000: invoked upcall /home/green/git/lustre-release/lustre/utils/l_getidentity lustre-MDT0000 500, time 2620us 00010000:00010000:2.0:1783441474.540191:0:5786:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff91a85f83c400/0xa2426164df2c78cb lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783441474.540223:0:5786:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91a85f83c400/0xa2426164df2c78cb lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783441474.540239:0:5786:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91a85f83c400/0xa2426164df2c78cb lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783441474.540260:0:5786:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff91a85f83da00/0xa2426164df2c78d2 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783441474.540285:0:5786:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91a85f83da00/0xa2426164df2c78d2 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783441474.540292:0:5786:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91a85f83da00/0xa2426164df2c78d2 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783441474.541237:0:5786:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff91a85f83d000/0xa2426164df2c78d9 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783441474.541251:0:5786:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91a85f83d000/0xa2426164df2c78d9 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783441474.541261:0:5786:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91a85f83d000/0xa2426164df2c78d9 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1783441474.541343:0:5786:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x1:0x0]: returning size 7680 00000004:00200000:2.0:1783441474.541347:0:5786:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1783441474.541453:0:5786:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff91a85f83d000/0xa2426164df2c78d9 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783441474.541468:0:5786:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff91a85f83c400/0xa2426164df2c78cb lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783441474.541474:0:5786:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff91a85f83c400/0xa2426164df2c78cb lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783441474.541481:0:5786:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff91a85f83c400/0xa2426164df2c78cb lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783441474.541487:0:5786:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91a85f83c400 already unused, calling callback (ffffffffc1f9b4f0) 00010000:00010000:2.0:1783441474.541491:0:5786:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91a85f83c400/0xa2426164df2c78cb lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783441474.541507:0:5786:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91a85f83c400/0xa2426164df2c78cb lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783441474.541522:0:5786:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff91a8429bd600) 00010000:00010000:2.0:1783441474.541525:0:5786:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1783441474.541531:0:5786:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff91a85f83c400/0xa2426164df2c78cb lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783441474.541931:0:5786:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91a85f83c400/0xa2426164df2c78cb lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783441474.541948:0:5786:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff91a85f83da00/0xa2426164df2c78d2 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783441474.541954:0:5786:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff91a85f83da00/0xa2426164df2c78d2 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783441474.541959:0:5786:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff91a85f83da00/0xa2426164df2c78d2 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783441474.541964:0:5786:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91a85f83da00 already unused, calling callback (ffffffffc1f9b4f0) 00010000:00010000:2.0:1783441474.541967:0:5786:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91a85f83da00/0xa2426164df2c78d2 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783441474.541974:0:5786:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91a85f83da00/0xa2426164df2c78d2 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783441474.541983:0:5786:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x792b1d9 (ffff91a8429bd000) 00010000:00010000:2.0:1783441474.541986:0:5786:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1783441474.541989:0:5786:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff91a85f83da00/0xa2426164df2c78d2 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783441474.542007:0:5786:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91a85f83da00/0xa2426164df2c78d2 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783441474.542060:0:5786:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91a85fe59400/0xa2426164df2c78c4 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.13@tcp remote: 0x633a354aa4df4d2e expref: 8 pid: 5786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783441474.542078:0:5786:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff91a85f83d000/0xa2426164df2c78d9 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.13@tcp remote: 0x633a354aa4df4d2e expref: 7 pid: 5786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783441474.542087:0:5786:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff91a8429bdd00) 00010000:00010000:2.0:1783441474.542090:0:5786:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:2.0:1783441474.542093:0:5786:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91a85f83d000, rc 0) 00000100:00100000:2.0:1783441474.542249:0:5786:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a87d7c6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:65454767-383a-4679-a788-eba05c6e0989+7:9653:x1870073673304192:12345-192.168.201.13@tcp:101:touch.500 Request processed in 24643us (25731us total) trans 0 rc 0/0 00000100:00100000:2.0:1783441474.542261:0:5786:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.13@tcp, seq: 21 00000100:00100000:1.0:1783441474.546380:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.13@tcp (source: 12345-192.168.201.13@tcp) 00000100:00100000:2.0:1783441474.546468:0:5785:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073673304448 00000100:00100000:2.0:1783441474.546481:0:5785:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073673304448 00000100:00100000:3.0:1783441474.546963:0:5785:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.13@tcp, seq: 22 00000100:00100000:3.0:1783441474.546979:0:5785:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a87d7c5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:65454767-383a-4679-a788-eba05c6e0989+7:9653:x1870073673304448:12345-192.168.201.13@tcp:101:touch.500 00010000:00010000:3.0:1783441474.547009:0:5785:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1783441474.547036:0:5785:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91a85eb3ce00/0xa2426164df2c78e0 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x633a354aa4df4d35 expref: -99 pid: 5785 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783441474.547449:0:5785:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff91a85eb3d200/0xa2426164df2c78e7 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783441474.547475:0:5785:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91a85eb3d200/0xa2426164df2c78e7 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783441474.547488:0:5785:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91a85eb3d200/0xa2426164df2c78e7 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783441474.547684:0:5785:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff91a85eb3d600/0xa2426164df2c78ee lrc: 3/0,1 mode: --/PW res: [0x200000401:0x1:0x0].0x48a8de3 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783441474.547708:0:5785:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91a85eb3d600/0xa2426164df2c78ee lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0x48a8de3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783441474.547726:0:5785:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91a85eb3d600/0xa2426164df2c78ee lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0x48a8de3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:3.0:1783441474.549468:0:5785:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x2:0x0], index 0: 0 00010000:00010000:3.0:1783441474.551412:0:5785:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff91a841476800/0xa2426164df2c78f5 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783441474.551431:0:5785:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91a841476800/0xa2426164df2c78f5 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783441474.551443:0:5785:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91a841476800/0xa2426164df2c78f5 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783441474.551477:0:5785:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff91a85eb3d200/0xa2426164df2c78e7 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783441474.551484:0:5785:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff91a85eb3d200/0xa2426164df2c78e7 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783441474.551492:0:5785:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff91a85eb3d200/0xa2426164df2c78e7 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783441474.551504:0:5785:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91a85eb3d200 already unused, calling callback (ffffffffc1f9b4f0) 00010000:00010000:3.0:1783441474.551509:0:5785:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91a85eb3d200/0xa2426164df2c78e7 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783441474.551517:0:5785:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91a85eb3d200/0xa2426164df2c78e7 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783441474.551530:0:5785:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff91a8429bdd00) 00010000:00010000:3.0:1783441474.551533:0:5785:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1783441474.551537:0:5785:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff91a85eb3d200/0xa2426164df2c78e7 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783441474.551544:0:5785:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91a85eb3d200/0xa2426164df2c78e7 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1783441474.551555:0:5785:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000f0a6b86d reply state 00000000abbd5af3 transno 4294967300 ns: mdt-lustre-MDT0000_UUID lock: ffff91a85eb3d600/0xa2426164df2c78ee lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0x48a8de3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783441474.551564:0:5785:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:3.0:1783441474.551598:0:5785:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91a85eb3ce00/0xa2426164df2c78e0 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.13@tcp remote: 0x633a354aa4df4d35 expref: 10 pid: 5785 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783441474.551611:0:5785:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff91a841476800/0xa2426164df2c78f5 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.13@tcp remote: 0x633a354aa4df4d35 expref: 9 pid: 5785 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783441474.551619:0:5785:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2:0x0].0x0 (ffff91a85faee500) 00010000:00010000:3.0:1783441474.551622:0:5785:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1783441474.551624:0:5785:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91a841476800, rc 0) 00000100:00100000:3.0:1783441474.551728:0:5785:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a87d7c5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:65454767-383a-4679-a788-eba05c6e0989+10:9653:x1870073673304448:12345-192.168.201.13@tcp:101:touch.500 Request processed in 4754us (5363us total) trans 4294967300 rc 0/0 00000100:00100000:3.0:1783441474.551762:0:5785:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.13@tcp, seq: 22 00000100:00100000:1.0:1783441474.574455:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.13@tcp (source: 12345-192.168.201.13@tcp) 00010000:00010000:0.0:1783441474.574491:0:3290:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff91a85eb3d600/0xa2426164df2c78ee lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0x48a8de3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783441474.574505:0:3290:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff91a85eb3d600/0xa2426164df2c78ee lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0x48a8de3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783441474.574514:0:3290:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff91a85eb3d600/0xa2426164df2c78ee lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0x48a8de3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783441474.574521:0:3290:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91a85eb3d600 already unused, calling callback (ffffffffc1f9b4f0) 00010000:00010000:0.0:1783441474.574526:0:3290:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91a85eb3d600/0xa2426164df2c78ee lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0x48a8de3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783441474.574535:0:3290:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91a85eb3d600/0xa2426164df2c78ee lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0x48a8de3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783441474.574552:0:3290:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x48a8de3 (ffff91a85faeee00) 00010000:00010000:0.0:1783441474.574556:0:3290:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1783441474.574560:0:3290:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff91a85eb3d600/0xa2426164df2c78ee lrc: 2/0,0 mode: --/PW res: [0x200000401:0x1:0x0].0x48a8de3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783441474.574567:0:3290:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91a85eb3d600/0xa2426164df2c78ee lrc: 0/0,0 mode: --/PW res: [0x200000401:0x1:0x0].0x48a8de3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783441474.574981:0:5787:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073673304704 00000100:00100000:2.0:1783441474.574998:0:5787:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073673304704 00000100:00100000:2.0:1783441474.575080:0:5787:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.13@tcp, seq: 23 00000100:00100000:2.0:1783441474.575092:0:5787:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a87d7c4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:65454767-383a-4679-a788-eba05c6e0989+9:9653:x1870073673304704:12345-192.168.201.13@tcp:36:touch.500 00010000:00010000:2.0:1783441474.575170:0:5787:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1783441474.575210:0:5787:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91a841476800/0xa2426164df2c78f5 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.13@tcp remote: 0x633a354aa4df4d35 expref: 9 pid: 5785 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783441474.575231:0:5787:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2:0x0].0x0 (ffff91a85faee500) 00010000:00010000:2.0:1783441474.575242:0:5787:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1783441474.575311:0:5787:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff91a85f83da00/0xa2426164df2c7903 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783441474.575328:0:5787:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91a85f83da00/0xa2426164df2c7903 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783441474.575339:0:5787:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91a85f83da00/0xa2426164df2c7903 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1783441474.575512:0:5787:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000b79fcc9a reply state 000000001292f6aa transno 4294967301 ns: mdt-lustre-MDT0000_UUID lock: ffff91a85f83da00/0xa2426164df2c7903 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783441474.575523:0:5787:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1783441474.575677:0:5787:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a87d7c4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:65454767-383a-4679-a788-eba05c6e0989+10:9653:x1870073673304704:12345-192.168.201.13@tcp:36:touch.500 Request processed in 586us (1229us total) trans 4294967301 rc 0/0 00000100:00100000:2.0:1783441474.575685:0:5787:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.13@tcp, seq: 23 00010000:00010000:0.0:1783441474.582365:0:3289:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff91a85f83da00/0xa2426164df2c7903 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783441474.582383:0:3289:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff91a85f83da00/0xa2426164df2c7903 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783441474.582391:0:3289:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff91a85f83da00/0xa2426164df2c7903 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783441474.582424:0:3289:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91a85f83da00 already unused, calling callback (ffffffffc1f9b4f0) 00010000:00010000:0.0:1783441474.582429:0:3289:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91a85f83da00/0xa2426164df2c7903 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783441474.582437:0:3289:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91a85f83da00/0xa2426164df2c7903 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783441474.582455:0:3289:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2:0x0].0x0 (ffff91a8429bd000) 00010000:00010000:0.0:1783441474.582458:0:3289:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1783441474.582463:0:3289:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff91a85f83da00/0xa2426164df2c7903 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783441474.582470:0:3289:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91a85f83da00/0xa2426164df2c7903 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783441474.583115:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.13@tcp (source: 12345-192.168.201.13@tcp) 00000100:00100000:2.0:1783441474.583224:0:6605:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073673304832 00000100:00100000:2.0:1783441474.583242:0:6605:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073673304832 00000100:00100000:2.0:1783441474.583320:0:6605:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.13@tcp, seq: 24 00000100:00100000:2.0:1783441474.583331:0:6605:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a87d7c5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:65454767-383a-4679-a788-eba05c6e0989+9:9653:x1870073673304832:12345-192.168.201.13@tcp:101:touch.500 00010000:00010000:2.0:1783441474.583362:0:6605:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1783441474.583392:0:6605:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91a85f83c400/0xa2426164df2c790a lrc: 2/0,0 mode: --/CR res: [0x200000401:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x633a354aa4df4d3c expref: -99 pid: 6605 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783441474.583469:0:6605:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91a85f83c400/0xa2426164df2c790a lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x2:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.201.13@tcp remote: 0x633a354aa4df4d3c expref: 10 pid: 6605 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783441474.583486:0:6605:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff91a85f83c400/0xa2426164df2c790a lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x2:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.13@tcp remote: 0x633a354aa4df4d3c expref: 10 pid: 6605 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783441474.583528:0:6605:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2:0x0].0x0 (ffff91a8429bd800) 00010000:00010000:2.0:1783441474.583532:0:6605:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1783441474.583545:0:6605:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91a85f83c400, rc 0) 00000100:00100000:2.0:1783441474.583626:0:6605:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a87d7c5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:65454767-383a-4679-a788-eba05c6e0989+10:9653:x1870073673304832:12345-192.168.201.13@tcp:101:touch.500 Request processed in 297us (523us total) trans 0 rc 0/0 00000100:00100000:2.0:1783441474.583636:0:6605:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.13@tcp, seq: 24 00000100:00100000:1.0:1783441474.587546:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.13@tcp (source: 12345-192.168.201.13@tcp) 00000100:00100000:0.0:1783441474.587678:0:6581:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073673304960 00000100:00100000:0.0:1783441474.587687:0:6581:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073673304960 00000100:00100000:0.0:1783441474.587762:0:6581:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.13@tcp, seq: 17 00000100:00100000:0.0:1783441474.587772:0:6581:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a87d7c7100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:2351:x1870073673304960:12345-192.168.201.13@tcp:8:touch.500 00010000:00080000:0.0:1783441474.587803:0:6581:0:(ldlm_lib.c:1432:target_handle_connect()) lustre-OST0000: connection from 65454767-383a-4679-a788-eba05c6e0989@192.168.201.13@tcp t0 exp 0000000000000000 cur 312 last 0 00000020:00000080:0.0:1783441474.587839:0:6581:0:(genops.c:1406:class_connect()) connect: client 65454767-383a-4679-a788-eba05c6e0989, cookie 0xa2426164df2c7911 00002000:00100000:1.0:1783441474.588025:0:6581:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli 65454767-383a-4679-a788-eba05c6e0989/ffff91a7450e9000 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113669 ocd_grant: 3407872 ocd_index: 0 ocd_group 0 00002000:00100000:1.0:1783441474.588092:0:6581:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0000: cli supports cksum type f7, return f7 00002000:00080000:1.0:1783441474.588415:0:6581:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:1.0:1783441474.588457:0:6581:0:(import.c:65:import_set_state_nolock()) ffff91a875375000 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1783441474.588578:0:6581:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a87d7c7100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:65454767-383a-4679-a788-eba05c6e0989+6:2351:x1870073673304960:12345-192.168.201.13@tcp:8:touch.500 Request processed in 805us (1041us total) trans 0 rc 0/0 00000100:00100000:1.0:1783441474.588587:0:6581:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.13@tcp, seq: 17 00000100:00100000:1.0:1783441474.598452:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.13@tcp (source: 12345-192.168.201.13@tcp) 00000100:00100000:2.0:1783441474.598535:0:6582:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073673305088 00000100:00100000:2.0:1783441474.598545:0:6582:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073673305088 00000100:00100000:2.0:1783441474.598667:0:6582:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.13@tcp, seq: 18 00000100:00100000:2.0:1783441474.598677:0:6582:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a87d7c4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:65454767-383a-4679-a788-eba05c6e0989+6:0:x1870073673305088:12345-192.168.201.13@tcp:2:touch.500 00000100:00080000:1.0:1783441474.599439:0:5781:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:1.0:1783441474.669207:0:5773:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:2.0:1783441474.701299:0:6613:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of 65454767-383a-4679-a788-eba05c6e0989 00000001:00080000:2.0:1783441474.701327:0:6613:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967299 is committed 00000100:00100000:3.0:1783441474.701482:0:6582:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a87d7c4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:65454767-383a-4679-a788-eba05c6e0989+5:0:x1870073673305088:12345-192.168.201.13@tcp:2:touch.500 Request processed in 102800us (103033us total) trans 4294967299 rc 0/0 00000100:00100000:3.0:1783441474.701504:0:6582:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.13@tcp, seq: 18 00000100:00100000:2.0:1783441474.714948:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.13@tcp (source: 12345-192.168.201.13@tcp) 00000100:00100000:1.0:1783441474.717877:0:5788:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073673305344 00000100:00100000:1.0:1783441474.717890:0:5788:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073673305344 00000100:00100000:1.0:1783441474.717957:0:5788:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.13@tcp, seq: 2 00000100:00100000:1.0:1783441474.717974:0:5788:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a87d4ebb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:65454767-383a-4679-a788-eba05c6e0989+10:9653:x1870073673305344:12345-192.168.201.13@tcp:35:touch.500 00000100:00100000:1.0:1783441474.718321:0:5788:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a87d4ebb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:65454767-383a-4679-a788-eba05c6e0989+11:9653:x1870073673305344:12345-192.168.201.13@tcp:35:touch.500 Request processed in 355us (3382us total) trans 4294967302 rc 0/0 00000100:00100000:1.0:1783441474.718329:0:5788:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.13@tcp, seq: 2 00000100:00100000:2.0:1783441474.770557:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.13@tcp (source: 12345-192.168.201.13@tcp) 00000100:00100000:1.0:1783441474.770698:0:5787:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073673305472 00000100:00100000:1.0:1783441474.770708:0:5787:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073673305472 00000100:00100000:1.0:1783441474.770798:0:5787:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.13@tcp, seq: 25 00000100:00100000:1.0:1783441474.770808:0:5787:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a87d4ead80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:65454767-383a-4679-a788-eba05c6e0989+11:9654:x1870073673305472:12345-192.168.201.13@tcp:101:rm.0 00010000:00010000:1.0:1783441474.770833:0:5787:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1783441474.771129:0:5787:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91a87da47c00/0xa2426164df2c7918 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x633a354aa4df4d43 expref: -99 pid: 5787 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783441474.771243:0:5787:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff91a87da47800/0xa2426164df2c791f lrc: 3/1,0 mode: --/PR res: [0x200000401:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783441474.771270:0:5787:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91a87da47800/0xa2426164df2c791f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783441474.771281:0:5787:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91a87da47800/0xa2426164df2c791f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1783441474.771348:0:5787:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x1:0x0]: returning size 7680 00000004:00200000:1.0:1783441474.771351:0:5787:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 1 stripe count 1 MDT count 1 00000004:00010000:1.0:1783441474.771387:0:5787:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff91a87da47800/0xa2426164df2c791f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783441474.771431:0:5787:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91a87da47c00/0xa2426164df2c7918 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.13@tcp remote: 0x633a354aa4df4d43 expref: 13 pid: 5787 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783441474.771470:0:5787:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff91a87da47800/0xa2426164df2c791f lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.13@tcp remote: 0x633a354aa4df4d43 expref: 12 pid: 5787 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783441474.771480:0:5787:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff91a8429bdd00) 00010000:00010000:1.0:1783441474.771483:0:5787:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1783441474.771540:0:5787:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91a87da47800, rc 0) 00000100:00100000:1.0:1783441474.771598:0:5787:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a87d4ead80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:65454767-383a-4679-a788-eba05c6e0989+12:9654:x1870073673305472:12345-192.168.201.13@tcp:101:rm.0 Request processed in 791us (1050us total) trans 0 rc 0/0 00000100:00100000:1.0:1783441474.771605:0:5787:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.13@tcp, seq: 25 00000100:00100000:2.0:1783441474.781264:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.13@tcp (source: 12345-192.168.201.13@tcp) 00000100:00100000:3.0:1783441474.781674:0:5785:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073673305728 00000100:00100000:3.0:1783441474.781684:0:5785:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073673305728 00000100:00100000:3.0:1783441474.781739:0:5785:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.13@tcp, seq: 26 00000100:00100000:3.0:1783441474.781794:0:5785:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a844b7ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:65454767-383a-4679-a788-eba05c6e0989+12:9654:x1870073673305728:12345-192.168.201.13@tcp:101:rm.0 00010000:00010000:3.0:1783441474.781815:0:5785:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1783441474.781833:0:5785:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91a841477800/0xa2426164df2c7926 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x633a354aa4df4d4a expref: -99 pid: 5785 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1783441474.781948:0:5785:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x1:0x0]: returning size 7680 00010000:00010000:3.0:1783441474.782289:0:5785:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff91a841477800/0xa2426164df2c7926 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.13@tcp remote: 0x633a354aa4df4d4a expref: 14 pid: 5785 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783441474.782305:0:5785:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff91a8429bd600) 00010000:00010000:3.0:1783441474.782308:0:5785:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1783441474.782313:0:5785:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91a841477800/0xa2426164df2c7926 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.13@tcp remote: 0x633a354aa4df4d4a expref: 14 pid: 5785 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783441474.782327:0:5785:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91a841477800, rc 0) 00000100:00100000:3.0:1783441474.782386:0:5785:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a844b7ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:65454767-383a-4679-a788-eba05c6e0989+13:9654:x1870073673305728:12345-192.168.201.13@tcp:101:rm.0 Request processed in 594us (1131us total) trans 4294967303 rc 301/301 00000100:00100000:3.0:1783441474.782393:0:5785:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.13@tcp, seq: 26 00000100:00100000:2.0:1783441474.786449:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.13@tcp (source: 12345-192.168.201.13@tcp) 00000100:00100000:1.0:1783441474.786543:0:5788:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073673305856 00000100:00100000:1.0:1783441474.786552:0:5788:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073673305856 00000100:00100000:1.0:1783441474.786611:0:5788:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.13@tcp, seq: 3 00000100:00100000:1.0:1783441474.786621:0:5788:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a844b7c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:65454767-383a-4679-a788-eba05c6e0989+13:9654:x1870073673305856:12345-192.168.201.13@tcp:37:rm.0 00000100:00100000:1.0:1783441474.806928:0:5788:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a844b7c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:65454767-383a-4679-a788-eba05c6e0989+13:9654:x1870073673305856:12345-192.168.201.13@tcp:37:rm.0 Request processed in 20296us (20476us total) trans 0 rc 0/0 00000100:00100000:1.0:1783441474.806944:0:5788:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.13@tcp, seq: 3 00000100:00100000:0.0:1783441474.815451:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.13@tcp (source: 12345-192.168.201.13@tcp) 00000100:00100000:2.0:1783441474.816182:0:5789:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073673306112 00000100:00100000:2.0:1783441474.816192:0:5789:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073673306112 00000100:00100000:2.0:1783441474.816280:0:5789:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.13@tcp, seq: 4 00000100:00100000:2.0:1783441474.816290:0:5789:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a8468aa850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:65454767-383a-4679-a788-eba05c6e0989+13:9654:x1870073673306112:12345-192.168.201.13@tcp:35:rm.0 00000100:00100000:2.0:1783441474.816572:0:5789:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a8468aa850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:65454767-383a-4679-a788-eba05c6e0989+14:9654:x1870073673306112:12345-192.168.201.13@tcp:35:rm.0 Request processed in 283us (1132us total) trans 4294967304 rc 0/0 00000100:00100000:2.0:1783441474.816580:0:5789:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.13@tcp, seq: 4 00000100:00100000:2.0:1783441474.825565:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.13@tcp (source: 12345-192.168.201.13@tcp) 00000100:00100000:1.0:1783441474.825799:0:5787:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073673306368 00000100:00100000:1.0:1783441474.825816:0:5787:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073673306368 00000100:00100000:1.0:1783441474.825915:0:5787:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.13@tcp, seq: 27 00000100:00100000:1.0:1783441474.825924:0:5787:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a844b7c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:65454767-383a-4679-a788-eba05c6e0989+14:9654:x1870073673306368:12345-192.168.201.13@tcp:101:rm.0 00010000:00010000:1.0:1783441474.825975:0:5787:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1783441474.825997:0:5787:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91a87da47c00/0xa2426164df2c7934 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x633a354aa4df4d51 expref: -99 pid: 5787 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783441474.826111:0:5787:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff91a87da47a00/0xa2426164df2c793b lrc: 3/1,0 mode: --/CR res: [0x200000401:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783441474.826125:0:5787:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91a87da47a00/0xa2426164df2c793b lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x1:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783441474.826136:0:5787:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91a87da47a00/0xa2426164df2c793b lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x1:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1783441474.826146:0:5787:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x1:0x0]: returning size 7680 00010000:00010000:1.0:1783441474.826268:0:5787:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91a87da47c00/0xa2426164df2c7934 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.13@tcp remote: 0x633a354aa4df4d51 expref: 17 pid: 5787 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783441474.826290:0:5787:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff91a87da47a00/0xa2426164df2c793b lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x1:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.13@tcp remote: 0x633a354aa4df4d51 expref: 16 pid: 5787 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783441474.826299:0:5787:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff91a8429bdd00) 00010000:00010000:1.0:1783441474.826302:0:5787:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:1.0:1783441474.826306:0:5787:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91a87da47a00, rc 0) 00000100:00100000:1.0:1783441474.826376:0:5787:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a844b7c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:65454767-383a-4679-a788-eba05c6e0989+16:9654:x1870073673306368:12345-192.168.201.13@tcp:101:rm.0 Request processed in 452us (825us total) trans 4294967305 rc 0/0 00000100:00100000:1.0:1783441474.826383:0:5787:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.13@tcp, seq: 27 00000100:00100000:3.0:1783441474.844816:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.13@tcp (source: 12345-192.168.201.13@tcp) 00000100:00100000:2.0:1783441474.844946:0:6605:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073673306496 00000100:00100000:2.0:1783441474.844964:0:6605:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073673306496 00000100:00100000:2.0:1783441474.845042:0:6605:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.13@tcp, seq: 28 00000100:00100000:2.0:1783441474.845054:0:6605:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a877fae300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:65454767-383a-4679-a788-eba05c6e0989+16:9654:x1870073673306496:12345-192.168.201.13@tcp:41:rm.0 00000004:00000024:2.0:1783441474.845137:0:6605:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 6815744 pending 0 free 7718567936 avail 7714373632 00000100:00100000:2.0:1783441474.845233:0:6605:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a877fae300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:65454767-383a-4679-a788-eba05c6e0989+16:9654:x1870073673306496:12345-192.168.201.13@tcp:41:rm.0 Request processed in 181us (431us total) trans 0 rc 0/0 00000100:00100000:2.0:1783441474.845242:0:6605:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.13@tcp, seq: 28 00000100:00100000:2.0:1783441474.853914:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.13@tcp (source: 12345-192.168.201.13@tcp) 00000100:00100000:1.0:1783441474.854921:0:5787:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073673306624 00000100:00100000:1.0:1783441474.854952:0:5787:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073673306624 00000100:00100000:1.0:1783441474.855036:0:5787:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.13@tcp, seq: 29 00000100:00100000:1.0:1783441474.855058:0:5787:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a844b7dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:65454767-383a-4679-a788-eba05c6e0989+16:9654:x1870073673306624:12345-192.168.201.13@tcp:101:rm.0 00010000:00010000:1.0:1783441474.855078:0:5787:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1783441474.855546:0:5787:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91a87da47400/0xa2426164df2c7949 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x633a354aa4df4d58 expref: -99 pid: 5787 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783441474.855621:0:5787:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff91a87da46200/0xa2426164df2c7950 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783441474.855646:0:5787:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91a87da46200/0xa2426164df2c7950 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783441474.855657:0:5787:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91a87da46200/0xa2426164df2c7950 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783441474.855671:0:5787:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff91a87da47c00/0xa2426164df2c7957 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x1:0x0].0x48a8de3 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783441474.855678:0:5787:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91a87da47c00/0xa2426164df2c7957 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x48a8de3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783441474.855685:0:5787:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91a87da47c00/0xa2426164df2c7957 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x48a8de3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783441474.855837:0:5787:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff91a87da46000/0xa2426164df2c795e lrc: 3/1,0 mode: --/PR res: [0x200000401:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783441474.855846:0:5787:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91a87da46000/0xa2426164df2c795e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783441474.855959:0:5787:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91a87da46000/0xa2426164df2c795e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1783441474.855996:0:5787:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x2:0x0]: returning size 0 00000004:00200000:1.0:1783441474.856001:0:5787:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:1.0:1783441474.856021:0:5787:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff91a87da46000/0xa2426164df2c795e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783441474.856033:0:5787:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91a87da46000/0xa2426164df2c795e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783441474.856204:0:5787:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff91a87da46200/0xa2426164df2c7950 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783441474.856210:0:5787:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff91a87da46200/0xa2426164df2c7950 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783441474.856217:0:5787:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff91a87da46200/0xa2426164df2c7950 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783441474.856222:0:5787:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91a87da46200 already unused, calling callback (ffffffffc1f9b4f0) 00010000:00010000:1.0:1783441474.856227:0:5787:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91a87da46200/0xa2426164df2c7950 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783441474.856234:0:5787:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91a87da46200/0xa2426164df2c7950 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783441474.856246:0:5787:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff91a8429bdd00) 00010000:00010000:1.0:1783441474.856249:0:5787:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1783441474.856253:0:5787:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff91a87da46200/0xa2426164df2c7950 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783441474.856260:0:5787:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91a87da46200/0xa2426164df2c7950 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783441474.856287:0:5787:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff91a87da47c00/0xa2426164df2c7957 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x48a8de3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783441474.856293:0:5787:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff91a87da47c00/0xa2426164df2c7957 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x48a8de3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783441474.856299:0:5787:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff91a87da47c00/0xa2426164df2c7957 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x48a8de3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783441474.856304:0:5787:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91a87da47c00 already unused, calling callback (ffffffffc1f9b4f0) 00010000:00010000:1.0:1783441474.856308:0:5787:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91a87da47c00/0xa2426164df2c7957 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x48a8de3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783441474.856314:0:5787:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91a87da47c00/0xa2426164df2c7957 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x48a8de3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783441474.856322:0:5787:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x48a8de3 (ffff91a858b90f00) 00010000:00010000:1.0:1783441474.856324:0:5787:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1783441474.856327:0:5787:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff91a87da47c00/0xa2426164df2c7957 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x1:0x0].0x48a8de3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783441474.856332:0:5787:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91a87da47c00/0xa2426164df2c7957 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x1:0x0].0x48a8de3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783441474.856366:0:5787:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91a87da47400/0xa2426164df2c7949 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.13@tcp remote: 0x633a354aa4df4d58 expref: 18 pid: 5787 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783441474.856379:0:5787:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff91a87da46000/0xa2426164df2c795e lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.13@tcp remote: 0x633a354aa4df4d58 expref: 17 pid: 5787 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783441474.856407:0:5787:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2:0x0].0x0 (ffff91a8429bd800) 00010000:00010000:1.0:1783441474.856409:0:5787:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1783441474.856412:0:5787:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91a87da46000, rc 0) 00000100:00100000:1.0:1783441474.856490:0:5787:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a844b7dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:65454767-383a-4679-a788-eba05c6e0989+17:9654:x1870073673306624:12345-192.168.201.13@tcp:101:rm.0 Request processed in 1434us (2591us total) trans 0 rc 0/0 00000100:00100000:1.0:1783441474.856498:0:5787:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.13@tcp, seq: 29 00000100:00100000:1.0:1783441474.869499:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.13@tcp (source: 12345-192.168.201.13@tcp) 00000100:00100000:2.0:1783441474.869604:0:6605:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073673306880 00000100:00100000:2.0:1783441474.869619:0:6605:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073673306880 00000100:00100000:2.0:1783441474.869710:0:6605:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.13@tcp, seq: 30 00000100:00100000:2.0:1783441474.869722:0:6605:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a87d7c6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:65454767-383a-4679-a788-eba05c6e0989+17:9654:x1870073673306880:12345-192.168.201.13@tcp:36:rm.0 00010000:00010000:2.0:1783441474.869845:0:6605:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 3 locks, starting at 0 00010000:00010000:2.0:1783441474.869878:0:6605:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91a87da46000/0xa2426164df2c795e lrc: 0/0,0 mode: --/PR res: [0x200000401:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.13@tcp remote: 0x633a354aa4df4d58 expref: 17 pid: 5787 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783441474.869905:0:6605:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91a85f83c400/0xa2426164df2c790a lrc: 0/0,0 mode: --/CR res: [0x200000401:0x2:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.13@tcp remote: 0x633a354aa4df4d3c expref: 16 pid: 6605 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783441474.869918:0:6605:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2:0x0].0x0 (ffff91a8429bd800) 00010000:00010000:2.0:1783441474.869936:0:6605:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91a87da47800/0xa2426164df2c791f lrc: 0/0,0 mode: --/PR res: [0x200000401:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.13@tcp remote: 0x633a354aa4df4d43 expref: 15 pid: 5787 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783441474.869947:0:6605:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff91a8429bdd00) 00010000:00010000:2.0:1783441474.869950:0:6605:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1783441474.869988:0:6605:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff91a85f83c600/0xa2426164df2c7965 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6605 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783441474.870023:0:6605:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91a85f83c600/0xa2426164df2c7965 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6605 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783441474.870034:0:6605:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91a85f83c600/0xa2426164df2c7965 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6605 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783441474.870050:0:6605:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff91a85f83da00/0xa2426164df2c796c lrc: 3/0,1 mode: --/PW res: [0x200000401:0x1:0x0].0x48a8de3 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6605 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783441474.870058:0:6605:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91a85f83da00/0xa2426164df2c796c lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0x48a8de3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6605 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783441474.870065:0:6605:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91a85f83da00/0xa2426164df2c796c lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0x48a8de3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6605 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783441474.870245:0:6605:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff91a85f83c000/0xa2426164df2c7973 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6605 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783441474.870253:0:6605:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91a85f83c000/0xa2426164df2c7973 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x2:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6605 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783441474.870260:0:6605:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91a85f83c000/0xa2426164df2c7973 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x2:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6605 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1783441474.871246:0:6605:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].2, 64 off8320 00000004:00080000:2.0:1783441474.871261:0:6605:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 312745518718ns, next at 313745515845ns, rc = 0 00010000:00010000:2.0:1783441474.871344:0:6605:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff91a85f83d600/0xa2426164df2c797a lrc: 3/0,1 mode: --/PW res: [0x200000401:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6605 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783441474.871360:0:6605:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91a85f83d600/0xa2426164df2c797a lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 6605 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783441474.871383:0:6605:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91a85f83d600/0xa2426164df2c797a lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 6605 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783441474.871394:0:6605:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff91a85f83d600/0xa2426164df2c797a lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 6605 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783441474.871401:0:6605:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff91a85f83d600/0xa2426164df2c797a lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 6605 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783441474.871406:0:6605:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff91a85f83d600/0xa2426164df2c797a lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 6605 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783441474.871438:0:6605:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1783441474.871464:0:6605:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff91a85f83c000/0xa2426164df2c7973 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x2:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6605 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783441474.871472:0:6605:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff91a85f83c000/0xa2426164df2c7973 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x2:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6605 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783441474.871478:0:6605:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff91a85f83c000/0xa2426164df2c7973 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x2:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6605 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783441474.871485:0:6605:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91a85f83c000 already unused, calling callback (ffffffffc1f9b4f0) 00010000:00010000:2.0:1783441474.871490:0:6605:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91a85f83c000/0xa2426164df2c7973 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x2:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6605 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783441474.871500:0:6605:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91a85f83c000/0xa2426164df2c7973 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x2:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6605 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783441474.871515:0:6605:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2:0x0].0x0 (ffff91a8429bdf00) 00010000:00010000:2.0:1783441474.871520:0:6605:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:0.0:1783441474.871526:0:5772:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1783441474.871533:0:6605:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff91a85f83c000/0xa2426164df2c7973 lrc: 2/0,0 mode: --/EX res: [0x200000401:0x2:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6605 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783441474.871540:0:5772:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff91a85f83d600/0xa2426164df2c797a lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40010480000000 pid: 6605 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783441474.871543:0:6605:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91a85f83c000/0xa2426164df2c7973 lrc: 0/0,0 mode: --/EX res: [0x200000401:0x2:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6605 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783441474.871572:0:5772:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91a85f83d600 already unused, calling callback (ffffffffc155ff90) 00010000:00010000:0.0:1783441474.871580:0:5772:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91a85f83d600/0xa2426164df2c797a lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 6605 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783441474.871589:0:6605:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff91a85f83c600/0xa2426164df2c7965 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6605 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783441474.871603:0:6605:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff91a85f83c600/0xa2426164df2c7965 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6605 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783441474.871619:0:6605:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff91a85f83c600/0xa2426164df2c7965 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6605 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783441474.871621:0:5772:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91a85f83d600/0xa2426164df2c797a lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 6605 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783441474.871631:0:6605:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91a85f83c600 already unused, calling callback (ffffffffc1f9b4f0) 00010000:00010000:2.0:1783441474.871655:0:6605:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91a85f83c600/0xa2426164df2c7965 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6605 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783441474.871659:0:5772:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2:0x0].0x0 (ffff91a8429bdf00) 00010000:00010000:2.0:1783441474.871669:0:6605:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91a85f83c600/0xa2426164df2c7965 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6605 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783441474.871669:0:5772:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:0.0:1783441474.871679:0:5772:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff91a85f83d600/0xa2426164df2c797a lrc: 1/0,0 mode: --/PW res: [0x200000401:0x2:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 6605 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783441474.871686:0:6605:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff91a8429bdd00) 00010000:00010000:0.0:1783441474.871688:0:5772:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91a85f83d600/0xa2426164df2c797a lrc: 0/0,0 mode: --/PW res: [0x200000401:0x2:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 6605 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783441474.871692:0:6605:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1783441474.871699:0:6605:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff91a85f83c600/0xa2426164df2c7965 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6605 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783441474.871709:0:6605:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91a85f83c600/0xa2426164df2c7965 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6605 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1783441474.871723:0:6605:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000c1e52ae9 reply state 000000006b16bc65 transno 4294967306 ns: mdt-lustre-MDT0000_UUID lock: ffff91a85f83da00/0xa2426164df2c796c lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0x48a8de3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6605 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783441474.871728:0:5772:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783441474.871732:0:5772:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783441474.871734:0:5772:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1783441474.871789:0:6605:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1783441474.871910:0:6605:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a87d7c6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:65454767-383a-4679-a788-eba05c6e0989+16:9654:x1870073673306880:12345-192.168.201.13@tcp:36:rm.0 Request processed in 2183us (2412us total) trans 4294967306 rc 0/0 00000100:00100000:2.0:1783441474.871921:0:6605:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.13@tcp, seq: 30 00010000:00010000:0.0:1783441474.876894:0:3290:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff91a85f83da00/0xa2426164df2c796c lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0x48a8de3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6605 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783441474.876914:0:3290:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff91a85f83da00/0xa2426164df2c796c lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0x48a8de3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6605 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783441474.876921:0:3290:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff91a85f83da00/0xa2426164df2c796c lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0x48a8de3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6605 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783441474.876928:0:3290:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91a85f83da00 already unused, calling callback (ffffffffc1f9b4f0) 00010000:00010000:0.0:1783441474.876933:0:3290:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91a85f83da00/0xa2426164df2c796c lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0x48a8de3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6605 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783441474.876941:0:3290:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91a85f83da00/0xa2426164df2c796c lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0x48a8de3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6605 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783441474.876958:0:3290:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x48a8de3 (ffff91a8429bd100) 00010000:00010000:0.0:1783441474.876977:0:3290:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1783441474.876982:0:3290:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff91a85f83da00/0xa2426164df2c796c lrc: 2/0,0 mode: --/PW res: [0x200000401:0x1:0x0].0x48a8de3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6605 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783441474.876988:0:3290:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91a85f83da00/0xa2426164df2c796c lrc: 0/0,0 mode: --/PW res: [0x200000401:0x1:0x0].0x48a8de3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6605 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783441474.877881:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.13@tcp (source: 12345-192.168.201.13@tcp) 00000100:00100000:2.0:1783441474.879889:0:5788:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073673307136 00000100:00100000:2.0:1783441474.879910:0:5788:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073673307136 00000100:00100000:2.0:1783441474.881132:0:5788:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.13@tcp, seq: 5 00000100:00100000:2.0:1783441474.881154:0:5788:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a87d7c7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:65454767-383a-4679-a788-eba05c6e0989+15:9654:x1870073673307136:12345-192.168.201.13@tcp:35:rm.0 00000100:00100000:2.0:1783441474.881510:0:5788:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a87d7c7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:65454767-383a-4679-a788-eba05c6e0989+16:9654:x1870073673307136:12345-192.168.201.13@tcp:35:rm.0 Request processed in 363us (3633us total) trans 4294967307 rc 0/0 00000100:00100000:2.0:1783441474.881518:0:5788:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.13@tcp, seq: 5 00000100:00100000:3.0:1783441474.887452:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.13@tcp (source: 12345-192.168.201.13@tcp) 00000100:00100000:0.0:1783441474.887597:0:5786:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073673307392 00000100:00100000:0.0:1783441474.887611:0:5786:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073673307392 00000100:00100000:0.0:1783441474.887711:0:5786:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.13@tcp, seq: 31 00000100:00100000:0.0:1783441474.887722:0:5786:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a877faf800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:65454767-383a-4679-a788-eba05c6e0989+16:9654:x1870073673307392:12345-192.168.201.13@tcp:36:rm.0 00010000:00010000:0.0:1783441474.887811:0:5786:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 3 locks, starting at 0 00010000:00010000:0.0:1783441474.887841:0:5786:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91a87da47a00/0xa2426164df2c793b lrc: 0/0,0 mode: --/CR res: [0x200000401:0x1:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.13@tcp remote: 0x633a354aa4df4d51 expref: 16 pid: 5787 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783441474.887882:0:5786:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91a85f83d000/0xa2426164df2c78d9 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x1:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.13@tcp remote: 0x633a354aa4df4d2e expref: 15 pid: 5786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783441474.887896:0:5786:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff91a8429bdd00) 00010000:00010000:0.0:1783441474.887914:0:5786:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91a85f83d800/0xa2426164df2c789a lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.13@tcp remote: 0x633a354aa4df4d20 expref: 14 pid: 5785 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783441474.887922:0:5786:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff91a8429bd600) 00010000:00010000:0.0:1783441474.887928:0:5786:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1783441474.887952:0:5786:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff91a85fe58600/0xa2426164df2c7981 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783441474.887965:0:5786:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91a85fe58600/0xa2426164df2c7981 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783441474.887993:0:5786:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91a85fe58600/0xa2426164df2c7981 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783441474.888008:0:5786:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff91a85fe59000/0xa2426164df2c7988 lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783441474.888015:0:5786:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91a85fe59000/0xa2426164df2c7988 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783441474.888022:0:5786:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91a85fe59000/0xa2426164df2c7988 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783441474.888338:0:5786:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff91a85fe58000/0xa2426164df2c798f lrc: 3/0,1 mode: --/EX res: [0x200000401:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783441474.888347:0:5786:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91a85fe58000/0xa2426164df2c798f lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783441474.888354:0:5786:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91a85fe58000/0xa2426164df2c798f lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1783441474.889016:0:5786:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x1:0x0]: returning size 7680 00010000:00010000:0.0:1783441474.889034:0:5786:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff91a85fe58000/0xa2426164df2c798f lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783441474.889043:0:5786:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff91a85fe58000/0xa2426164df2c798f lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783441474.889050:0:5786:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff91a85fe58000/0xa2426164df2c798f lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783441474.889056:0:5786:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91a85fe58000 already unused, calling callback (ffffffffc1f9b4f0) 00010000:00010000:0.0:1783441474.889065:0:5786:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91a85fe58000/0xa2426164df2c798f lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783441474.889074:0:5786:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91a85fe58000/0xa2426164df2c798f lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783441474.889085:0:5786:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff91a8439b0500) 00010000:00010000:0.0:1783441474.889088:0:5786:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:0.0:1783441474.889091:0:5786:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff91a85fe58000/0xa2426164df2c798f lrc: 2/0,0 mode: --/EX res: [0x200000401:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783441474.889097:0:5786:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91a85fe58000/0xa2426164df2c798f lrc: 0/0,0 mode: --/EX res: [0x200000401:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783441474.889114:0:5786:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff91a85fe58600/0xa2426164df2c7981 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783441474.889121:0:5786:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff91a85fe58600/0xa2426164df2c7981 lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783441474.889127:0:5786:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff91a85fe58600/0xa2426164df2c7981 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783441474.889132:0:5786:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91a85fe58600 already unused, calling callback (ffffffffc1f9b4f0) 00010000:00010000:0.0:1783441474.889134:0:5786:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91a85fe58600/0xa2426164df2c7981 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783441474.889140:0:5786:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91a85fe58600/0xa2426164df2c7981 lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783441474.889146:0:5786:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff91a8439b0c00) 00010000:00010000:0.0:1783441474.889148:0:5786:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1783441474.889158:0:5786:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff91a85fe58600/0xa2426164df2c7981 lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783441474.889163:0:5786:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91a85fe58600/0xa2426164df2c7981 lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1783441474.889175:0:5786:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 000000000d591f89 reply state 00000000f856c74e transno 4294967308 ns: mdt-lustre-MDT0000_UUID lock: ffff91a85fe59000/0xa2426164df2c7988 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783441474.889184:0:5786:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1783441474.889276:0:5786:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a877faf800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:65454767-383a-4679-a788-eba05c6e0989+15:9654:x1870073673307392:12345-192.168.201.13@tcp:36:rm.0 Request processed in 1552us (1835us total) trans 4294967308 rc 0/0 00000100:00100000:0.0:1783441474.889283:0:5786:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.13@tcp, seq: 31 00010000:00010000:3.0:1783441474.896356:0:3289:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff91a85fe59000/0xa2426164df2c7988 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783441474.896373:0:3289:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff91a85fe59000/0xa2426164df2c7988 lrc: 2/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783441474.896380:0:3289:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff91a85fe59000/0xa2426164df2c7988 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783441474.896387:0:3289:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91a85fe59000 already unused, calling callback (ffffffffc1f9b4f0) 00010000:00010000:3.0:1783441474.896392:0:3289:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91a85fe59000/0xa2426164df2c7988 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783441474.896410:0:3289:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91a85fe59000/0xa2426164df2c7988 lrc: 4/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783441474.896426:0:3289:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x792b1d9 (ffff91a8439b0e00) 00010000:00010000:3.0:1783441474.896429:0:3289:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1783441474.896433:0:3289:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff91a85fe59000/0xa2426164df2c7988 lrc: 2/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783441474.896440:0:3289:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91a85fe59000/0xa2426164df2c7988 lrc: 0/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783441475.694719:0:5773:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783441476.730058:0:5772:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1783441476.973016:0:3305:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff91a877fad500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:6c1ddb50-5795-40c6-a2b6-8f58add9da62:3305:1870073693264768:0@lo:400:kworker.0 00000100:00100000:2.0:1783441476.973093:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783441476.973583:0:5780:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073693264768 00000100:00100000:0.0:1783441476.973591:0:5780:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073693264768 00000100:00100000:0.0:1783441476.973656:0:5780:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 250 00000100:00100000:0.0:1783441476.973666:0:5780:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a8655e5c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6c1ddb50-5795-40c6-a2b6-8f58add9da62+19:3305:x1870073693264768:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1783441476.973912:0:3306:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff91a877fac000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3306:1870073693264896:0@lo:400:kworker.0 00000100:00100000:1.0:1783441476.973945:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783441476.978006:0:5780:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a8655e5c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6c1ddb50-5795-40c6-a2b6-8f58add9da62+19:3305:x1870073693264768:12345-0@lo:400:kworker.0 Request processed in 4332us (4903us total) trans 0 rc 0/0 00000100:00100000:0.0:1783441476.978021:0:5780:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 250 00000100:00100000:0.0:1783441476.978099:0:6605:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073693264896 00000100:00100000:0.0:1783441476.978107:0:6605:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073693264896 00000100:00100000:0.0:1783441476.978158:0:6605:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 110 00000100:00100000:0.0:1783441476.978166:0:6605:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a87d7c5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3306:x1870073693264896:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1783441476.978238:0:6605:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a87d7c5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3306:x1870073693264896:12345-0@lo:400:kworker.0 Request processed in 72us (4292us total) trans 0 rc 0/0 00000100:00100000:0.0:1783441476.978245:0:6605:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 110 00000100:00100000:0.0:1783441476.978285:0:3306:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff91a877fac000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3306:1870073693264896:0@lo:400:kworker.0 00000100:00100000:1.0:1783441476.978551:0:3303:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff91a877fac380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3303:1870073693265024:0@lo:400:kworker.0 00000100:00100000:1.0:1783441476.978587:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783441476.978627:0:3303:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1783441476.978633:0:3303:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff91a877faf480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3303:1870073693265152:0@lo:400:kworker.0 00000100:00100000:1.0:1783441476.978658:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783441476.978781:0:5786:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073693265024 00000100:00100000:3.0:1783441476.978785:0:5786:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073693265024 00000100:00100000:3.0:1783441476.978828:0:5786:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 111 00000100:00100000:3.0:1783441476.978836:0:5786:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a87d7c4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3303:x1870073693265024:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1783441476.978873:0:5786:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a87d7c4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3303:x1870073693265024:12345-0@lo:400:kworker.0 Request processed in 38us (286us total) trans 0 rc 0/0 00000100:00100000:3.0:1783441476.978895:0:5786:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 111 00000100:00100000:3.0:1783441476.978923:0:8557:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073693265152 00000100:00100000:3.0:1783441476.978926:0:8557:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073693265152 00000100:00100000:3.0:1783441476.978952:0:8557:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 61 00000100:00100000:3.0:1783441476.978958:0:8557:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a87d7c4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3303:x1870073693265152:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1783441476.978988:0:8557:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a87d7c4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3303:x1870073693265152:12345-0@lo:400:kworker.0 Request processed in 30us (329us total) trans 0 rc 0/0 00000100:00100000:3.0:1783441476.978994:0:8557:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 61 00000100:00080000:1.0:1783441476.979058:0:5781:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1783441476.979064:0:5781:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:1.0:1783441476.979088:0:3303:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff91a877faf480 x1870073693265152/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1783441492 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1783441476.979100:0:3303:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff91a877faf480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3303:1870073693265152:0@lo:400:kworker.0 00000100:00100000:1.0:1783441476.979110:0:3303:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff91a877fac380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3303:1870073693265024:0@lo:400:kworker.0 00000100:00100000:0.0:1783441476.979178:0:3306:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff91a877fae680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3306:1870073693265408:0@lo:400:kworker.0 00000100:00100000:0.0:1783441476.979212:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783441476.979236:0:3306:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1783441476.979242:0:3306:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff91a877fad880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3306:1870073693265280:0@lo:400:kworker.0 00000100:00100000:0.0:1783441476.979262:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783441476.979332:0:6605:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073693265280 00000100:00100000:1.0:1783441476.979336:0:6605:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073693265280 00000100:00100000:1.0:1783441476.979381:0:6605:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 112 00000100:00100000:1.0:1783441476.979387:0:6605:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a87d805f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3306:x1870073693265280:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1783441476.979418:0:6605:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a87d805f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3306:x1870073693265280:12345-0@lo:400:kworker.0 Request processed in 31us (155us total) trans 0 rc 0/0 00000100:00100000:1.0:1783441476.979424:0:6605:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 112 00000100:00080000:0.0:1783441476.979477:0:5781:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1783441476.979495:0:3306:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff91a877fad880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3306:1870073693265280:0@lo:400:kworker.0 00000100:00100000:3.0:1783441476.979559:0:6583:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073693265408 00000100:00100000:3.0:1783441476.979563:0:6583:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073693265408 00000100:00100000:3.0:1783441476.979614:0:6583:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 62 00000100:00100000:3.0:1783441476.979621:0:6583:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a87d806a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3306:x1870073693265408:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1783441476.979655:0:6583:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a87d806a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3306:x1870073693265408:12345-0@lo:400:kworker.0 Request processed in 35us (443us total) trans 0 rc 0/0 00000100:00100000:3.0:1783441476.979661:0:6583:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 62 00000100:00080000:0.0:1783441476.979807:0:5781:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00080000:0.0:1783441476.979825:0:3306:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff91a877fae680 x1870073693265408/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1783441492 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1783441476.979835:0:3306:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff91a877fae680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3306:1870073693265408:0@lo:400:kworker.0 00000100:00100000:2.0:1783441476.982069:0:3305:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff91a877fad500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:6c1ddb50-5795-40c6-a2b6-8f58add9da62:3305:1870073693264768:0@lo:400:kworker.0 00000100:00100000:1.0:1783441477.485384:0:3303:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff91a844b7f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3303:1870073693265536:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1783441477.485454:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783441477.488520:0:6585:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073693265536 00000100:00100000:3.0:1783441477.488534:0:6585:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073693265536 00000100:00100000:3.0:1783441477.488620:0:6585:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 50 00000100:00100000:3.0:1783441477.488630:0:6585:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a87d7c7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3303:x1870073693265536:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1783441477.488667:0:6585:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3858759680 avail 3856662528 00000100:00100000:3.0:1783441477.488836:0:6585:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a87d7c7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3303:x1870073693265536:12345-0@lo:13:osp-pre-1-0.0 Request processed in 112us (3287us total) trans 0 rc 0/0 00000100:00100000:3.0:1783441477.488846:0:6585:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 50 00010000:00080000:1.0:1783441477.490339:0:3303:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff91a844b7f800 x1870073693265536/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1783441493 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1783441477.490366:0:3303:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff91a844b7f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3303:1870073693265536:0@lo:13:osp-pre-1-0.0 00010000:00010000:3.0:1783441477.742073:0:5773:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1783441478.509391:0:3304:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff91a877fafb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3304:1870073693265664:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1783441478.509478:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783441478.509615:0:6585:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073693265664 00000100:00100000:2.0:1783441478.509624:0:6585:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073693265664 00000100:00100000:2.0:1783441478.509701:0:6585:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 51 00000100:00100000:2.0:1783441478.509711:0:6585:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a87d804700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3304:x1870073693265664:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1783441478.509769:0:6585:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000004:00080000:3.0:1783441478.509876:0:6611:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 316384133943ns, next at 317384131668ns, rc = 0 00000100:00080000:1.0:1783441478.513520:0:5781:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1783441478.514026:0:6585:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a87d804700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3304:x1870073693265664:12345-0@lo:13:osp-pre-0-0.0 Request processed in 4311us (4542us total) trans 0 rc 0/0 00000100:00100000:2.0:1783441478.514040:0:6585:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 51 00010000:00080000:0.0:1783441478.514179:0:3304:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff91a877fafb80 x1870073693265664/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1783441494 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1783441478.514326:0:3304:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff91a877fafb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3304:1870073693265664:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1783441478.520849:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.13@tcp (source: 12345-192.168.201.13@tcp) 00000100:00100000:0.0:1783441478.520892:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.13@tcp (source: 12345-192.168.201.13@tcp) 00000100:00100000:0.0:1783441478.520921:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.13@tcp (source: 12345-192.168.201.13@tcp) 00000100:00100000:0.0:1783441478.520955:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.13@tcp (source: 12345-192.168.201.13@tcp) 00000100:00100000:0.0:1783441478.520985:0:5787:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073673307648 00000100:00100000:0.0:1783441478.520993:0:5787:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073673307648 00000100:00100000:0.0:1783441478.521036:0:5787:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073673307904 00000100:00100000:0.0:1783441478.521039:0:5787:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073673307904 00000100:00100000:0.0:1783441478.521063:0:5787:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.13@tcp, seq: 113 00000100:00100000:0.0:1783441478.521070:0:5787:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a87d807100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:65454767-383a-4679-a788-eba05c6e0989+14:2355:x1870073673307648:12345-192.168.201.13@tcp:400:kworker.0 00000100:00100000:0.0:1783441478.521150:0:5787:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a87d807100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:65454767-383a-4679-a788-eba05c6e0989+14:2355:x1870073673307648:12345-192.168.201.13@tcp:400:kworker.0 Request processed in 80us (231us total) trans 0 rc 0/0 00000100:00100000:0.0:1783441478.521158:0:5787:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.13@tcp, seq: 113 00000100:00100000:0.0:1783441478.521173:0:5787:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.13@tcp, seq: 114 00000100:00100000:0.0:1783441478.521179:0:5787:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a87d804e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d5aa2a25-c618-49e9-a833-85b3b4747e53+5:2355:x1870073673307904:12345-192.168.201.13@tcp:400:kworker.0 00000100:00100000:0.0:1783441478.521196:0:5787:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a87d804e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d5aa2a25-c618-49e9-a833-85b3b4747e53+5:2355:x1870073673307904:12345-192.168.201.13@tcp:400:kworker.0 Request processed in 18us (240us total) trans 0 rc 0/0 00000100:00100000:0.0:1783441478.521201:0:5787:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.13@tcp, seq: 114 00000100:00100000:2.0:1783441478.521470:0:5778:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073673307520 00000100:00100000:2.0:1783441478.521480:0:5778:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073673307520 00000100:00100000:2.0:1783441478.521516:0:5778:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.13@tcp, seq: 251 00000100:00100000:2.0:1783441478.521521:0:5778:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a8655e5050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:51c2a82e-e792-4f56-84e8-12cc033e9e70+13:2355:x1870073673307520:12345-192.168.201.13@tcp:400:kworker.0 00000100:00100000:2.0:1783441478.521542:0:5778:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a8655e5050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:51c2a82e-e792-4f56-84e8-12cc033e9e70+13:2355:x1870073673307520:12345-192.168.201.13@tcp:400:kworker.0 Request processed in 21us (706us total) trans 0 rc 0/0 00000100:00100000:2.0:1783441478.521546:0:5778:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.13@tcp, seq: 251 00000100:00080000:1.0:1783441478.521777:0:5781:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1783441478.521900:0:8557:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073673307776 00000100:00100000:3.0:1783441478.521912:0:8557:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073673307776 00000100:00080000:1.0:1783441478.522074:0:5781:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1783441478.526184:0:8557:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.13@tcp, seq: 63 00000100:00100000:3.0:1783441478.526206:0:8557:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a87d805c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:65454767-383a-4679-a788-eba05c6e0989+5:2355:x1870073673307776:12345-192.168.201.13@tcp:400:kworker.0 00000100:00100000:3.0:1783441478.526311:0:8557:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a87d805c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:65454767-383a-4679-a788-eba05c6e0989+5:2355:x1870073673307776:12345-192.168.201.13@tcp:400:kworker.0 Request processed in 116us (5418us total) trans 0 rc 0/0 00000100:00100000:3.0:1783441478.526318:0:8557:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.13@tcp, seq: 63 00010000:00010000:2.0:1783441478.764902:0:5772:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:0.0:1783441479.628895:0:5807:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967308 is committed 00000004:00080000:0.0:1783441479.628971:0:5807:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2 committed 00000004:00080000:0.0:1783441479.629012:0:5807:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 3 committed 00000100:00100000:2.0:1783441479.630973:0:3305:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff91a87d7c5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3305:1870073693265792:0@lo:6:osp-syn-0-0.0 00000100:00100000:2.0:1783441479.631071:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783441479.631170:0:6583:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073693265792 00000100:00100000:2.0:1783441479.631180:0:6583:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073693265792 00000100:00100000:2.0:1783441479.631236:0:6583:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:2.0:1783441479.631247:0:6583:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a844b7d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3305:x1870073693265792:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:2.0:1783441479.631286:0:6583:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x240000400:2 count 1 00002000:00010000:2.0:1783441479.631351:0:6583:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x2:0x0] initial LVB size: 0, mtime: 0x6a4d2843, atime: 0x6a4d2843, ctime: 0x6a4d2843, blocks: 0x1 00010000:00010000:2.0:1783441479.631361:0:6583:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000006656bc4f/0xa2426164df2c7996 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6583 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783441479.631381:0:6583:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x2:0x0].0x0 since=317s v=(0 0) 00010000:00010000:2.0:1783441479.631387:0:6583:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1783441479.631395:0:6583:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000006656bc4f/0xa2426164df2c7996 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6583 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783441479.631418:0:6583:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000006656bc4f/0xa2426164df2c7996 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6583 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783441479.631430:0:6583:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000006656bc4f/0xa2426164df2c7996 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6583 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783441479.631458:0:6583:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000006656bc4f/0xa2426164df2c7996 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 6583 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783441479.631491:0:6583:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:2.0:1783441479.632902:0:6583:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a844b7d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:3305:x1870073693265792:12345-0@lo:6:osp-syn-0-0.0 Request processed in 1647us (1822us total) trans 4294967300 rc 0/0 00000100:00100000:2.0:1783441479.632915:0:6583:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00010000:00010000:2.0:1783441479.632963:0:5773:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1783441479.632972:0:5773:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000006656bc4f/0xa2426164df2c7996 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6583 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783441479.632984:0:5773:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91a85f83da00 already unused, calling callback (ffffffffc155ff90) 00010000:00010000:2.0:1783441479.632989:0:5773:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000006656bc4f/0xa2426164df2c7996 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6583 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783441479.633001:0:5773:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000006656bc4f/0xa2426164df2c7996 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 6583 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783441479.633025:0:5773:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000006656bc4f/0xa2426164df2c7996 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6583 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783441479.633031:0:5773:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000006656bc4f/0xa2426164df2c7996 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6583 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783441479.633059:0:5773:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783441479.633073:0:5773:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783441479.633075:0:5773:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00080000:2.0:1783441479.633125:0:3305:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff91a87d7c5880/2, rc 0, transno 4294967300 00000100:00100000:2.0:1783441479.633133:0:3305:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff91a87d7c5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3305:1870073693265792:0@lo:6:osp-syn-0-0.0 00010000:00010000:2.0:1783441479.789948:0:5772:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:3.0:1783441480.119447:0:6613:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967300 is committed 00000001:02000400:2.0:1783441480.228040:0:11464:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: excepting tests: 6 7a 7b 23 35 33 00010000:00010000:2.0:1783441480.813045:0:5773:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:0.0:1783441481.304251:0:11512:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007ffeba129310 20000000:00000080:0.0:1783441481.304269:0:11512:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff91a87da31800 uarg=0000000000000000 20000000:01000000:0.0:1783441481.304310:0:11512:0:(mgs_llog.c:6188:mgs_set_param2()) set_param2 fs='' device='lustre' param='mdt.lustre-MDT0000.hsm_control=enabled' 20000000:01000000:0.0:1783441481.304316:0:11512:0:(mgs_llog.c:4643:mgs_write_log_param2()) next param 'mdt.lustre-MDT0000.hsm_control=enabled' 20000000:01000000:0.0:1783441481.304320:0:11512:0:(mgs_llog.c:1379:mgs_modify_param()) modify params/lustre/mdt.lustre-MDT0000.hsm_control=enabled del=0 00000040:00080000:0.0:1783441481.314816:0:11513:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 7 count 7 20000000:02000000:2.0:1783441481.315186:0:11512:0:(mgs_llog.c:4116:mgs_wlp_lcfg()) Setting parameter lustre.mdt.lustre-MDT0000.hsm_control=enabled in log params 00000040:00080000:2.0:1783441481.325200:0:11512:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].7, 224 off9536 00000040:00080000:2.0:1783441481.325261:0:11512:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].8, 128 off9664 00000040:00080000:2.0:1783441481.325321:0:11512:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].9, 224 off9888 10000000:01000000:2.0:1783441481.325340:0:11512:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 00010000:00010000:2.0:1783441481.325362:0:11512:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff91a85f83d400/0xa2426164df2c799d lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 11512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783441481.325381:0:11512:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff91a85fe58c00/0xa2426164df2c783f lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xa2426164df2c7838 expref: 18 pid: 5778 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783441481.325390:0:11512:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff91a85fe59600/0xa2426164df2c784d lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xa2426164df2c7846 expref: 18 pid: 5778 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783441481.325400:0:11512:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff91a85eb3da00/0xa2426164df2c7854 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 192.168.201.13@tcp remote: 0x633a354aa4df4d0b expref: 12 pid: 5778 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783441481.325407:0:11512:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff91a87da46400/0xa2426164df2c7862 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xa2426164df2c785b expref: 18 pid: 5779 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783441481.325416:0:11512:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff91a85eb3c200/0xa2426164df2c7869 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 192.168.201.13@tcp remote: 0x633a354aa4df4d12 expref: 12 pid: 5780 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783441481.325424:0:11512:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff91a85f83d400/0xa2426164df2c799d lrc: 8/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 11512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783441481.325486:0:11512:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff91a85eb3c200/0xa2426164df2c7869 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 192.168.201.13@tcp remote: 0x633a354aa4df4d12 expref: 12 pid: 5780 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783441481.325501:0:11512:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff91a85eb3c200/0xa2426164df2c7869 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 192.168.201.13@tcp remote: 0x633a354aa4df4d12 expref: 12 pid: 5780 timeout: 419 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783441481.325515:0:11512:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff91a844b7f480 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11512:1870073693265920:192.168.201.13@tcp:104: 00010000:00010000:2.0:1783441481.325643:0:11512:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff91a87da46400/0xa2426164df2c7862 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xa2426164df2c785b expref: 18 pid: 5779 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783441481.325651:0:11512:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff91a87da46400/0xa2426164df2c7862 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xa2426164df2c785b expref: 18 pid: 5779 timeout: 469 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783441481.325661:0:11512:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff91a844b7c000 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11512:1870073693266048:0@lo:104: 00000100:00100000:2.0:1783441481.325706:0:11512:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1783441481.325761:0:11512:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff91a85eb3da00/0xa2426164df2c7854 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 192.168.201.13@tcp remote: 0x633a354aa4df4d0b expref: 12 pid: 5778 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783441481.325770:0:11512:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff91a85eb3da00/0xa2426164df2c7854 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 192.168.201.13@tcp remote: 0x633a354aa4df4d0b expref: 12 pid: 5778 timeout: 419 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783441481.325779:0:11512:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff91a875693b80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11512:1870073693266176:192.168.201.13@tcp:104: 00010000:00010000:2.0:1783441481.325807:0:11512:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff91a85fe59600/0xa2426164df2c784d lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xa2426164df2c7846 expref: 18 pid: 5778 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783441481.325814:0:11512:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff91a85fe59600/0xa2426164df2c784d lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xa2426164df2c7846 expref: 18 pid: 5778 timeout: 469 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783441481.325832:0:11512:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff91a87d4ddc00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11512:1870073693266304:0@lo:104: 00000100:00100000:2.0:1783441481.325853:0:11512:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1783441481.325876:0:11512:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff91a85fe58c00/0xa2426164df2c783f lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xa2426164df2c7838 expref: 18 pid: 5778 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783441481.325883:0:11512:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff91a85fe58c00/0xa2426164df2c783f lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xa2426164df2c7838 expref: 18 pid: 5778 timeout: 469 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783441481.325891:0:11512:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff91a859084e00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11512:1870073693266432:0@lo:104: 00000100:00100000:2.0:1783441481.325914:0:11512:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783441481.325924:0:11512:0:(client.c:2702:ptlrpc_set_wait()) set ffff91a848f23240 going to sleep for 11 seconds 00000100:00100000:3.0:1783441481.331346:0:5767:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/2 left), rc = 0 00000100:00100000:3.0:1783441481.331373:0:5767:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073693266048 00000100:00100000:3.0:1783441481.331381:0:5767:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073693266048 00000100:00100000:3.0:1783441481.331585:0:5767:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073693266304 00000100:00100000:3.0:1783441481.331589:0:5767:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073693266304 00000100:00100000:3.0:1783441481.331601:0:5767:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073693266432 00000100:00100000:3.0:1783441481.331604:0:5767:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073693266432 00000100:00100000:3.0:1783441481.331619:0:5767:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:3.0:1783441481.331629:0:5767:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a844b7f800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:6c1ddb50-5795-40c6-a2b6-8f58add9da62+5:11512:x1870073693266048:12345-0@lo:104: 00010000:00010000:3.0:1783441481.331647:0:5767:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.113@tcp lock: ffff91a85eb3d000/0xa2426164df2c785b lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xa2426164df2c7862 expref: -99 pid: 5783 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783441481.331768:0:5767:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1783441481.331775:0:5767:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a844b7f800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:6c1ddb50-5795-40c6-a2b6-8f58add9da62+5:11512:x1870073693266048:12345-0@lo:104: Request processed in 147us (6069us total) trans 0 rc 0/0 00000100:00100000:3.0:1783441481.331782:0:5767:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:3.0:1783441481.331801:0:5767:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:3.0:1783441481.331807:0:5767:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a87d4ebb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:6c1ddb50-5795-40c6-a2b6-8f58add9da62+4:11512:x1870073693266304:12345-0@lo:104: 00010000:00010000:3.0:1783441481.331815:0:5767:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.113@tcp lock: ffff91a85f83ca00/0xa2426164df2c7846 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xa2426164df2c784d expref: -99 pid: 5783 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783441481.331883:0:5767:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:3.0:1783441481.331888:0:5767:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a87d4ebb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:6c1ddb50-5795-40c6-a2b6-8f58add9da62+4:11512:x1870073693266304:12345-0@lo:104: Request processed in 83us (6035us total) trans 0 rc 0/0 00000100:00100000:3.0:1783441481.331895:0:5767:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:3.0:1783441481.331907:0:5767:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:3.0:1783441481.331913:0:5767:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a7448fec50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:6c1ddb50-5795-40c6-a2b6-8f58add9da62+3:11512:x1870073693266432:12345-0@lo:104: 00010000:00010000:3.0:1783441481.331921:0:5767:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.113@tcp lock: ffff91a85fe58e00/0xa2426164df2c7838 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xa2426164df2c783f expref: -99 pid: 5783 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783441481.331947:0:5767:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to priority blp list, 3 blwis in pool 00000100:00100000:3.0:1783441481.331952:0:5767:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a7448fec50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:6c1ddb50-5795-40c6-a2b6-8f58add9da62+3:11512:x1870073693266432:12345-0@lo:104: Request processed in 40us (6038us total) trans 0 rc 0/0 00000100:00100000:3.0:1783441481.331957:0:5767:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00010000:00010000:3.0:1783441481.332005:0:5772:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:3.0:1783441481.332011:0:5772:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.113@tcp lock: ffff91a85eb3d000/0xa2426164df2c785b lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xa2426164df2c7862 expref: -99 pid: 5783 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783441481.332018:0:5772:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91a85eb3d000 already unused, calling callback (ffffffffc1b78c20) 10000000:00010000:3.0:1783441481.332023:0:5772:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.113@tcp lock: ffff91a85eb3d000/0xa2426164df2c785b lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0xa2426164df2c7862 expref: -99 pid: 5783 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783441481.332033:0:5772:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.113@tcp lock: ffff91a85eb3d000/0xa2426164df2c785b lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0xa2426164df2c7862 expref: -99 pid: 5783 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1783441481.332041:0:5772:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.113@tcp lock: ffff91a85eb3d000/0xa2426164df2c785b lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0xa2426164df2c7862 expref: -99 pid: 5783 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1783441481.332046:0:5772:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:3.0:1783441481.332086:0:5772:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.113@tcp lock: ffff91a85eb3d000/0xa2426164df2c785b lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xa2426164df2c7862 expref: -99 pid: 5783 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783441481.332092:0:5772:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1783441481.332115:0:5772:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.113@tcp lock: ffff91a85eb3d000/0xa2426164df2c785b lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xa2426164df2c7862 expref: -99 pid: 5783 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783441481.332121:0:5772:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.113@tcp lock: ffff91a85eb3d000/0xa2426164df2c785b lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xa2426164df2c7862 expref: -99 pid: 5783 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783441481.332133:0:5772:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1783441481.332136:0:5772:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.113@tcp lock: ffff91a85f83ca00/0xa2426164df2c7846 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xa2426164df2c784d expref: -99 pid: 5783 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783441481.332141:0:5772:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91a85f83ca00 already unused, calling callback (ffffffffc1b78c20) 10000000:00010000:3.0:1783441481.332144:0:5772:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.113@tcp lock: ffff91a85f83ca00/0xa2426164df2c7846 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0xa2426164df2c784d expref: -99 pid: 5783 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783441481.332150:0:5772:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.113@tcp lock: ffff91a85f83ca00/0xa2426164df2c7846 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0xa2426164df2c784d expref: -99 pid: 5783 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1783441481.332157:0:5772:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.113@tcp lock: ffff91a85f83ca00/0xa2426164df2c7846 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0xa2426164df2c784d expref: -99 pid: 5783 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1783441481.332161:0:5772:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:3.0:1783441481.332174:0:5772:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.113@tcp lock: ffff91a85f83ca00/0xa2426164df2c7846 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xa2426164df2c784d expref: -99 pid: 5783 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783441481.332179:0:5772:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1783441481.332192:0:5772:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.113@tcp lock: ffff91a85f83ca00/0xa2426164df2c7846 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xa2426164df2c784d expref: -99 pid: 5783 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783441481.332208:0:5772:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.113@tcp lock: ffff91a85f83ca00/0xa2426164df2c7846 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xa2426164df2c784d expref: -99 pid: 5783 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783441481.332216:0:5772:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1783441481.332219:0:5772:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.113@tcp lock: ffff91a85fe58e00/0xa2426164df2c7838 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xa2426164df2c783f expref: -99 pid: 5783 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783441481.332224:0:5772:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91a85fe58e00 already unused, calling callback (ffffffffc1b78c20) 10000000:00010000:3.0:1783441481.332227:0:5772:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.113@tcp lock: ffff91a85fe58e00/0xa2426164df2c7838 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xa2426164df2c783f expref: -99 pid: 5783 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783441481.332233:0:5772:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.113@tcp lock: ffff91a85fe58e00/0xa2426164df2c7838 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xa2426164df2c783f expref: -99 pid: 5783 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1783441481.332238:0:5772:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.113@tcp lock: ffff91a85fe58e00/0xa2426164df2c7838 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xa2426164df2c783f expref: -99 pid: 5783 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1783441481.332243:0:5772:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:3.0:1783441481.332256:0:5772:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.113@tcp lock: ffff91a85fe58e00/0xa2426164df2c7838 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xa2426164df2c783f expref: -99 pid: 5783 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783441481.332261:0:5772:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1783441481.332266:0:5772:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.113@tcp lock: ffff91a85fe58e00/0xa2426164df2c7838 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xa2426164df2c783f expref: -99 pid: 5783 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783441481.332272:0:5772:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.113@tcp lock: ffff91a85fe58e00/0xa2426164df2c7838 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xa2426164df2c783f expref: -99 pid: 5783 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783441481.332284:0:5772:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783441481.332291:0:5772:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783441481.332293:0:5772:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783441481.332300:0:5773:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1783441481.332308:0:3305:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1783441481.332321:0:3305:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff91a877fad180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:6c1ddb50-5795-40c6-a2b6-8f58add9da62:3305:1870073693266560:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1783441481.332357:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783441481.332634:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.13@tcp (source: 12345-192.168.201.13@tcp) 00000100:00100000:1.0:1783441481.332738:0:3303:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff91a877faed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:6c1ddb50-5795-40c6-a2b6-8f58add9da62:3303:1870073693266688:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1783441481.332993:0:3304:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff91a877faca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:6c1ddb50-5795-40c6-a2b6-8f58add9da62:3304:1870073693266816:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1783441481.333022:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783441481.333064:0:5770:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073693266560 00000100:00100000:1.0:1783441481.333070:0:5770:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073693266560 00010000:00010000:1.0:1783441481.333094:0:5770:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff91a87da46400/0xa2426164df2c7862 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xa2426164df2c785b expref: 19 pid: 5779 timeout: 469 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783441481.333116:0:5770:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073693266816 00000100:00100000:1.0:1783441481.333119:0:5770:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073693266816 00010000:00010000:1.0:1783441481.333130:0:5770:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff91a85fe58c00/0xa2426164df2c783f lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xa2426164df2c7838 expref: 20 pid: 5778 timeout: 469 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783441481.333146:0:5770:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:1.0:1783441481.333162:0:5770:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a877faea00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:6c1ddb50-5795-40c6-a2b6-8f58add9da62+20:3305:x1870073693266560:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1783441481.333173:0:5770:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1783441481.333179:0:5770:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff91a87da46400/0xa2426164df2c7862 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xa2426164df2c785b expref: 20 pid: 5779 timeout: 469 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783441481.333188:0:5770:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff91a87da46400/0xa2426164df2c7862 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xa2426164df2c785b expref: 20 pid: 5779 timeout: 469 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783441481.333205:0:5770:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1783441481.333243:0:5770:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a877faea00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:6c1ddb50-5795-40c6-a2b6-8f58add9da62+20:3305:x1870073693266560:12345-0@lo:103:ldlm_bl.0 Request processed in 82us (885us total) trans 0 rc 0/0 00000100:00100000:1.0:1783441481.333249:0:5770:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00100000:1.0:1783441481.333264:0:5770:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:1.0:1783441481.333270:0:5770:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a8476b3100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:6c1ddb50-5795-40c6-a2b6-8f58add9da62+19:3304:x1870073693266816:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1783441481.333277:0:5770:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1783441481.333281:0:5770:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff91a85fe58c00/0xa2426164df2c783f lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xa2426164df2c7838 expref: 19 pid: 5778 timeout: 469 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783441481.333289:0:5770:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff91a85fe58c00/0xa2426164df2c783f lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xa2426164df2c7838 expref: 19 pid: 5778 timeout: 469 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783441481.333298:0:5770:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1783441481.333322:0:5770:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a8476b3100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:6c1ddb50-5795-40c6-a2b6-8f58add9da62+19:3304:x1870073693266816:12345-0@lo:103:ldlm_bl.0 Request processed in 53us (299us total) trans 0 rc 0/0 00000100:00100000:1.0:1783441481.333329:0:5770:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00100000:1.0:1783441481.333367:0:3304:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff91a877faca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:6c1ddb50-5795-40c6-a2b6-8f58add9da62:3304:1870073693266816:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1783441481.333637:0:11512:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff91a844b7f480 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11512:1870073693265920:192.168.201.13@tcp:104: 00010000:00010000:2.0:1783441481.333650:0:11512:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff91a87da46400/0xa2426164df2c7862 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xa2426164df2c785b expref: 18 pid: 5779 timeout: 469 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783441481.333664:0:11512:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff91a844b7c000 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11512:1870073693266048:0@lo:104: 00000100:00100000:2.0:1783441481.333673:0:11512:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff91a875693b80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11512:1870073693266176:192.168.201.13@tcp:104: 00000100:00100000:2.0:1783441481.333681:0:11512:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff91a87d4ddc00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11512:1870073693266304:0@lo:104: 00010000:00010000:2.0:1783441481.333689:0:11512:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff91a85fe58c00/0xa2426164df2c783f lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xa2426164df2c7838 expref: 17 pid: 5778 timeout: 469 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783441481.333698:0:11512:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff91a859084e00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11512:1870073693266432:0@lo:104: 00010000:00010000:2.0:1783441481.333725:0:11512:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff91a85f83d400/0xa2426164df2c799d lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 11512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783441481.334676:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.13@tcp (source: 12345-192.168.201.13@tcp) 00000100:00100000:2.0:1783441481.334799:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783441481.340757:0:3305:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff91a877fad180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:6c1ddb50-5795-40c6-a2b6-8f58add9da62:3305:1870073693266560:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1783441481.350782:0:5770:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073673308032 00000100:00100000:1.0:1783441481.350798:0:5770:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073673308032 00010000:00010000:1.0:1783441481.350935:0:5770:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff91a85eb3c200/0xa2426164df2c7869 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 192.168.201.13@tcp remote: 0x633a354aa4df4d12 expref: 13 pid: 5780 timeout: 419 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783441481.350970:0:5770:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073673308160 00000100:00100000:1.0:1783441481.350973:0:5770:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073673308160 00010000:00010000:1.0:1783441481.350987:0:5770:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff91a85eb3da00/0xa2426164df2c7854 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 192.168.201.13@tcp remote: 0x633a354aa4df4d0b expref: 14 pid: 5778 timeout: 419 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783441481.351000:0:5770:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073693266688 00000100:00100000:1.0:1783441481.351003:0:5770:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073693266688 00010000:00010000:1.0:1783441481.351014:0:5770:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff91a85fe59600/0xa2426164df2c784d lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xa2426164df2c7846 expref: 17 pid: 5778 timeout: 469 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783441481.351029:0:5770:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.13@tcp, seq: 32 00000100:00100000:1.0:1783441481.351037:0:5770:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a87d806300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:51c2a82e-e792-4f56-84e8-12cc033e9e70+14:2355:x1870073673308032:12345-192.168.201.13@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1783441481.351053:0:5770:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1783441481.351058:0:5770:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff91a85eb3c200/0xa2426164df2c7869 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 192.168.201.13@tcp remote: 0x633a354aa4df4d12 expref: 14 pid: 5780 timeout: 419 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783441481.351070:0:5770:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff91a85eb3c200/0xa2426164df2c7869 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000400000020 nid: 192.168.201.13@tcp remote: 0x633a354aa4df4d12 expref: 14 pid: 5780 timeout: 419 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783441481.351087:0:5770:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff91a85eb3c200/0xa2426164df2c7869 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 192.168.201.13@tcp remote: 0x633a354aa4df4d12 expref: 14 pid: 5780 timeout: 419 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783441481.351093:0:11015:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.13@tcp, seq: 33 00000100:00100000:3.0:1783441481.351101:0:11015:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a87d807800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:51c2a82e-e792-4f56-84e8-12cc033e9e70+13:2354:x1870073673308160:12345-192.168.201.13@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1783441481.351101:0:5770:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1783441481.351108:0:11015:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1783441481.351112:0:11015:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff91a85eb3da00/0xa2426164df2c7854 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 192.168.201.13@tcp remote: 0x633a354aa4df4d0b expref: 13 pid: 5778 timeout: 419 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783441481.351121:0:11015:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff91a85eb3da00/0xa2426164df2c7854 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 192.168.201.13@tcp remote: 0x633a354aa4df4d0b expref: 13 pid: 5778 timeout: 419 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783441481.351129:0:11015:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff91a85eb3da00/0xa2426164df2c7854 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 192.168.201.13@tcp remote: 0x633a354aa4df4d0b expref: 13 pid: 5778 timeout: 419 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783441481.351137:0:11015:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1783441481.351209:0:5771:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 4 min 3 max 56 00000100:00100000:0.0:1783441481.351219:0:5771:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cn00_004' 00000100:00100000:1.0:1783441481.351276:0:5770:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a87d806300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:51c2a82e-e792-4f56-84e8-12cc033e9e70+12:2355:x1870073673308032:12345-192.168.201.13@tcp:103:ldlm_bl.0 Request processed in 238us (18642us total) trans 0 rc 0/0 00000100:00100000:1.0:1783441481.351284:0:5770:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.13@tcp, seq: 32 00000100:00100000:1.0:1783441481.351302:0:5770:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:1.0:1783441481.351314:0:5770:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a845459450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:6c1ddb50-5795-40c6-a2b6-8f58add9da62+17:3303:x1870073693266688:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1783441481.351322:0:5770:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1783441481.351327:0:5770:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff91a85fe59600/0xa2426164df2c784d lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xa2426164df2c7846 expref: 17 pid: 5778 timeout: 469 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783441481.351336:0:5770:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff91a85fe59600/0xa2426164df2c784d lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xa2426164df2c7846 expref: 17 pid: 5778 timeout: 469 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783441481.351345:0:5770:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff91a85fe59600/0xa2426164df2c784d lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xa2426164df2c7846 expref: 17 pid: 5778 timeout: 469 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783441481.351355:0:5770:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff91a85f83d400/0xa2426164df2c799d lrc: 3/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 11512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783441481.351364:0:5770:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff91a85f83d400/0xa2426164df2c799d lrc: 4/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 11512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783441481.351378:0:5770:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff91a85f83d400/0xa2426164df2c799d lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 11512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783441481.351385:0:5770:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff91a85f83d400/0xa2426164df2c799d lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 11512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783441481.351390:0:5770:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff91a85f83d400/0xa2426164df2c799d lrc: 4/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 11512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783441481.351396:0:5770:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff91a85f83d400/0xa2426164df2c799d lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 11512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783441481.351402:0:5770:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91a85f83d400 already unused, calling callback (ffffffffc155ff90) 00010000:00010000:1.0:1783441481.351406:0:5770:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff91a85f83d400/0xa2426164df2c799d lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 11512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783441481.352307:0:5770:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff91a85f83d400/0xa2426164df2c799d lrc: 6/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 11512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783441481.352341:0:5770:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff91a85f83d400/0xa2426164df2c799d lrc: 4/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 11512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783441481.352353:0:5770:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1783441481.352415:0:5770:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a845459450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:6c1ddb50-5795-40c6-a2b6-8f58add9da62+16:3303:x1870073693266688:12345-0@lo:103:ldlm_bl.0 Request processed in 1099us (17614us total) trans 0 rc 0/0 00000100:00100000:1.0:1783441481.352436:0:5770:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00000100:00100000:1.0:1783441481.352713:0:3303:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff91a877faed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:6c1ddb50-5795-40c6-a2b6-8f58add9da62:3303:1870073693266688:0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1783441481.353186:0:11512:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff91a85f83d400/0xa2426164df2c799d lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 11512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783441481.353197:0:11512:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff91a85f83d400/0xa2426164df2c799d lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 11512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783441481.353204:0:11512:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff91a85f83d400/0xa2426164df2c799d lrc: 0/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 11512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783441481.353547:0:11015:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a87d807800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:51c2a82e-e792-4f56-84e8-12cc033e9e70+11:2354:x1870073673308160:12345-192.168.201.13@tcp:103:ldlm_bl.0 Request processed in 2435us (18867us total) trans 0 rc 0/0 00000100:00100000:3.0:1783441481.353559:0:11015:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.13@tcp, seq: 33 00010000:00010000:3.0:1783441481.837328:0:5772:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1783441482.092998:0:3305:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff91a877fad180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3305:1870073693266944:0@lo:400:kworker.0 00000100:00100000:3.0:1783441482.093070:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783441482.093130:0:3305:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff91a877faea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3305:1870073693267456:0@lo:400:kworker.0 00000100:00100000:3.0:1783441482.093168:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783441482.093199:0:3305:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1783441482.093204:0:3305:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff91a877fadf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3305:1870073693267072:0@lo:400:kworker.0 00000100:00100000:3.0:1783441482.093225:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783441482.093255:0:8557:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073693267456 00000100:00100000:3.0:1783441482.093262:0:8557:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073693267456 00000100:00100000:3.0:1783441482.093315:0:8557:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 64 00000100:00100000:3.0:1783441482.093324:0:8557:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a877fafb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3305:x1870073693267456:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1783441482.093377:0:8557:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a877fafb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3305:x1870073693267456:12345-0@lo:400:kworker.0 Request processed in 53us (206us total) trans 0 rc 0/0 00000100:00100000:3.0:1783441482.093384:0:8557:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 64 00010000:00080000:3.0:1783441482.093436:0:3305:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff91a877faea00 x1870073693267456/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1783441498 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1783441482.093551:0:3304:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff91a877faed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3304:1870073693267328:0@lo:400:kworker.0 00000100:00100000:0.0:1783441482.093581:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783441482.093600:0:3304:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1783441482.093606:0:3304:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff91a877fac700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3304:1870073693267200:0@lo:400:kworker.0 00000100:00100000:0.0:1783441482.093627:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783441482.093652:0:5787:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073693266944 00000100:00100000:0.0:1783441482.093656:0:5787:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073693266944 00000100:00100000:0.0:1783441482.093698:0:5787:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073693267072 00000100:00100000:0.0:1783441482.093702:0:5787:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073693267072 00000100:00100000:0.0:1783441482.093716:0:5787:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073693267328 00000100:00100000:0.0:1783441482.093718:0:5787:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073693267328 00000100:00100000:0.0:1783441482.093733:0:5787:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 115 00000100:00100000:0.0:1783441482.093767:0:5787:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a877faca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3305:x1870073693266944:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1783441482.093802:0:5787:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a877faca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3305:x1870073693266944:12345-0@lo:400:kworker.0 Request processed in 62us (732us total) trans 0 rc 0/0 00000100:00100000:0.0:1783441482.093808:0:5787:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 115 00000100:00100000:0.0:1783441482.093822:0:5787:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 116 00000100:00100000:0.0:1783441482.093828:0:5787:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a877fad500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3305:x1870073693267072:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1783441482.093854:0:5787:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a877fad500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3305:x1870073693267072:12345-0@lo:400:kworker.0 Request processed in 26us (628us total) trans 0 rc 0/0 00000100:00100000:0.0:1783441482.093860:0:5787:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 116 00000100:00100000:0.0:1783441482.093871:0:5787:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 117 00000100:00100000:0.0:1783441482.093876:0:5787:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a87d805500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3304:x1870073693267328:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1783441482.093906:0:5787:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a87d805500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3304:x1870073693267328:12345-0@lo:400:kworker.0 Request processed in 30us (325us total) trans 0 rc 0/0 00000100:00100000:0.0:1783441482.093923:0:5787:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 117 00000100:00100000:0.0:1783441482.093981:0:3304:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff91a877faed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3304:1870073693267328:0@lo:400:kworker.0 00000100:00080000:1.0:1783441482.094133:0:5781:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1783441482.094137:0:5781:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1783441482.094146:0:6581:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073693267200 00000100:00100000:1.0:1783441482.094150:0:6581:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073693267200 00000100:00100000:1.0:1783441482.094192:0:6581:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 65 00000100:00100000:1.0:1783441482.094201:0:6581:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a87d806d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3304:x1870073693267200:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1783441482.094236:0:6581:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a87d806d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3304:x1870073693267200:12345-0@lo:400:kworker.0 Request processed in 37us (608us total) trans 0 rc 0/0 00000100:00100000:1.0:1783441482.094243:0:6581:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 65 00000100:00080000:0.0:1783441482.094306:0:5781:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1783441482.094323:0:3304:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967300 gen 2 00000004:00080000:0.0:1783441482.094328:0:3304:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff91a87d7c5880, transno 4294967300 00000100:00100000:0.0:1783441482.094344:0:3304:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff91a877fac700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3304:1870073693267200:0@lo:400:kworker.0 00000100:00100000:3.0:1783441482.095132:0:3305:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff91a877faea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3305:1870073693267456:0@lo:400:kworker.0 00000100:00100000:3.0:1783441482.095160:0:3305:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff91a877fadf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3305:1870073693267072:0@lo:400:kworker.0 00000100:00100000:3.0:1783441482.095171:0:3305:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff91a877fad180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3305:1870073693266944:0@lo:400:kworker.0 10000000:01000000:2.0:1783441482.479918:0:5783:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:2.0:1783441482.479926:0:5783:0:(mgc_request.c:1801:mgc_process_log()) Process log params-ffff91a875566000 from 7 10000000:01000000:2.0:1783441482.479931:0:5783:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:2.0:1783441482.479982:0:5783:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.113@tcp lock: ffff91a85f83d200/0xa2426164df2c79a4 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5783 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783441482.479995:0:5783:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.113@tcp lock: ffff91a85f83d200/0xa2426164df2c79a4 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5783 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783441482.480006:0:5783:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.113@tcp lock: ffff91a85f83d200/0xa2426164df2c79a4 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5783 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783441482.480034:0:5783:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff91a859084e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6c1ddb50-5795-40c6-a2b6-8f58add9da62:5783:1870073693267584:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1783441482.480109:0:5783:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783441482.480219:0:5783:0:(client.c:2702:ptlrpc_set_wait()) set ffff91a848f23240 going to sleep for 11 seconds 00000100:00100000:1.0:1783441482.486889:0:5780:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073693267584 00000100:00100000:1.0:1783441482.486904:0:5780:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073693267584 00000100:00100000:1.0:1783441482.487034:0:5780:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 252 00000100:00100000:1.0:1783441482.487044:0:5780:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a8655e4c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6c1ddb50-5795-40c6-a2b6-8f58add9da62+16:5783:x1870073693267584:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1783441482.487060:0:5780:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1783441482.487078:0:5780:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff91a87da47a00/0xa2426164df2c79ab lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xa2426164df2c79a4 expref: -99 pid: 5780 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783441482.487122:0:5780:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff91a87da47a00/0xa2426164df2c79ab lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xa2426164df2c79a4 expref: 17 pid: 5780 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783441482.487132:0:5780:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff91a87da47a00/0xa2426164df2c79ab lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xa2426164df2c79a4 expref: 17 pid: 5780 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783441482.487142:0:5780:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91a87da47a00, rc 0) 00000100:00100000:1.0:1783441482.487227:0:5780:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a8655e4c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6c1ddb50-5795-40c6-a2b6-8f58add9da62+17:5783:x1870073693267584:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 184us (7117us total) trans 0 rc 0/0 00000100:00100000:1.0:1783441482.487234:0:5780:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 252 00000100:00100000:3.0:1783441482.487338:0:5783:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff91a859084e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6c1ddb50-5795-40c6-a2b6-8f58add9da62:5783:1870073693267584:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1783441482.487354:0:5783:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.113@tcp lock: ffff91a85f83d200/0xa2426164df2c79a4 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xa2426164df2c79ab expref: -99 pid: 5783 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783441482.487364:0:5783:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.113@tcp lock: ffff91a85f83d200/0xa2426164df2c79a4 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xa2426164df2c79ab expref: -99 pid: 5783 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783441482.487453:0:5783:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff91a877fad180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6c1ddb50-5795-40c6-a2b6-8f58add9da62:5783:1870073693267712:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1783441482.487488:0:5783:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783441482.502466:0:5783:0:(client.c:2702:ptlrpc_set_wait()) set ffff91a848632b40 going to sleep for 11 seconds 00000100:00100000:2.0:1783441482.503653:0:5778:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073693267712 00000100:00100000:2.0:1783441482.503673:0:5778:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073693267712 00000100:00100000:2.0:1783441482.503951:0:5778:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 253 00000100:00100000:2.0:1783441482.503961:0:5778:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a8655e4850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6c1ddb50-5795-40c6-a2b6-8f58add9da62+17:5783:x1870073693267712:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1783441482.505233:0:5778:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a8655e4850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6c1ddb50-5795-40c6-a2b6-8f58add9da62+17:5783:x1870073693267712:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 1269us (17739us total) trans 0 rc 0/0 00000100:00100000:2.0:1783441482.505244:0:5778:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 253 00000100:00100000:3.0:1783441482.506034:0:5783:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff91a877fad180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6c1ddb50-5795-40c6-a2b6-8f58add9da62:5783:1870073693267712:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1783441482.506094:0:5783:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff91a877fad180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6c1ddb50-5795-40c6-a2b6-8f58add9da62:5783:1870073693267840:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1783441482.506155:0:5783:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783441482.506198:0:5783:0:(client.c:2702:ptlrpc_set_wait()) set ffff91a848632b40 going to sleep for 11 seconds 00000100:00100000:1.0:1783441482.509720:0:5780:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073693267840 00000100:00100000:1.0:1783441482.509735:0:5780:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073693267840 00000100:00100000:1.0:1783441482.509853:0:5780:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 254 00000100:00100000:1.0:1783441482.509865:0:5780:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a8655e6450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6c1ddb50-5795-40c6-a2b6-8f58add9da62+17:5783:x1870073693267840:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1783441482.510143:0:5780:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a8655e6450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6c1ddb50-5795-40c6-a2b6-8f58add9da62+17:5783:x1870073693267840:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 279us (3986us total) trans 0 rc 0/0 00000100:00100000:1.0:1783441482.510151:0:5780:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 254 00000100:00100000:3.0:1783441482.510628:0:5783:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff91a877fad180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6c1ddb50-5795-40c6-a2b6-8f58add9da62:5783:1870073693267840:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1783441482.511873:0:11526:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff91a8476b3b80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:6c1ddb50-5795-40c6-a2b6-8f58add9da62:11526:1870073693267968:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1783441482.511940:0:11526:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783441482.511981:0:11526:0:(client.c:2702:ptlrpc_set_wait()) set ffff91a862ffa480 going to sleep for 11 seconds 00000100:00100000:0.0:1783441482.512090:0:5779:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073693267968 00000100:00100000:0.0:1783441482.512096:0:5779:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073693267968 00000100:00100000:0.0:1783441482.512138:0:5779:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 255 00000100:00100000:0.0:1783441482.512146:0:5779:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a8655e6c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6c1ddb50-5795-40c6-a2b6-8f58add9da62+17:11526:x1870073693267968:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1783441482.512359:0:5779:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a8655e6c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6c1ddb50-5795-40c6-a2b6-8f58add9da62+17:11526:x1870073693267968:12345-0@lo:502:llog_process_th.0 Request processed in 212us (418us total) trans 0 rc 0/0 00000100:00100000:0.0:1783441482.512367:0:5779:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 255 00000100:00100000:2.0:1783441482.512649:0:11526:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff91a8476b3b80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:6c1ddb50-5795-40c6-a2b6-8f58add9da62:11526:1870073693267968:0@lo:502:llog_process_th.0 00000020:01000000:2.0:1783441482.512701:0:11526:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1783441482.512712:0:11526:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1783441482.512714:0:11526:0:(obd_config.c:1561:class_process_config()) marker 4 (0x1) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:2.0:1783441482.512721:0:11526:0:(obd_config.c:2005:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff91a875566000 00000020:00000080:2.0:1783441482.512723:0:11526:0:(obd_config.c:1470:class_process_config()) processing cmd: ce032 00000100:00100000:2.0:1783441482.512841:0:11526:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff91a859084000 pname:cluuid:pid:xid:nid:opc:job llog_process_th:6c1ddb50-5795-40c6-a2b6-8f58add9da62:11526:1870073693268096:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1783441482.512885:0:11526:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783441482.512921:0:11526:0:(client.c:2702:ptlrpc_set_wait()) set ffff91a844c90480 going to sleep for 11 seconds 00000100:00100000:3.0:1783441482.513101:0:5778:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073693268096 00000100:00100000:3.0:1783441482.513106:0:5778:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073693268096 00000100:00100000:3.0:1783441482.513143:0:5778:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 256 00000100:00100000:3.0:1783441482.513150:0:5778:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a8484bbc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6c1ddb50-5795-40c6-a2b6-8f58add9da62+17:11526:x1870073693268096:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1783441482.513295:0:5778:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a8484bbc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6c1ddb50-5795-40c6-a2b6-8f58add9da62+17:11526:x1870073693268096:12345-0@lo:502:llog_process_th.0 Request processed in 145us (409us total) trans 0 rc 0/0 00000100:00100000:3.0:1783441482.513302:0:5778:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 256 00000100:00100000:2.0:1783441482.516887:0:11526:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff91a859084000 pname:cluuid:pid:xid:nid:opc:job llog_process_th:6c1ddb50-5795-40c6-a2b6-8f58add9da62:11526:1870073693268096:0@lo:502:llog_process_th.0 00000020:01000000:2.0:1783441482.516932:0:11526:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1783441482.516940:0:11526:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1783441482.516942:0:11526:0:(obd_config.c:1561:class_process_config()) marker 4 (0x2) lustre mdt.lustre-MDT0000.hsm_control 00000040:00080000:2.0:1783441482.516945:0:11526:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 10 count 10 00000020:01000000:3.0:1783441482.517201:0:5783:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 7-9 (rc=0) 10000000:01000000:3.0:1783441482.517222:0:5783:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.201.113@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:3.0:1783441482.517232:0:5783:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.113@tcp lock: ffff91a85f83d200/0xa2426164df2c79a4 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xa2426164df2c79ab expref: -99 pid: 5783 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783441482.517244:0:5783:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.113@tcp lock: ffff91a85f83d200/0xa2426164df2c79a4 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xa2426164df2c79ab expref: -99 pid: 5783 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1783441482.517265:0:5783:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:3.0:1783441482.517268:0:5783:0:(mgc_request.c:1801:mgc_process_log()) Process log params-ffff91a867cf2000 from 7 10000000:01000000:3.0:1783441482.517271:0:5783:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:3.0:1783441482.517304:0:5783:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.113@tcp lock: ffff91a841477800/0xa2426164df2c79b2 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5783 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783441482.517313:0:5783:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.113@tcp lock: ffff91a841477800/0xa2426164df2c79b2 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5783 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783441482.517329:0:5783:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.113@tcp lock: ffff91a841477800/0xa2426164df2c79b2 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5783 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783441482.517351:0:5783:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff91a877fad180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6c1ddb50-5795-40c6-a2b6-8f58add9da62:5783:1870073693268224:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1783441482.517422:0:5783:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783441482.517606:0:5783:0:(client.c:2702:ptlrpc_set_wait()) set ffff91a848632a80 going to sleep for 11 seconds 00000100:00100000:2.0:1783441482.517850:0:5778:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073693268224 00000100:00100000:2.0:1783441482.517856:0:5778:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073693268224 00000100:00100000:2.0:1783441482.517892:0:5778:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 257 00000100:00100000:2.0:1783441482.517899:0:5778:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a8484ba050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6c1ddb50-5795-40c6-a2b6-8f58add9da62+17:5783:x1870073693268224:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1783441482.517910:0:5778:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1783441482.517922:0:5778:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff91a85f83d400/0xa2426164df2c79b9 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xa2426164df2c79b2 expref: -99 pid: 5778 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783441482.517944:0:5778:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff91a85f83d400/0xa2426164df2c79b9 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xa2426164df2c79b2 expref: 18 pid: 5778 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783441482.517955:0:5778:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff91a85f83d400/0xa2426164df2c79b9 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xa2426164df2c79b2 expref: 18 pid: 5778 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783441482.517964:0:5778:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91a85f83d400, rc 0) 00000100:00100000:2.0:1783441482.518006:0:5778:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a8484ba050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6c1ddb50-5795-40c6-a2b6-8f58add9da62+18:5783:x1870073693268224:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 107us (584us total) trans 0 rc 0/0 00000100:00100000:2.0:1783441482.518012:0:5778:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 257 00000100:00100000:3.0:1783441482.518903:0:5783:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff91a877fad180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6c1ddb50-5795-40c6-a2b6-8f58add9da62:5783:1870073693268224:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1783441482.518921:0:5783:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.113@tcp lock: ffff91a841477800/0xa2426164df2c79b2 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xa2426164df2c79b9 expref: -99 pid: 5783 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783441482.518930:0:5783:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.113@tcp lock: ffff91a841477800/0xa2426164df2c79b2 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xa2426164df2c79b9 expref: -99 pid: 5783 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783441482.518985:0:5783:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff91a877fad180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6c1ddb50-5795-40c6-a2b6-8f58add9da62:5783:1870073693268352:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1783441482.519013:0:5783:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783441482.519038:0:5783:0:(client.c:2702:ptlrpc_set_wait()) set ffff91a848632a80 going to sleep for 11 seconds 00000100:00100000:2.0:1783441482.519236:0:5779:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073693268352 00000100:00100000:2.0:1783441482.519241:0:5779:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073693268352 00000100:00100000:2.0:1783441482.519285:0:5779:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 258 00000100:00100000:2.0:1783441482.519292:0:5779:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a8484bb850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6c1ddb50-5795-40c6-a2b6-8f58add9da62+18:5783:x1870073693268352:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1783441482.520586:0:5779:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a8484bb850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6c1ddb50-5795-40c6-a2b6-8f58add9da62+18:5783:x1870073693268352:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 1289us (1566us total) trans 0 rc 0/0 00000100:00100000:2.0:1783441482.520595:0:5779:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 258 00000100:00100000:1.0:1783441482.541611:0:5783:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff91a877fad180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6c1ddb50-5795-40c6-a2b6-8f58add9da62:5783:1870073693268352:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1783441482.541811:0:5783:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff91a87d806300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6c1ddb50-5795-40c6-a2b6-8f58add9da62:5783:1870073693268480:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1783441482.541891:0:5783:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783441482.541925:0:5783:0:(client.c:2702:ptlrpc_set_wait()) set ffff91a87d7f9540 going to sleep for 11 seconds 00000100:00100000:1.0:1783441482.542195:0:5780:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073693268480 00000100:00100000:1.0:1783441482.542202:0:5780:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073693268480 00000100:00100000:3.0:1783441482.542322:0:5778:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 259 00000100:00100000:3.0:1783441482.542334:0:5778:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a8484ba850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6c1ddb50-5795-40c6-a2b6-8f58add9da62+18:5783:x1870073693268480:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1783441482.542534:0:5778:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a8484ba850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6c1ddb50-5795-40c6-a2b6-8f58add9da62+18:5783:x1870073693268480:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 202us (642us total) trans 0 rc 0/0 00000100:00100000:3.0:1783441482.542542:0:5778:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 259 00000100:00100000:0.0:1783441482.542712:0:5783:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff91a87d806300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6c1ddb50-5795-40c6-a2b6-8f58add9da62:5783:1870073693268480:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1783441482.545363:0:11528:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff91a87d806300 pname:cluuid:pid:xid:nid:opc:job llog_process_th:6c1ddb50-5795-40c6-a2b6-8f58add9da62:11528:1870073693268608:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1783441482.546420:0:11528:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783441482.546471:0:11528:0:(client.c:2702:ptlrpc_set_wait()) set ffff91a87d7f9900 going to sleep for 11 seconds 00000100:00100000:2.0:1783441482.546666:0:5779:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073693268608 00000100:00100000:2.0:1783441482.546675:0:5779:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073693268608 00000100:00100000:2.0:1783441482.546764:0:5779:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 260 00000100:00100000:2.0:1783441482.546774:0:5779:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a848f75050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6c1ddb50-5795-40c6-a2b6-8f58add9da62+18:11528:x1870073693268608:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1783441482.547006:0:5779:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a848f75050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6c1ddb50-5795-40c6-a2b6-8f58add9da62+18:11528:x1870073693268608:12345-0@lo:502:llog_process_th.0 Request processed in 233us (587us total) trans 0 rc 0/0 00000100:00100000:2.0:1783441482.547013:0:5779:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 260 00000100:00100000:0.0:1783441482.547471:0:11528:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff91a87d806300 pname:cluuid:pid:xid:nid:opc:job llog_process_th:6c1ddb50-5795-40c6-a2b6-8f58add9da62:11528:1870073693268608:0@lo:502:llog_process_th.0 00000020:01000000:0.0:1783441482.547517:0:11528:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1783441482.547527:0:11528:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1783441482.547535:0:11528:0:(obd_config.c:1561:class_process_config()) marker 4 (0x1) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:0.0:1783441482.547546:0:11528:0:(obd_config.c:2005:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff91a867cf2000 00000020:00000080:0.0:1783441482.547548:0:11528:0:(obd_config.c:1470:class_process_config()) processing cmd: ce032 00000100:00100000:0.0:1783441482.547639:0:11528:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff91a87d806300 pname:cluuid:pid:xid:nid:opc:job llog_process_th:6c1ddb50-5795-40c6-a2b6-8f58add9da62:11528:1870073693268736:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1783441482.547704:0:11528:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783441482.547735:0:11528:0:(client.c:2702:ptlrpc_set_wait()) set ffff91a87d7f9900 going to sleep for 11 seconds 00000100:00100000:3.0:1783441482.547959:0:5780:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073693268736 00000100:00100000:3.0:1783441482.547964:0:5780:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073693268736 00000100:00100000:3.0:1783441482.547991:0:5780:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 261 00000100:00100000:3.0:1783441482.547999:0:5780:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a848f74c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6c1ddb50-5795-40c6-a2b6-8f58add9da62+18:11528:x1870073693268736:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1783441482.548156:0:5780:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a848f74c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6c1ddb50-5795-40c6-a2b6-8f58add9da62+18:11528:x1870073693268736:12345-0@lo:502:llog_process_th.0 Request processed in 157us (450us total) trans 0 rc 0/0 00000100:00100000:3.0:1783441482.548162:0:5780:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 261 00000100:00100000:0.0:1783441482.548362:0:11528:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff91a87d806300 pname:cluuid:pid:xid:nid:opc:job llog_process_th:6c1ddb50-5795-40c6-a2b6-8f58add9da62:11528:1870073693268736:0@lo:502:llog_process_th.0 00000020:01000000:0.0:1783441482.548383:0:11528:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1783441482.548388:0:11528:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1783441482.548391:0:11528:0:(obd_config.c:1561:class_process_config()) marker 4 (0x2) lustre mdt.lustre-MDT0000.hsm_control 00000040:00080000:0.0:1783441482.548395:0:11528:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 10 count 10 00000020:01000000:3.0:1783441482.548982:0:5783:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 7-9 (rc=0) 10000000:01000000:3.0:1783441482.549001:0:5783:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.201.113@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:3.0:1783441482.549012:0:5783:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.113@tcp lock: ffff91a841477800/0xa2426164df2c79b2 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xa2426164df2c79b9 expref: -99 pid: 5783 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783441482.549024:0:5783:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.113@tcp lock: ffff91a841477800/0xa2426164df2c79b2 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xa2426164df2c79b9 expref: -99 pid: 5783 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1783441482.549034:0:5783:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:3.0:1783441482.549037:0:5783:0:(mgc_request.c:1801:mgc_process_log()) Process log params-ffff91a84869e800 from 7 10000000:01000000:3.0:1783441482.549040:0:5783:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:3.0:1783441482.549066:0:5783:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.113@tcp lock: ffff91a841477600/0xa2426164df2c79c0 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5783 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783441482.549073:0:5783:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.113@tcp lock: ffff91a841477600/0xa2426164df2c79c0 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5783 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783441482.549081:0:5783:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.113@tcp lock: ffff91a841477600/0xa2426164df2c79c0 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5783 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783441482.549097:0:5783:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff91a877fadf80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6c1ddb50-5795-40c6-a2b6-8f58add9da62:5783:1870073693268864:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1783441482.549128:0:5783:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783441482.549155:0:5783:0:(client.c:2702:ptlrpc_set_wait()) set ffff91a848632840 going to sleep for 11 seconds 00000100:00100000:0.0:1783441482.549224:0:5778:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073693268864 00000100:00100000:0.0:1783441482.549230:0:5778:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073693268864 00000100:00100000:0.0:1783441482.549266:0:5778:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 262 00000100:00100000:0.0:1783441482.549273:0:5778:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a848f74850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6c1ddb50-5795-40c6-a2b6-8f58add9da62+18:5783:x1870073693268864:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1783441482.549282:0:5778:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1783441482.549294:0:5778:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff91a85fe59400/0xa2426164df2c79c7 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0xa2426164df2c79c0 expref: -99 pid: 5778 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783441482.549314:0:5778:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff91a85fe59400/0xa2426164df2c79c7 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xa2426164df2c79c0 expref: 19 pid: 5778 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783441482.549324:0:5778:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff91a85fe59400/0xa2426164df2c79c7 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xa2426164df2c79c0 expref: 19 pid: 5778 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783441482.549332:0:5778:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91a85fe59400, rc 0) 00000100:00100000:0.0:1783441482.549361:0:5778:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a848f74850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6c1ddb50-5795-40c6-a2b6-8f58add9da62+19:5783:x1870073693268864:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 88us (231us total) trans 0 rc 0/0 00000100:00100000:0.0:1783441482.549366:0:5778:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 262 00000100:00100000:3.0:1783441482.550384:0:5783:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff91a877fadf80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6c1ddb50-5795-40c6-a2b6-8f58add9da62:5783:1870073693268864:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1783441482.550406:0:5783:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.113@tcp lock: ffff91a841477600/0xa2426164df2c79c0 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xa2426164df2c79c7 expref: -99 pid: 5783 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783441482.550427:0:5783:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.113@tcp lock: ffff91a841477600/0xa2426164df2c79c0 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0xa2426164df2c79c7 expref: -99 pid: 5783 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783441482.550497:0:5783:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff91a877fadf80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6c1ddb50-5795-40c6-a2b6-8f58add9da62:5783:1870073693268992:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1783441482.550541:0:5783:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783441482.550571:0:5783:0:(client.c:2702:ptlrpc_set_wait()) set ffff91a848632840 going to sleep for 11 seconds 00000100:00100000:2.0:1783441482.551686:0:5779:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073693268992 00000100:00100000:2.0:1783441482.551696:0:5779:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073693268992 00000100:00100000:2.0:1783441482.551738:0:5779:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 263 00000100:00100000:2.0:1783441482.552622:0:5779:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a848f76450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6c1ddb50-5795-40c6-a2b6-8f58add9da62+19:5783:x1870073693268992:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1783441482.554018:0:5779:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a848f76450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6c1ddb50-5795-40c6-a2b6-8f58add9da62+19:5783:x1870073693268992:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 1403us (3472us total) trans 0 rc 0/0 00000100:00100000:2.0:1783441482.554029:0:5779:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 263 00000100:00100000:3.0:1783441482.554159:0:5783:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff91a877fadf80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6c1ddb50-5795-40c6-a2b6-8f58add9da62:5783:1870073693268992:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1783441482.554214:0:5783:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff91a877fadf80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6c1ddb50-5795-40c6-a2b6-8f58add9da62:5783:1870073693269120:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1783441482.554270:0:5783:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783441482.554302:0:5783:0:(client.c:2702:ptlrpc_set_wait()) set ffff91a848632840 going to sleep for 11 seconds 00000100:00100000:0.0:1783441482.554393:0:5778:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073693269120 00000100:00100000:0.0:1783441482.554401:0:5778:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073693269120 00000100:00100000:0.0:1783441482.554454:0:5778:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 264 00000100:00100000:0.0:1783441482.554462:0:5778:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a848f76c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6c1ddb50-5795-40c6-a2b6-8f58add9da62+19:5783:x1870073693269120:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1783441482.554633:0:5778:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a848f76c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6c1ddb50-5795-40c6-a2b6-8f58add9da62+19:5783:x1870073693269120:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 171us (361us total) trans 0 rc 0/0 00000100:00100000:0.0:1783441482.554639:0:5778:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 264 00000100:00100000:2.0:1783441482.554964:0:5783:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff91a877fadf80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6c1ddb50-5795-40c6-a2b6-8f58add9da62:5783:1870073693269120:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1783441482.568652:0:11530:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff91a859084000 pname:cluuid:pid:xid:nid:opc:job llog_process_th:6c1ddb50-5795-40c6-a2b6-8f58add9da62:11530:1870073693269248:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1783441482.568802:0:11530:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783441482.568845:0:11530:0:(client.c:2702:ptlrpc_set_wait()) set ffff91a848552b40 going to sleep for 11 seconds 00000100:00100000:3.0:1783441482.569446:0:5779:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073693269248 00000100:00100000:3.0:1783441482.569455:0:5779:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073693269248 00000100:00100000:3.0:1783441482.569519:0:5779:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 265 00000100:00100000:3.0:1783441482.569529:0:5779:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a848f77c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6c1ddb50-5795-40c6-a2b6-8f58add9da62+19:11530:x1870073693269248:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1783441482.570073:0:5779:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a848f77c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6c1ddb50-5795-40c6-a2b6-8f58add9da62+19:11530:x1870073693269248:12345-0@lo:502:llog_process_th.0 Request processed in 544us (1270us total) trans 0 rc 0/0 00000100:00100000:3.0:1783441482.570081:0:5779:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 265 00000100:00100000:2.0:1783441482.570229:0:11530:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff91a859084000 pname:cluuid:pid:xid:nid:opc:job llog_process_th:6c1ddb50-5795-40c6-a2b6-8f58add9da62:11530:1870073693269248:0@lo:502:llog_process_th.0 00000020:01000000:2.0:1783441482.570277:0:11530:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1783441482.570288:0:11530:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1783441482.570297:0:11530:0:(obd_config.c:1561:class_process_config()) marker 4 (0x1) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:2.0:1783441482.570304:0:11530:0:(obd_config.c:2005:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff91a84869e800 00000020:00000080:2.0:1783441482.570307:0:11530:0:(obd_config.c:1470:class_process_config()) processing cmd: ce032 00000100:00100000:2.0:1783441482.570395:0:11530:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff91a859084000 pname:cluuid:pid:xid:nid:opc:job llog_process_th:6c1ddb50-5795-40c6-a2b6-8f58add9da62:11530:1870073693269376:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1783441482.571182:0:11530:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783441482.571356:0:5780:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073693269376 00000100:00100000:3.0:1783441482.571363:0:5780:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073693269376 00000100:00100000:3.0:1783441482.571410:0:5780:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 266 00000100:00100000:3.0:1783441482.571418:0:5780:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a848f76050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6c1ddb50-5795-40c6-a2b6-8f58add9da62+19:11530:x1870073693269376:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1783441482.571623:0:5780:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a848f76050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6c1ddb50-5795-40c6-a2b6-8f58add9da62+19:11530:x1870073693269376:12345-0@lo:502:llog_process_th.0 Request processed in 203us (441us total) trans 0 rc 0/0 00000100:00100000:3.0:1783441482.571630:0:5780:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 266 00000100:00100000:3.0:1783441482.571704:0:11530:0:(client.c:2702:ptlrpc_set_wait()) set ffff91a844c90480 going to sleep for 11 seconds 00000100:00100000:3.0:1783441482.571721:0:11530:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff91a859084000 pname:cluuid:pid:xid:nid:opc:job llog_process_th:6c1ddb50-5795-40c6-a2b6-8f58add9da62:11530:1870073693269376:0@lo:502:llog_process_th.0 00000020:01000000:3.0:1783441482.571968:0:11530:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1783441482.571975:0:11530:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1783441482.571977:0:11530:0:(obd_config.c:1561:class_process_config()) marker 4 (0x2) lustre mdt.lustre-MDT0000.hsm_control 00000040:00080000:3.0:1783441482.571983:0:11530:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 10 count 10 00000020:01000000:2.0:1783441482.572151:0:5783:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 7-9 (rc=0) 10000000:01000000:2.0:1783441482.572172:0:5783:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.201.113@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:2.0:1783441482.572181:0:5783:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.113@tcp lock: ffff91a841477600/0xa2426164df2c79c0 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xa2426164df2c79c7 expref: -99 pid: 5783 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783441482.572202:0:5783:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.113@tcp lock: ffff91a841477600/0xa2426164df2c79c0 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xa2426164df2c79c7 expref: -99 pid: 5783 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1783441482.583031:0:11531:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:0.0:1783441482.606164:0:3305:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1783441482.606189:0:3305:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff91a859085500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3305:1870073693269504:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1783441482.606268:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783441482.606550:0:6584:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073693269504 00000100:00100000:2.0:1783441482.606559:0:6584:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073693269504 00000100:00100000:2.0:1783441482.606612:0:6584:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 52 00000100:00100000:2.0:1783441482.606621:0:6584:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a87d806300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3305:x1870073693269504:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1783441482.606656:0:6584:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3858759680 avail 3856662528 00000100:00100000:2.0:1783441482.606727:0:6584:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a87d806300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3305:x1870073693269504:12345-0@lo:13:osp-pre-1-0.0 Request processed in 106us (457us total) trans 0 rc 0/0 00000100:00100000:2.0:1783441482.606734:0:6584:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 52 00010000:00080000:1.0:1783441482.606864:0:3305:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff91a859085500 x1870073693269504/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1783441498 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1783441482.606885:0:3305:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff91a859085500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3305:1870073693269504:0@lo:13:osp-pre-1-0.0 00010000:00010000:3.0:1783441482.861177:0:5773:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1783441483.317323:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.13@tcp (source: 12345-192.168.201.13@tcp) 00000100:00100000:3.0:1783441483.317410:0:5779:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073673308288 00000100:00100000:3.0:1783441483.317428:0:5779:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073673308288 00000100:00100000:3.0:1783441483.317488:0:5779:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.13@tcp, seq: 267 00000100:00100000:3.0:1783441483.317507:0:5779:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a848f77850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:51c2a82e-e792-4f56-84e8-12cc033e9e70+11:5571:x1870073673308288:12345-192.168.201.13@tcp:101:ll_cfg_requeue.0 00010000:00010000:3.0:1783441483.317523:0:5779:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1783441483.317542:0:5779:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff91a841477400/0xa2426164df2c79ce lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x633a354aa4df4d5f expref: -99 pid: 5779 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783441483.317573:0:5779:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff91a841477400/0xa2426164df2c79ce lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 192.168.201.13@tcp remote: 0x633a354aa4df4d5f expref: 12 pid: 5779 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783441483.317585:0:5779:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff91a841477400/0xa2426164df2c79ce lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 192.168.201.13@tcp remote: 0x633a354aa4df4d5f expref: 12 pid: 5779 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783441483.317594:0:5779:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91a841477400, rc 0) 00000100:00100000:3.0:1783441483.317655:0:5779:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a848f77850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:51c2a82e-e792-4f56-84e8-12cc033e9e70+12:5571:x1870073673308288:12345-192.168.201.13@tcp:101:ll_cfg_requeue.0 Request processed in 149us (342us total) trans 0 rc 0/0 00000100:00100000:3.0:1783441483.317662:0:5779:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.13@tcp, seq: 267 00000100:00100000:2.0:1783441483.321224:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.13@tcp (source: 12345-192.168.201.13@tcp) 00000100:00100000:0.0:1783441483.321314:0:5778:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073673308416 00000100:00100000:0.0:1783441483.321324:0:5778:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073673308416 00000100:00100000:0.0:1783441483.321377:0:5778:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.13@tcp, seq: 268 00000100:00100000:0.0:1783441483.321387:0:5778:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a848f76850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:51c2a82e-e792-4f56-84e8-12cc033e9e70+12:5571:x1870073673308416:12345-192.168.201.13@tcp:501:ll_cfg_requeue.0 00000100:00100000:0.0:1783441483.321706:0:5778:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a848f76850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:51c2a82e-e792-4f56-84e8-12cc033e9e70+12:5571:x1870073673308416:12345-192.168.201.13@tcp:501:ll_cfg_requeue.0 Request processed in 319us (491us total) trans 0 rc 0/0 00000100:00100000:0.0:1783441483.321714:0:5778:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.13@tcp, seq: 268 00000100:00100000:0.0:1783441483.332091:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.13@tcp (source: 12345-192.168.201.13@tcp) 00000100:00100000:1.0:1783441483.332205:0:5780:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073673308544 00000100:00100000:1.0:1783441483.332214:0:5780:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073673308544 00000100:00100000:1.0:1783441483.332267:0:5780:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.13@tcp, seq: 269 00000100:00100000:1.0:1783441483.332276:0:5780:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a848f75450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:51c2a82e-e792-4f56-84e8-12cc033e9e70+12:5571:x1870073673308544:12345-192.168.201.13@tcp:503:ll_cfg_requeue.0 00000100:00100000:1.0:1783441483.332520:0:5780:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a848f75450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:51c2a82e-e792-4f56-84e8-12cc033e9e70+12:5571:x1870073673308544:12345-192.168.201.13@tcp:503:ll_cfg_requeue.0 Request processed in 244us (439us total) trans 0 rc 0/0 00000100:00100000:1.0:1783441483.332527:0:5780:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.13@tcp, seq: 269 00000100:00100000:2.0:1783441483.349892:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.13@tcp (source: 12345-192.168.201.13@tcp) 00000100:00100000:0.0:1783441483.350132:0:5779:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073673308672 00000100:00100000:0.0:1783441483.350143:0:5779:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073673308672 00000100:00100000:0.0:1783441483.350201:0:5779:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.13@tcp, seq: 270 00000100:00100000:0.0:1783441483.350211:0:5779:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a848f75850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:51c2a82e-e792-4f56-84e8-12cc033e9e70+12:9925:x1870073673308672:12345-192.168.201.13@tcp:502:llog_process_th.0 00000100:00100000:0.0:1783441483.350486:0:5779:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a848f75850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:51c2a82e-e792-4f56-84e8-12cc033e9e70+12:9925:x1870073673308672:12345-192.168.201.13@tcp:502:llog_process_th.0 Request processed in 275us (603us total) trans 0 rc 0/0 00000100:00100000:0.0:1783441483.350502:0:5779:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.13@tcp, seq: 270 00000100:00100000:2.0:1783441483.360221:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.13@tcp (source: 12345-192.168.201.13@tcp) 00000100:00100000:0.0:1783441483.360316:0:5778:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073673308800 00000100:00100000:0.0:1783441483.360325:0:5778:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073673308800 00000100:00100000:0.0:1783441483.360389:0:5778:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.13@tcp, seq: 271 00000100:00100000:0.0:1783441483.360398:0:5778:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a848f77050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:51c2a82e-e792-4f56-84e8-12cc033e9e70+12:9925:x1870073673308800:12345-192.168.201.13@tcp:502:llog_process_th.0 00000100:00100000:0.0:1783441483.360662:0:5778:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a848f77050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:51c2a82e-e792-4f56-84e8-12cc033e9e70+12:9925:x1870073673308800:12345-192.168.201.13@tcp:502:llog_process_th.0 Request processed in 264us (450us total) trans 0 rc 0/0 00000100:00100000:0.0:1783441483.360670:0:5778:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.13@tcp, seq: 271 00000100:00100000:2.0:1783441483.376209:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.13@tcp (source: 12345-192.168.201.13@tcp) 00000100:00100000:1.0:1783441483.376359:0:5780:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073673308928 00000100:00100000:1.0:1783441483.376371:0:5780:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073673308928 00000100:00100000:1.0:1783441483.376437:0:5780:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.13@tcp, seq: 272 00000100:00100000:1.0:1783441483.376447:0:5780:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a848f74050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:51c2a82e-e792-4f56-84e8-12cc033e9e70+12:5571:x1870073673308928:12345-192.168.201.13@tcp:101:ll_cfg_requeue.0 00010000:00010000:1.0:1783441483.376463:0:5780:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1783441483.376481:0:5780:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff91a87da47400/0xa2426164df2c79d5 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0x633a354aa4df4d66 expref: -99 pid: 5780 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783441483.376527:0:5780:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff91a87da47400/0xa2426164df2c79d5 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 192.168.201.13@tcp remote: 0x633a354aa4df4d66 expref: 13 pid: 5780 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783441483.376539:0:5780:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff91a87da47400/0xa2426164df2c79d5 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 192.168.201.13@tcp remote: 0x633a354aa4df4d66 expref: 13 pid: 5780 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783441483.376548:0:5780:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91a87da47400, rc 0) 00000100:00100000:1.0:1783441483.376606:0:5780:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a848f74050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:51c2a82e-e792-4f56-84e8-12cc033e9e70+13:5571:x1870073673308928:12345-192.168.201.13@tcp:101:ll_cfg_requeue.0 Request processed in 160us (405us total) trans 0 rc 0/0 00000100:00100000:1.0:1783441483.376612:0:5780:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.13@tcp, seq: 272 00000100:00100000:2.0:1783441483.385111:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.13@tcp (source: 12345-192.168.201.13@tcp) 00000100:00100000:0.0:1783441483.385277:0:5778:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073673309056 00000100:00100000:0.0:1783441483.385287:0:5778:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073673309056 00000100:00100000:0.0:1783441483.385354:0:5778:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.13@tcp, seq: 273 00000100:00100000:0.0:1783441483.385366:0:5778:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a848f74450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:51c2a82e-e792-4f56-84e8-12cc033e9e70+13:5571:x1870073673309056:12345-192.168.201.13@tcp:501:ll_cfg_requeue.0 00000100:00100000:0.0:1783441483.386004:0:5778:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a848f74450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:51c2a82e-e792-4f56-84e8-12cc033e9e70+13:5571:x1870073673309056:12345-192.168.201.13@tcp:501:ll_cfg_requeue.0 Request processed in 639us (900us total) trans 0 rc 0/0 00000100:00100000:0.0:1783441483.386013:0:5778:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.13@tcp, seq: 273 00000100:00100000:2.0:1783441483.404083:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.13@tcp (source: 12345-192.168.201.13@tcp) 00000100:00100000:3.0:1783441483.404180:0:5779:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073673309184 00000100:00100000:3.0:1783441483.404190:0:5779:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073673309184 00000100:00100000:3.0:1783441483.404248:0:5779:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.13@tcp, seq: 274 00000100:00100000:3.0:1783441483.404257:0:5779:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a848f77450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:51c2a82e-e792-4f56-84e8-12cc033e9e70+13:5571:x1870073673309184:12345-192.168.201.13@tcp:503:ll_cfg_requeue.0 00000100:00100000:3.0:1783441483.404483:0:5779:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a848f77450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:51c2a82e-e792-4f56-84e8-12cc033e9e70+13:5571:x1870073673309184:12345-192.168.201.13@tcp:503:ll_cfg_requeue.0 Request processed in 226us (408us total) trans 0 rc 0/0 00000100:00100000:3.0:1783441483.404521:0:5779:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.13@tcp, seq: 274 00000100:00100000:2.0:1783441483.415665:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.13@tcp (source: 12345-192.168.201.13@tcp) 00000100:00100000:0.0:1783441483.417528:0:5778:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073673309312 00000100:00100000:0.0:1783441483.417542:0:5778:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073673309312 00000100:00100000:0.0:1783441483.417605:0:5778:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.13@tcp, seq: 275 00000100:00100000:0.0:1783441483.417615:0:5778:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a848f75c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:51c2a82e-e792-4f56-84e8-12cc033e9e70+13:9928:x1870073673309312:12345-192.168.201.13@tcp:502:llog_process_th.0 00000100:00100000:0.0:1783441483.418198:0:5778:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a848f75c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:51c2a82e-e792-4f56-84e8-12cc033e9e70+13:9928:x1870073673309312:12345-192.168.201.13@tcp:502:llog_process_th.0 Request processed in 583us (2543us total) trans 0 rc 0/0 00000100:00100000:0.0:1783441483.418207:0:5778:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.13@tcp, seq: 275 00000100:00100000:2.0:1783441483.435073:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.13@tcp (source: 12345-192.168.201.13@tcp) 00000100:00100000:1.0:1783441483.435204:0:5780:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073673309440 00000100:00100000:1.0:1783441483.435217:0:5780:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073673309440 00000100:00100000:1.0:1783441483.435287:0:5780:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.13@tcp, seq: 276 00000100:00100000:1.0:1783441483.435296:0:5780:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a848f71850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:51c2a82e-e792-4f56-84e8-12cc033e9e70+13:9928:x1870073673309440:12345-192.168.201.13@tcp:502:llog_process_th.0 00000100:00100000:1.0:1783441483.435904:0:5780:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a848f71850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:51c2a82e-e792-4f56-84e8-12cc033e9e70+13:9928:x1870073673309440:12345-192.168.201.13@tcp:502:llog_process_th.0 Request processed in 446us (678us total) trans 0 rc 0/0 00000100:00100000:1.0:1783441483.435913:0:5780:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.13@tcp, seq: 276 00000040:00080000:2.0:1783441483.629359:0:11531:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:2.0:1783441483.630194:0:3303:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff91a877faea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3303:1870073693269632:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1783441483.630268:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783441483.636328:0:6584:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073693269632 00000100:00100000:3.0:1783441483.636342:0:6584:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073693269632 00000100:00100000:3.0:1783441483.636408:0:6584:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 53 00000100:00100000:3.0:1783441483.636419:0:6584:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a859087480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3303:x1870073693269632:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1783441483.636460:0:6584:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1783441483.636555:0:6584:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a859087480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3303:x1870073693269632:12345-0@lo:13:osp-pre-0-0.0 Request processed in 138us (6286us total) trans 0 rc 0/0 00000100:00100000:3.0:1783441483.636563:0:6584:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 53 00000100:00100000:3.0:1783441483.636623:0:3303:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff91a877faea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3303:1870073693269632:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1783441483.637835:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.13@tcp (source: 12345-192.168.201.13@tcp) 00000100:00100000:0.0:1783441483.637882:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.13@tcp (source: 12345-192.168.201.13@tcp) 00000100:00100000:0.0:1783441483.637914:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.13@tcp (source: 12345-192.168.201.13@tcp) 00000100:00100000:0.0:1783441483.637940:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.13@tcp (source: 12345-192.168.201.13@tcp) 00000100:00100000:0.0:1783441483.637963:0:5787:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073673309696 00000100:00100000:0.0:1783441483.637983:0:5787:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073673309696 00000100:00100000:0.0:1783441483.638022:0:5787:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073673309952 00000100:00100000:0.0:1783441483.638026:0:5787:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073673309952 00000100:00100000:0.0:1783441483.638048:0:5787:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.13@tcp, seq: 118 00000100:00100000:0.0:1783441483.638056:0:5787:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a87d805880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:65454767-383a-4679-a788-eba05c6e0989+5:2355:x1870073673309696:12345-192.168.201.13@tcp:400:kworker.0 00000100:00100000:0.0:1783441483.638111:0:5787:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a87d805880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:65454767-383a-4679-a788-eba05c6e0989+5:2355:x1870073673309696:12345-192.168.201.13@tcp:400:kworker.0 Request processed in 56us (195us total) trans 0 rc 0/0 00000100:00100000:0.0:1783441483.638118:0:5787:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.13@tcp, seq: 118 00000100:00100000:0.0:1783441483.638133:0:5787:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.13@tcp, seq: 119 00000100:00100000:0.0:1783441483.638140:0:5787:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a87d807b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d5aa2a25-c618-49e9-a833-85b3b4747e53+5:2355:x1870073673309952:12345-192.168.201.13@tcp:400:kworker.0 00000100:00100000:0.0:1783441483.638164:0:5787:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a87d807b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d5aa2a25-c618-49e9-a833-85b3b4747e53+5:2355:x1870073673309952:12345-192.168.201.13@tcp:400:kworker.0 Request processed in 25us (224us total) trans 0 rc 0/0 00000100:00100000:0.0:1783441483.638169:0:5787:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.13@tcp, seq: 119 00000100:00080000:0.0:1783441483.638187:0:5781:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1783441483.638388:0:8557:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073673309824 00000100:00100000:1.0:1783441483.638393:0:8557:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073673309824 00000100:00100000:1.0:1783441483.638429:0:8557:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.13@tcp, seq: 66 00000100:00100000:1.0:1783441483.638437:0:8557:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a87d804380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:65454767-383a-4679-a788-eba05c6e0989+5:2355:x1870073673309824:12345-192.168.201.13@tcp:400:kworker.0 00000100:00100000:1.0:1783441483.638471:0:8557:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a87d804380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:65454767-383a-4679-a788-eba05c6e0989+5:2355:x1870073673309824:12345-192.168.201.13@tcp:400:kworker.0 Request processed in 36us (598us total) trans 0 rc 0/0 00000100:00100000:1.0:1783441483.638478:0:8557:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.13@tcp, seq: 66 00000100:00080000:1.0:1783441483.638508:0:5781:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1783441483.639270:0:5778:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073673309568 00000100:00100000:3.0:1783441483.639275:0:5778:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073673309568 00000100:00100000:3.0:1783441483.639313:0:5778:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.13@tcp, seq: 277 00000100:00100000:3.0:1783441483.639321:0:5778:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a848f73050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:51c2a82e-e792-4f56-84e8-12cc033e9e70+13:2355:x1870073673309568:12345-192.168.201.13@tcp:400:kworker.0 00000100:00100000:3.0:1783441483.639367:0:5778:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a848f73050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:51c2a82e-e792-4f56-84e8-12cc033e9e70+13:2355:x1870073673309568:12345-192.168.201.13@tcp:400:kworker.0 Request processed in 47us (1536us total) trans 0 rc 0/0 00000100:00100000:3.0:1783441483.639373:0:5778:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.13@tcp, seq: 277 00010000:00010000:3.0:1783441483.885520:0:5772:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783441484.909101:0:5773:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783441485.933133:0:5772:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783441486.957838:0:5773:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1783441487.213057:0:3303:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff91a877fac380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3303:1870073693270144:0@lo:400:kworker.0 00000100:00100000:3.0:1783441487.213149:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783441487.213399:0:3305:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff91a877fae680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3305:1870073693269888:0@lo:400:kworker.0 00000100:00100000:1.0:1783441487.213443:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783441487.213498:0:3305:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff91a877fac000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3305:1870073693270400:0@lo:400:kworker.0 00000100:00100000:2.0:1783441487.213703:0:3306:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff91a877fad880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3306:1870073693270016:0@lo:400:kworker.0 00000100:00100000:2.0:1783441487.213733:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783441487.213994:0:3303:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:3.0:1783441487.214000:0:3303:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff91a877faea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:6c1ddb50-5795-40c6-a2b6-8f58add9da62:3303:1870073693269760:0@lo:400:kworker.0 00000100:00100000:3.0:1783441487.214028:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783441487.214054:0:3303:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff91a877faf480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3303:1870073693270272:0@lo:400:kworker.0 00000100:00100000:3.0:1783441487.214074:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783441487.214545:0:5787:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073693269888 00000100:00100000:0.0:1783441487.214554:0:5787:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073693269888 00000100:00100000:0.0:1783441487.214611:0:5787:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073693270016 00000100:00100000:0.0:1783441487.214614:0:5787:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073693270016 00000100:00100000:0.0:1783441487.214634:0:5787:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073693270272 00000100:00100000:0.0:1783441487.214636:0:5787:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073693270272 00000100:00100000:0.0:1783441487.214652:0:5787:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 120 00000100:00100000:0.0:1783441487.214660:0:5787:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a8476b2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3305:x1870073693269888:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1783441487.214721:0:5787:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a8476b2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3305:x1870073693269888:12345-0@lo:400:kworker.0 Request processed in 62us (1278us total) trans 0 rc 0/0 00000100:00100000:0.0:1783441487.214729:0:5787:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 120 00000100:00100000:0.0:1783441487.214773:0:5787:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 121 00000100:00100000:0.0:1783441487.214780:0:5787:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a859085f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3306:x1870073693270016:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1783441487.214826:0:5787:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a859085f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3306:x1870073693270016:12345-0@lo:400:kworker.0 Request processed in 46us (1091us total) trans 0 rc 0/0 00000100:00100000:0.0:1783441487.214832:0:5787:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 121 00000100:00100000:0.0:1783441487.214844:0:5787:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 122 00000100:00100000:0.0:1783441487.214850:0:5787:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a877faf100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3303:x1870073693270272:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1783441487.214879:0:5787:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a877faf100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3303:x1870073693270272:12345-0@lo:400:kworker.0 Request processed in 30us (804us total) trans 0 rc 0/0 00000100:00100000:0.0:1783441487.214884:0:5787:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 122 00000100:00100000:0.0:1783441487.214923:0:3303:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff91a877faf480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3303:1870073693270272:0@lo:400:kworker.0 00000100:00100000:1.0:1783441487.215604:0:5780:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073693269760 00000100:00100000:1.0:1783441487.215611:0:5780:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073693269760 00000100:00100000:1.0:1783441487.215660:0:5780:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 278 00000100:00100000:1.0:1783441487.215668:0:5780:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a848f70050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6c1ddb50-5795-40c6-a2b6-8f58add9da62+19:3303:x1870073693269760:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1783441487.215726:0:5780:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a848f70050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6c1ddb50-5795-40c6-a2b6-8f58add9da62+19:3303:x1870073693269760:12345-0@lo:400:kworker.0 Request processed in 59us (1696us total) trans 0 rc 0/0 00000100:00100000:1.0:1783441487.215732:0:5780:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 278 00000100:00080000:1.0:1783441487.215788:0:5781:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1783441487.215802:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783441487.215852:0:3305:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff91a877fae680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3305:1870073693269888:0@lo:400:kworker.0 00000100:00100000:1.0:1783441487.215880:0:3303:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff91a877faea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:6c1ddb50-5795-40c6-a2b6-8f58add9da62:3303:1870073693269760:0@lo:400:kworker.0 00000100:00100000:2.0:1783441487.216024:0:6582:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073693270144 00000100:00100000:2.0:1783441487.216028:0:6582:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073693270144 00000100:00100000:2.0:1783441487.216080:0:6582:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073693270400 00000100:00100000:2.0:1783441487.216084:0:6582:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073693270400 00000100:00100000:2.0:1783441487.216117:0:6582:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 67 00000100:00100000:2.0:1783441487.216125:0:6582:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a877face00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3303:x1870073693270144:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1783441487.216177:0:6582:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a877face00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3303:x1870073693270144:12345-0@lo:400:kworker.0 Request processed in 43us (3018us total) trans 0 rc 0/0 00000100:00100000:2.0:1783441487.216183:0:6582:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 67 00000100:00100000:2.0:1783441487.216196:0:6582:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 68 00000100:00100000:2.0:1783441487.216202:0:6582:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a8476b1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3305:x1870073693270400:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1783441487.216233:0:6582:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a8476b1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3305:x1870073693270400:12345-0@lo:400:kworker.0 Request processed in 32us (430us total) trans 0 rc 0/0 00000100:00100000:2.0:1783441487.216240:0:6582:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 68 00000100:00100000:2.0:1783441487.216275:0:3306:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff91a877fad880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3306:1870073693270016:0@lo:400:kworker.0 00010000:00080000:2.0:1783441487.216298:0:3305:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff91a877fac000 x1870073693270400/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1783441503 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1783441487.216309:0:3305:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff91a877fac000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3305:1870073693270400:0@lo:400:kworker.0 00000100:00100000:2.0:1783441487.216329:0:3303:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff91a877fac380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3303:1870073693270144:0@lo:400:kworker.0 00000100:00080000:1.0:1783441487.219173:0:5781:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1783441487.219184:0:5781:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1783441487.725416:0:3305:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1783441487.730449:0:3305:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff91a859086680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3305:1870073693270528:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1783441487.730530:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783441487.732888:0:6584:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073693270528 00000100:00100000:3.0:1783441487.732979:0:6584:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073693270528 00000100:00100000:3.0:1783441487.733048:0:6584:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 54 00000100:00100000:3.0:1783441487.733057:0:6584:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a8476b3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3305:x1870073693270528:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1783441487.733097:0:6584:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3858759680 avail 3856662528 00000100:00100000:3.0:1783441487.733233:0:6584:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a8476b3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3305:x1870073693270528:12345-0@lo:13:osp-pre-1-0.0 Request processed in 177us (2703us total) trans 0 rc 0/0 00000100:00100000:3.0:1783441487.733242:0:6584:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 54 00010000:00080000:2.0:1783441487.733302:0:3305:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff91a859086680 x1870073693270528/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1783441503 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1783441487.733323:0:3305:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff91a859086680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3305:1870073693270528:0@lo:13:osp-pre-1-0.0 00010000:00010000:3.0:1783441487.982052:0:5772:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1783441488.755778:0:3304:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1783441488.755801:0:3304:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff91a877fadc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3304:1870073693270656:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1783441488.755884:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783441488.756149:0:6585:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073693270656 00000100:00100000:3.0:1783441488.756158:0:6585:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073693270656 00000100:00100000:3.0:1783441488.756214:0:6585:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 55 00000100:00100000:3.0:1783441488.756224:0:6585:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a87d805180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3304:x1870073693270656:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1783441488.756261:0:6585:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1783441488.756308:0:6585:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a87d805180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3304:x1870073693270656:12345-0@lo:13:osp-pre-0-0.0 Request processed in 86us (424us total) trans 0 rc 0/0 00000100:00100000:3.0:1783441488.756315:0:6585:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 55 00000100:00100000:0.0:1783441488.756524:0:3304:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff91a877fadc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3304:1870073693270656:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1783441488.763647:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.13@tcp (source: 12345-192.168.201.13@tcp) 00000100:00100000:1.0:1783441488.763699:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.13@tcp (source: 12345-192.168.201.13@tcp) 00000100:00100000:1.0:1783441488.763807:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.13@tcp (source: 12345-192.168.201.13@tcp) 00000100:00100000:1.0:1783441488.763840:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.13@tcp (source: 12345-192.168.201.13@tcp) 00000100:00100000:3.0:1783441488.763971:0:5787:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073673310208 00000100:00100000:3.0:1783441488.763981:0:5787:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073673310208 00000100:00100000:2.0:1783441488.764035:0:6582:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073673310336 00000100:00100000:2.0:1783441488.764041:0:6582:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073673310336 00000100:00100000:3.0:1783441488.764044:0:5787:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073673310464 00000100:00100000:3.0:1783441488.764049:0:5787:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073673310464 00000100:00100000:3.0:1783441488.764084:0:5787:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.13@tcp, seq: 123 00000100:00100000:2.0:1783441488.764089:0:6582:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.13@tcp, seq: 69 00000100:00100000:3.0:1783441488.764095:0:5787:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a87531f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:65454767-383a-4679-a788-eba05c6e0989+5:2355:x1870073673310208:12345-192.168.201.13@tcp:400:kworker.0 00000100:00100000:2.0:1783441488.764102:0:6582:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a87d7c5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:65454767-383a-4679-a788-eba05c6e0989+5:2355:x1870073673310336:12345-192.168.201.13@tcp:400:kworker.0 00000100:00100000:1.0:1783441488.764187:0:5785:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.13@tcp, seq: 124 00000100:00100000:1.0:1783441488.764198:0:5785:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a87531ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d5aa2a25-c618-49e9-a833-85b3b4747e53+5:2355:x1870073673310464:12345-192.168.201.13@tcp:400:kworker.0 00000100:00100000:0.0:1783441488.764201:0:5779:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073673310080 00000100:00100000:0.0:1783441488.764207:0:5779:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073673310080 00000100:00100000:0.0:1783441488.764242:0:5779:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.13@tcp, seq: 279 00000100:00100000:0.0:1783441488.764251:0:5779:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a848f70450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:51c2a82e-e792-4f56-84e8-12cc033e9e70+13:2355:x1870073673310080:12345-192.168.201.13@tcp:400:kworker.0 00000100:00100000:3.0:1783441488.764261:0:5787:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a87531f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:65454767-383a-4679-a788-eba05c6e0989+5:2355:x1870073673310208:12345-192.168.201.13@tcp:400:kworker.0 Request processed in 167us (452us total) trans 0 rc 0/0 00000100:00100000:3.0:1783441488.764271:0:5787:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.13@tcp, seq: 123 00000100:00080000:3.0:1783441488.764332:0:5781:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1783441488.764336:0:5781:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1783441488.766599:0:6582:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a87d7c5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:65454767-383a-4679-a788-eba05c6e0989+5:2355:x1870073673310336:12345-192.168.201.13@tcp:400:kworker.0 Request processed in 2491us (2889us total) trans 0 rc 0/0 00000100:00100000:2.0:1783441488.766614:0:6582:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.13@tcp, seq: 69 00000100:00100000:1.0:1783441488.771708:0:5785:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a87531ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d5aa2a25-c618-49e9-a833-85b3b4747e53+5:2355:x1870073673310464:12345-192.168.201.13@tcp:400:kworker.0 Request processed in 7500us (7853us total) trans 0 rc 0/0 00000100:00100000:1.0:1783441488.771724:0:5785:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.13@tcp, seq: 124 00000100:00100000:0.0:1783441488.772092:0:5779:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a848f70450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:51c2a82e-e792-4f56-84e8-12cc033e9e70+13:2355:x1870073673310080:12345-192.168.201.13@tcp:400:kworker.0 Request processed in 7839us (8450us total) trans 0 rc 0/0 00000100:00100000:0.0:1783441488.772103:0:5779:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.13@tcp, seq: 279 00010000:00010000:3.0:1783441489.006162:0:5773:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783441490.029083:0:5772:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783441491.052964:0:5773:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783441492.094702:0:5772:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1783441492.334838:0:3306:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff91a877fac000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3306:1870073693271040:0@lo:400:kworker.0 00000100:00100000:3.0:1783441492.334929:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783441492.335016:0:3306:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:3.0:1783441492.335023:0:3306:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff91a877fac380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3306:1870073693270912:0@lo:400:kworker.0 00000100:00100000:3.0:1783441492.335049:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783441492.335067:0:3306:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff91a877fae680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3306:1870073693271424:0@lo:400:kworker.0 00000100:00100000:3.0:1783441492.335090:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783441492.335128:0:5787:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073693271040 00000100:00100000:3.0:1783441492.335136:0:5787:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073693271040 00000100:00100000:3.0:1783441492.335185:0:5787:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073693270912 00000100:00100000:3.0:1783441492.335188:0:5787:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073693270912 00000100:00100000:3.0:1783441492.335208:0:5787:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 125 00000100:00100000:3.0:1783441492.335216:0:5787:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a877faf480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3306:x1870073693271040:12345-0@lo:400:kworker.0 00000100:00080000:1.0:1783441492.335421:0:5781:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1783441492.335438:0:8557:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073693271424 00000100:00100000:1.0:1783441492.335442:0:8557:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073693271424 00000100:00100000:1.0:1783441492.335481:0:8557:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 70 00000100:00100000:1.0:1783441492.335491:0:8557:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a877fad180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3306:x1870073693271424:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1783441492.335557:0:8557:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a877fad180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3306:x1870073693271424:12345-0@lo:400:kworker.0 Request processed in 68us (464us total) trans 0 rc 0/0 00000100:00100000:1.0:1783441492.335564:0:8557:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 70 00000100:00100000:1.0:1783441492.335589:0:6605:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 126 00000100:00100000:1.0:1783441492.335610:0:6605:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a877fadf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3306:x1870073693270912:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1783441492.335642:0:6605:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a877fadf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3306:x1870073693270912:12345-0@lo:400:kworker.0 Request processed in 33us (591us total) trans 0 rc 0/0 00000100:00100000:1.0:1783441492.335648:0:6605:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 126 00000100:00080000:1.0:1783441492.335691:0:5781:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1783441492.335794:0:3306:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff91a877fac380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3306:1870073693270912:0@lo:400:kworker.0 00010000:00080000:1.0:1783441492.335807:0:3306:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff91a877fae680 x1870073693271424/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1783441508 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1783441492.335819:0:3306:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff91a877fae680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3306:1870073693271424:0@lo:400:kworker.0 00000100:00100000:3.0:1783441492.336029:0:5787:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a877faf480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3306:x1870073693271040:12345-0@lo:400:kworker.0 Request processed in 813us (1106us total) trans 0 rc 0/0 00000100:00100000:3.0:1783441492.336034:0:5787:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 125 00000100:00100000:2.0:1783441492.336141:0:3303:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff91a877fad880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3303:1870073693271168:0@lo:400:kworker.0 00000100:00100000:2.0:1783441492.336189:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783441492.336226:0:3303:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:2.0:1783441492.336233:0:3303:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff91a877fadc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:6c1ddb50-5795-40c6-a2b6-8f58add9da62:3303:1870073693270784:0@lo:400:kworker.0 00000100:00100000:2.0:1783441492.336277:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783441492.336318:0:3303:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff91a877faea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3303:1870073693271296:0@lo:400:kworker.0 00000100:00100000:2.0:1783441492.336355:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783441492.336505:0:5778:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073693270784 00000100:00100000:2.0:1783441492.336511:0:5778:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073693270784 00000100:00100000:2.0:1783441492.336541:0:5778:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 280 00000100:00100000:2.0:1783441492.336548:0:5778:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a848f73450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6c1ddb50-5795-40c6-a2b6-8f58add9da62+19:3303:x1870073693270784:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1783441492.336585:0:5778:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a848f73450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6c1ddb50-5795-40c6-a2b6-8f58add9da62+19:3303:x1870073693270784:12345-0@lo:400:kworker.0 Request processed in 38us (308us total) trans 0 rc 0/0 00000100:00100000:2.0:1783441492.336592:0:5778:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 280 00000100:00100000:2.0:1783441492.336631:0:6605:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073693271296 00000100:00100000:2.0:1783441492.336635:0:6605:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073693271296 00000100:00100000:2.0:1783441492.336666:0:6605:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 127 00000100:00100000:2.0:1783441492.336673:0:6605:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a859087100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3303:x1870073693271296:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1783441492.336702:0:6605:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a859087100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3303:x1870073693271296:12345-0@lo:400:kworker.0 Request processed in 30us (361us total) trans 0 rc 0/0 00000100:00100000:2.0:1783441492.336709:0:6605:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 127 00000100:00080000:2.0:1783441492.336726:0:5781:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1783441492.336763:0:3303:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff91a877fadc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:6c1ddb50-5795-40c6-a2b6-8f58add9da62:3303:1870073693270784:0@lo:400:kworker.0 00000100:00100000:2.0:1783441492.336775:0:3303:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff91a877faea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3303:1870073693271296:0@lo:400:kworker.0 00000100:00100000:3.0:1783441492.336854:0:6583:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073693271168 00000100:00100000:3.0:1783441492.336859:0:6583:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073693271168 00000100:00100000:3.0:1783441492.336899:0:6583:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 71 00000100:00100000:3.0:1783441492.336913:0:6583:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a859086680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3303:x1870073693271168:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1783441492.336951:0:6583:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a859086680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3303:x1870073693271168:12345-0@lo:400:kworker.0 Request processed in 39us (768us total) trans 0 rc 0/0 00000100:00100000:3.0:1783441492.336957:0:6583:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 71 00000100:00100000:3.0:1783441492.336987:0:3303:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff91a877fad880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3303:1870073693271168:0@lo:400:kworker.0 00000100:00080000:2.0:1783441492.337533:0:5781:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1783441492.339474:0:3306:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff91a877fac000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3306:1870073693271040:0@lo:400:kworker.0 00000100:00100000:1.0:1783441492.846017:0:3306:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff91a859085500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3306:1870073693271552:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1783441492.846099:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783441492.846190:0:6585:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073693271552 00000100:00100000:2.0:1783441492.846209:0:6585:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073693271552 00000100:00100000:2.0:1783441492.850223:0:6585:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 56 00000100:00100000:2.0:1783441492.850273:0:6585:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a87531e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3306:x1870073693271552:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1783441492.850347:0:6585:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3858759680 avail 3856662528 00000100:00100000:2.0:1783441492.850471:0:6585:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a87531e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3306:x1870073693271552:12345-0@lo:13:osp-pre-1-0.0 Request processed in 231us (4373us total) trans 0 rc 0/0 00000100:00100000:2.0:1783441492.850479:0:6585:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 56 00010000:00080000:1.0:1783441492.851878:0:3306:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff91a859085500 x1870073693271552/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1783441508 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1783441492.851918:0:3306:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff91a859085500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3306:1870073693271552:0@lo:13:osp-pre-1-0.0 00010000:00010000:3.0:1783441493.100969:0:5773:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:0.0:1783441493.869427:0:11531:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:2.0:1783441493.872419:0:3303:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff91a877fad880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3303:1870073693271680:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1783441493.872494:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783441493.872582:0:6585:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073693271680 00000100:00100000:3.0:1783441493.872591:0:6585:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073693271680 00000100:00100000:3.0:1783441493.872647:0:6585:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 57 00000100:00100000:3.0:1783441493.872657:0:6585:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a859084000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3303:x1870073693271680:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1783441493.872693:0:6585:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1783441493.872775:0:6585:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a859084000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3303:x1870073693271680:12345-0@lo:13:osp-pre-0-0.0 Request processed in 119us (281us total) trans 0 rc 0/0 00000100:00100000:3.0:1783441493.872783:0:6585:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 57 00000100:00100000:2.0:1783441493.872821:0:3303:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff91a877fad880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3303:1870073693271680:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1783441493.880124:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.13@tcp (source: 12345-192.168.201.13@tcp) 00000100:00100000:1.0:1783441493.880167:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.13@tcp (source: 12345-192.168.201.13@tcp) 00000100:00100000:1.0:1783441493.880191:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.13@tcp (source: 12345-192.168.201.13@tcp) 00000100:00100000:1.0:1783441493.880223:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.13@tcp (source: 12345-192.168.201.13@tcp) 00000100:00100000:0.0:1783441493.880291:0:5779:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073673310592 00000100:00100000:0.0:1783441493.880302:0:5779:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073673310592 00000100:00100000:0.0:1783441493.880377:0:5779:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.13@tcp, seq: 281 00000100:00100000:0.0:1783441493.880388:0:5779:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a848f71c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:51c2a82e-e792-4f56-84e8-12cc033e9e70+13:2355:x1870073673310592:12345-192.168.201.13@tcp:400:kworker.0 00000100:00100000:0.0:1783441493.880468:0:5779:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a848f71c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:51c2a82e-e792-4f56-84e8-12cc033e9e70+13:2355:x1870073673310592:12345-192.168.201.13@tcp:400:kworker.0 Request processed in 83us (355us total) trans 0 rc 0/0 00000100:00100000:0.0:1783441493.880474:0:5779:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.13@tcp, seq: 281 00000100:00100000:2.0:1783441493.880697:0:8557:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073673310848 00000100:00100000:2.0:1783441493.880701:0:8557:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073673310848 00000100:00100000:2.0:1783441493.880764:0:8557:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.13@tcp, seq: 72 00000100:00100000:2.0:1783441493.880770:0:8557:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a87531f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:65454767-383a-4679-a788-eba05c6e0989+5:2355:x1870073673310848:12345-192.168.201.13@tcp:400:kworker.0 00000100:00100000:2.0:1783441493.880805:0:8557:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a87531f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:65454767-383a-4679-a788-eba05c6e0989+5:2355:x1870073673310848:12345-192.168.201.13@tcp:400:kworker.0 Request processed in 36us (638us total) trans 0 rc 0/0 00000100:00100000:2.0:1783441493.880810:0:8557:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.13@tcp, seq: 72 00000100:00080000:2.0:1783441493.880839:0:5781:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1783441493.881042:0:5786:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073673310720 00000100:00100000:3.0:1783441493.881046:0:5786:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073673310720 00000100:00100000:3.0:1783441493.881136:0:5786:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073673310976 00000100:00100000:3.0:1783441493.881140:0:5786:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073673310976 00000100:00100000:3.0:1783441493.881173:0:5786:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.13@tcp, seq: 128 00000100:00100000:3.0:1783441493.881180:0:5786:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a87531d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:65454767-383a-4679-a788-eba05c6e0989+5:2355:x1870073673310720:12345-192.168.201.13@tcp:400:kworker.0 00000100:00100000:3.0:1783441493.881220:0:5786:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a87531d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:65454767-383a-4679-a788-eba05c6e0989+5:2355:x1870073673310720:12345-192.168.201.13@tcp:400:kworker.0 Request processed in 41us (1028us total) trans 0 rc 0/0 00000100:00100000:3.0:1783441493.881227:0:5786:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.13@tcp, seq: 128 00000100:00100000:3.0:1783441493.881240:0:5786:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.13@tcp, seq: 129 00000100:00100000:3.0:1783441493.881246:0:5786:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a87531c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d5aa2a25-c618-49e9-a833-85b3b4747e53+5:2355:x1870073673310976:12345-192.168.201.13@tcp:400:kworker.0 00000100:00080000:2.0:1783441493.881410:0:5781:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1783441493.881504:0:5786:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a87531c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d5aa2a25-c618-49e9-a833-85b3b4747e53+5:2355:x1870073673310976:12345-192.168.201.13@tcp:400:kworker.0 Request processed in 257us (1279us total) trans 0 rc 0/0 00000100:00100000:3.0:1783441493.881515:0:5786:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.13@tcp, seq: 129 00010000:00010000:1.0:1783441494.124972:0:5772:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783441495.154796:0:5773:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783441496.172999:0:5772:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783441497.198273:0:5773:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1783441497.452979:0:3305:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff91a877faed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3305:1870073693271936:0@lo:400:kworker.0 00000100:00100000:1.0:1783441497.453043:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783441497.453158:0:5785:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073693271936 00000100:00100000:0.0:1783441497.453167:0:5785:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073693271936 00000100:00100000:0.0:1783441497.453236:0:5785:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 130 00000100:00100000:0.0:1783441497.453246:0:5785:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a87531c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3305:x1870073693271936:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1783441497.453349:0:3303:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1783441497.453360:0:3303:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff91a877fac700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:6c1ddb50-5795-40c6-a2b6-8f58add9da62:3303:1870073693271808:0@lo:400:kworker.0 00000100:00100000:2.0:1783441497.453394:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783441497.453454:0:5780:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073693271808 00000100:00100000:2.0:1783441497.453458:0:5780:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073693271808 00000100:00100000:2.0:1783441497.453493:0:5780:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 282 00000100:00100000:2.0:1783441497.453498:0:5780:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a848f71050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6c1ddb50-5795-40c6-a2b6-8f58add9da62+19:3303:x1870073693271808:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1783441497.453544:0:5780:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a848f71050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6c1ddb50-5795-40c6-a2b6-8f58add9da62+19:3303:x1870073693271808:12345-0@lo:400:kworker.0 Request processed in 44us (148us total) trans 0 rc 0/0 00000100:00100000:2.0:1783441497.453551:0:5780:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 282 00000100:00100000:2.0:1783441497.453590:0:3303:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff91a877fac700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:6c1ddb50-5795-40c6-a2b6-8f58add9da62:3303:1870073693271808:0@lo:400:kworker.0 00000100:00100000:2.0:1783441497.453769:0:3306:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff91a877fac700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3306:1870073693272064:0@lo:400:kworker.0 00000100:00100000:2.0:1783441497.453797:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783441497.453831:0:6605:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073693272064 00000100:00100000:2.0:1783441497.453835:0:6605:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073693272064 00000100:00100000:2.0:1783441497.454028:0:6605:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 131 00000100:00100000:2.0:1783441497.454036:0:6605:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a859084e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3306:x1870073693272064:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1783441497.454081:0:6605:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a859084e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3306:x1870073693272064:12345-0@lo:400:kworker.0 Request processed in 46us (283us total) trans 0 rc 0/0 00000100:00100000:2.0:1783441497.454087:0:6605:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 131 00000100:00080000:2.0:1783441497.454116:0:5781:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1783441497.454134:0:3306:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff91a877fac700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3306:1870073693272064:0@lo:400:kworker.0 00000100:00100000:0.0:1783441497.456676:0:5785:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a87531c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3305:x1870073693271936:12345-0@lo:400:kworker.0 Request processed in 3422us (3621us total) trans 0 rc 0/0 00000100:00100000:0.0:1783441497.456687:0:5785:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 130 00000100:00100000:1.0:1783441497.457638:0:3305:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff91a877faed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3305:1870073693271936:0@lo:400:kworker.0 00000100:00100000:0.0:1783441497.457928:0:3304:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff91a877fac000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3304:1870073693272320:0@lo:400:kworker.0 00000100:00100000:2.0:1783441497.457985:0:3303:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff91a877fad880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3303:1870073693272192:0@lo:400:kworker.0 00000100:00100000:0.0:1783441497.457989:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783441497.458017:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783441497.458067:0:3306:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1783441497.458076:0:3306:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff91a877faea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3306:1870073693272448:0@lo:400:kworker.0 00000100:00100000:2.0:1783441497.458083:0:6583:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073693272192 00000100:00100000:2.0:1783441497.458089:0:6583:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073693272192 00000100:00100000:3.0:1783441497.458102:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783441497.458124:0:6582:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073693272448 00000100:00100000:3.0:1783441497.458127:0:6582:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073693272448 00000100:00100000:2.0:1783441497.458139:0:6583:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 73 00000100:00100000:2.0:1783441497.458148:0:6583:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a859085500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3303:x1870073693272192:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1783441497.458153:0:6582:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 74 00000100:00100000:3.0:1783441497.458158:0:6582:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a877fadc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3306:x1870073693272448:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1783441497.458224:0:5787:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073693272320 00000100:00100000:1.0:1783441497.458227:0:5787:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073693272320 00000100:00100000:1.0:1783441497.458272:0:5787:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 132 00000100:00100000:1.0:1783441497.458280:0:5787:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a8756a4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3304:x1870073693272320:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1783441497.458439:0:6583:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a859085500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3303:x1870073693272192:12345-0@lo:400:kworker.0 Request processed in 291us (419us total) trans 0 rc 0/0 00000100:00100000:2.0:1783441497.458446:0:6583:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 73 00000100:00080000:2.0:1783441497.458470:0:5781:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1783441497.458475:0:5781:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1783441497.458477:0:5781:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1783441497.458511:0:3303:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff91a877fad880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3303:1870073693272192:0@lo:400:kworker.0 00000100:00100000:1.0:1783441497.458860:0:5787:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a8756a4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3304:x1870073693272320:12345-0@lo:400:kworker.0 Request processed in 580us (870us total) trans 0 rc 0/0 00000100:00100000:1.0:1783441497.458867:0:5787:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 132 00000100:00100000:0.0:1783441497.458966:0:3304:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff91a877fac000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3304:1870073693272320:0@lo:400:kworker.0 00000100:00100000:3.0:1783441497.459334:0:6582:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a877fadc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3306:x1870073693272448:12345-0@lo:400:kworker.0 Request processed in 1174us (1229us total) trans 0 rc 0/0 00000100:00100000:3.0:1783441497.459341:0:6582:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 74 00010000:00080000:2.0:1783441497.460035:0:3306:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff91a877faea00 x1870073693272448/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1783441513 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1783441497.460045:0:3306:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff91a877faea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3306:1870073693272448:0@lo:400:kworker.0 00000100:00100000:3.0:1783441497.967694:0:3306:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff91a87d4dd180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3306:1870073693272576:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1783441497.967799:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783441497.967927:0:6585:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073693272576 00000100:00100000:2.0:1783441497.967936:0:6585:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073693272576 00000100:00100000:2.0:1783441497.967996:0:6585:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 58 00000100:00100000:2.0:1783441497.968005:0:6585:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a877fae680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3306:x1870073693272576:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1783441497.968039:0:6585:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3858759680 avail 3856662528 00000100:00100000:2.0:1783441497.968091:0:6585:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a877fae680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3306:x1870073693272576:12345-0@lo:13:osp-pre-1-0.0 Request processed in 86us (291us total) trans 0 rc 0/0 00000100:00100000:2.0:1783441497.968098:0:6585:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 58 00010000:00080000:1.0:1783441497.968709:0:3306:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff91a87d4dd180 x1870073693272576/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1783441513 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1783441497.968731:0:3306:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff91a87d4dd180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3306:1870073693272576:0@lo:13:osp-pre-1-0.0 00010000:00010000:1.0:1783441498.221427:0:5772:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1783441498.989348:0:3304:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1783441498.989369:0:3304:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff91a87d647800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3304:1870073693272704:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1783441498.989430:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783441498.989499:0:6585:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073693272704 00000100:00100000:0.0:1783441498.989506:0:6585:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073693272704 00000100:00100000:0.0:1783441498.989549:0:6585:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 59 00000100:00100000:0.0:1783441498.989557:0:6585:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a87d645500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3304:x1870073693272704:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1783441498.989591:0:6585:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1783441498.989629:0:6585:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a87d645500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3304:x1870073693272704:12345-0@lo:13:osp-pre-0-0.0 Request processed in 72us (199us total) trans 0 rc 0/0 00000100:00100000:0.0:1783441498.989636:0:6585:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 59 00000100:00100000:0.0:1783441498.989675:0:3304:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff91a87d647800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3304:1870073693272704:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1783441498.996185:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.13@tcp (source: 12345-192.168.201.13@tcp) 00000100:00100000:2.0:1783441498.996268:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.13@tcp (source: 12345-192.168.201.13@tcp) 00000100:00100000:3.0:1783441498.996490:0:5786:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073673311232 00000100:00100000:3.0:1783441498.996500:0:5786:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073673311232 00000100:00080000:0.0:1783441498.996583:0:5781:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1783441498.996594:0:5786:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.13@tcp, seq: 133 00000100:00100000:3.0:1783441498.996605:0:5786:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a87d4dfb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:65454767-383a-4679-a788-eba05c6e0989+5:2354:x1870073673311232:12345-192.168.201.13@tcp:400:kworker.0 00000100:00100000:3.0:1783441498.996683:0:5786:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a87d4dfb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:65454767-383a-4679-a788-eba05c6e0989+5:2354:x1870073673311232:12345-192.168.201.13@tcp:400:kworker.0 Request processed in 80us (518us total) trans 0 rc 0/0 00000100:00100000:3.0:1783441498.996691:0:5786:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.13@tcp, seq: 133 00000100:00100000:1.0:1783441498.997804:0:5778:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073673311104 00000100:00100000:1.0:1783441498.997813:0:5778:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073673311104 00000100:00100000:1.0:1783441498.997859:0:5778:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.13@tcp, seq: 283 00000100:00100000:1.0:1783441498.997868:0:5778:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a848f70c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:51c2a82e-e792-4f56-84e8-12cc033e9e70+13:2354:x1870073673311104:12345-192.168.201.13@tcp:400:kworker.0 00000100:00100000:1.0:1783441498.997921:0:5778:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a848f70c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:51c2a82e-e792-4f56-84e8-12cc033e9e70+13:2354:x1870073673311104:12345-192.168.201.13@tcp:400:kworker.0 Request processed in 55us (1653us total) trans 0 rc 0/0 00000100:00100000:1.0:1783441498.997929:0:5778:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.13@tcp, seq: 283 00000100:00100000:0.0:1783441499.021283:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.13@tcp (source: 12345-192.168.201.13@tcp) 00000100:00100000:3.0:1783441499.021800:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.13@tcp (source: 12345-192.168.201.13@tcp) 00000100:00100000:2.0:1783441499.022667:0:6583:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073673311360 00000100:00100000:2.0:1783441499.022678:0:6583:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073673311360 00000100:00100000:2.0:1783441499.022796:0:6583:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.13@tcp, seq: 20 00000100:00100000:2.0:1783441499.022808:0:6583:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a87d647800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:65454767-383a-4679-a788-eba05c6e0989+5:2351:x1870073673311360:12345-192.168.201.13@tcp:9:kworker.0 00000020:00000080:2.0:1783441499.022838:0:6583:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xa2426164df2c7911 00000100:00080000:2.0:1783441499.022846:0:6583:0:(import.c:65:import_set_state_nolock()) ffff91a875375000 : changing import state from FULL to CLOSED 00000001:00000004:2.0:1783441499.022897:0:6583:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 4294967300 00000100:00100000:2.0:1783441499.023203:0:6583:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a87d647800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:65454767-383a-4679-a788-eba05c6e0989+2:2351:x1870073673311360:12345-192.168.201.13@tcp:9:kworker.0 Request processed in 396us (1936us total) trans 0 rc 0/0 00000100:00100000:2.0:1783441499.023212:0:6583:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.13@tcp, seq: 20 00010000:00010000:2.0:1783441499.023254:0:5773:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1783441499.023987:0:6605:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073673311488 00000100:00100000:0.0:1783441499.023997:0:6605:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073673311488 00000100:00100000:0.0:1783441499.024046:0:6605:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.13@tcp, seq: 134 00000100:00100000:0.0:1783441499.024056:0:6605:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a877fac380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:d5aa2a25-c618-49e9-a833-85b3b4747e53+5:2355:x1870073673311488:12345-192.168.201.13@tcp:400:kworker.0 00000100:00100000:0.0:1783441499.024115:0:6605:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a877fac380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:d5aa2a25-c618-49e9-a833-85b3b4747e53+5:2355:x1870073673311488:12345-192.168.201.13@tcp:400:kworker.0 Request processed in 62us (2317us total) trans 0 rc 0/0 00000100:00100000:0.0:1783441499.024122:0:6605:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.13@tcp, seq: 134 00000100:00080000:3.0:1783441499.025553:0:5781:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1783441499.025560:0:5781:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:1.0:1783441499.246879:0:5772:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783441500.268979:0:5773:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:3.0:1783441500.571472:0:6613:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of 65454767-383a-4679-a788-eba05c6e0989 00000020:00000080:3.0:1783441500.571493:0:6613:0:(genops.c:906:class_export_put()) final put ffff91a7450e9000/65454767-383a-4679-a788-eba05c6e0989 00000020:00000080:3.0:1783441500.571523:0:33:0:(genops.c:865:class_export_destroy()) destroying export ffff91a7450e9000/65454767-383a-4679-a788-eba05c6e0989 for lustre-OST0000 00000020:00000080:3.0:1783441500.571569:0:33:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff91a875375000 for lustre-OST0000 00010000:00010000:1.0:1783441501.292913:0:5772:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783441502.317640:0:5773:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1783441502.582529:0:3304:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff91a877faea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:6c1ddb50-5795-40c6-a2b6-8f58add9da62:3304:1870073693272832:0@lo:400:kworker.0 00000100:00100000:3.0:1783441502.582611:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783441502.582657:0:3304:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff91a877fac700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3304:1870073693273344:0@lo:400:kworker.0 00000100:00100000:3.0:1783441502.582681:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783441502.582701:0:3304:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1783441502.582705:0:3304:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff91a877faed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3304:1870073693273216:0@lo:400:kworker.0 00000100:00100000:3.0:1783441502.582720:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783441502.582754:0:3305:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff91a877fac000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3305:1870073693272960:0@lo:400:kworker.0 00000100:00100000:3.0:1783441502.582768:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783441502.582779:0:3305:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff91a867cd5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3305:1870073693273472:0@lo:400:kworker.0 00000100:00100000:3.0:1783441502.582790:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783441502.582799:0:3305:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1783441502.582802:0:3305:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff91a877fad880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3305:1870073693273088:0@lo:400:kworker.0 00000100:00100000:3.0:1783441502.582833:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783441502.582859:0:5779:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073693272832 00000100:00100000:3.0:1783441502.582865:0:5779:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073693272832 00000100:00100000:3.0:1783441502.582900:0:5779:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 284 00000100:00100000:3.0:1783441502.582906:0:5779:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a848f70850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6c1ddb50-5795-40c6-a2b6-8f58add9da62+19:3304:x1870073693272832:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1783441502.582950:0:5779:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a848f70850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6c1ddb50-5795-40c6-a2b6-8f58add9da62+19:3304:x1870073693272832:12345-0@lo:400:kworker.0 Request processed in 43us (339us total) trans 0 rc 0/0 00000100:00100000:3.0:1783441502.582957:0:5779:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 284 00000100:00100000:3.0:1783441502.582988:0:5785:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073693273344 00000100:00100000:3.0:1783441502.582991:0:5785:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073693273344 00000100:00100000:3.0:1783441502.583030:0:5785:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073693272960 00000100:00100000:3.0:1783441502.583034:0:5785:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073693272960 00000100:00100000:3.0:1783441502.583044:0:5785:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073693273088 00000100:00100000:3.0:1783441502.583046:0:5785:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073693273088 00000100:00100000:3.0:1783441502.583059:0:5785:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 135 00000100:00100000:3.0:1783441502.583065:0:5785:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a844b7c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3304:x1870073693273344:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1783441502.583180:0:5785:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a844b7c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3304:x1870073693273344:12345-0@lo:400:kworker.0 Request processed in 33us (415us total) trans 0 rc 0/0 00000100:00100000:3.0:1783441502.583188:0:5785:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 135 00000100:00100000:3.0:1783441502.583202:0:5785:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 136 00000100:00100000:3.0:1783441502.583208:0:5785:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a844b7f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3305:x1870073693272960:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1783441502.583242:0:5785:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a844b7f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3305:x1870073693272960:12345-0@lo:400:kworker.0 Request processed in 34us (471us total) trans 0 rc 0/0 00000100:00100000:3.0:1783441502.583247:0:5785:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 136 00000100:00100000:3.0:1783441502.583258:0:5785:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 137 00000100:00100000:3.0:1783441502.583263:0:5785:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a87da68e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3305:x1870073693273088:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1783441502.583289:0:5785:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a87da68e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3305:x1870073693273088:12345-0@lo:400:kworker.0 Request processed in 25us (454us total) trans 0 rc 0/0 00000100:00100000:3.0:1783441502.583294:0:5785:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 137 00000100:00100000:3.0:1783441502.583312:0:6581:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073693273216 00000100:00100000:3.0:1783441502.583316:0:6581:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073693273216 00000100:00100000:3.0:1783441502.583341:0:6581:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073693273472 00000100:00100000:3.0:1783441502.583344:0:6581:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073693273472 00000100:00100000:3.0:1783441502.583363:0:6581:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 75 00000100:00100000:3.0:1783441502.583368:0:6581:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a844b7f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3304:x1870073693273216:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1783441502.583408:0:6581:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a844b7f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3304:x1870073693273216:12345-0@lo:400:kworker.0 Request processed in 40us (686us total) trans 0 rc 0/0 00000100:00100000:3.0:1783441502.583422:0:6581:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 75 00000100:00100000:3.0:1783441502.583434:0:6581:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 76 00000100:00100000:3.0:1783441502.583440:0:6581:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a87d4ebb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3305:x1870073693273472:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1783441502.583468:0:6581:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a87d4ebb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3305:x1870073693273472:12345-0@lo:400:kworker.0 Request processed in 29us (676us total) trans 0 rc 0/0 00000100:00100000:3.0:1783441502.583474:0:6581:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 76 00000100:00100000:3.0:1783441502.583518:0:3304:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff91a877faed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3304:1870073693273216:0@lo:400:kworker.0 00000100:00100000:3.0:1783441502.583525:0:3304:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff91a877faea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:6c1ddb50-5795-40c6-a2b6-8f58add9da62:3304:1870073693272832:0@lo:400:kworker.0 00000100:00100000:3.0:1783441502.583531:0:3304:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff91a877fac700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3304:1870073693273344:0@lo:400:kworker.0 00000100:00080000:3.0:1783441502.583555:0:5781:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1783441502.583560:0:5781:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1783441502.583562:0:5781:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1783441502.583578:0:3305:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff91a877fad880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3305:1870073693273088:0@lo:400:kworker.0 00000100:00100000:3.0:1783441502.583588:0:3305:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff91a877fac000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3305:1870073693272960:0@lo:400:kworker.0 00010000:00080000:3.0:1783441502.583599:0:3305:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff91a867cd5f80 x1870073693273472/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1783441518 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1783441502.583607:0:3305:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff91a867cd5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3305:1870073693273472:0@lo:400:kworker.0 00000100:00100000:2.0:1783441503.085698:0:3305:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1783441503.085722:0:3305:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff91a87d4ddc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3305:1870073693273600:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1783441503.085813:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783441503.085929:0:6585:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073693273600 00000100:00100000:0.0:1783441503.085938:0:6585:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073693273600 00000100:00100000:0.0:1783441503.085991:0:6585:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 60 00000100:00100000:0.0:1783441503.085999:0:6585:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a87d4dd180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3305:x1870073693273600:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1783441503.086033:0:6585:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3858759680 avail 3856662528 00000100:00100000:0.0:1783441503.086079:0:6585:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a87d4dd180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3305:x1870073693273600:12345-0@lo:13:osp-pre-1-0.0 Request processed in 80us (266us total) trans 0 rc 0/0 00000100:00100000:0.0:1783441503.086086:0:6585:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 60 00010000:00080000:0.0:1783441503.086125:0:3305:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff91a87d4ddc00 x1870073693273600/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1783441519 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1783441503.086142:0:3305:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff91a87d4ddc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3305:1870073693273600:0@lo:13:osp-pre-1-0.0 00000040:00080000:3.0:1783441503.090213:0:11531:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:1.0:1783441503.343695:0:5772:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1783441504.108963:0:3304:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1783441504.108988:0:3304:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff91a87d644000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3304:1870073693273728:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1783441504.109058:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783441504.109121:0:6585:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073693273728 00000100:00100000:0.0:1783441504.109129:0:6585:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073693273728 00000100:00100000:0.0:1783441504.109290:0:6585:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 61 00000100:00100000:0.0:1783441504.109311:0:6585:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a87d644380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3304:x1870073693273728:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1783441504.109350:0:6585:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1783441504.109411:0:6585:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a87d644380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3304:x1870073693273728:12345-0@lo:13:osp-pre-0-0.0 Request processed in 103us (352us total) trans 0 rc 0/0 00000100:00100000:0.0:1783441504.109418:0:6585:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 61 00000100:00080000:0.0:1783441504.109441:0:5781:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1783441504.109475:0:3304:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff91a87d644000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3304:1870073693273728:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1783441504.117100:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.13@tcp (source: 12345-192.168.201.13@tcp) 00000100:00100000:3.0:1783441504.117182:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.13@tcp (source: 12345-192.168.201.13@tcp) 00000100:00100000:3.0:1783441504.118371:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.13@tcp (source: 12345-192.168.201.13@tcp) 00000100:00100000:3.0:1783441504.118419:0:5785:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073673311872 00000100:00100000:3.0:1783441504.118429:0:5785:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073673311872 00000100:00100000:3.0:1783441504.118496:0:5785:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073673311744 00000100:00100000:3.0:1783441504.118499:0:5785:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073673311744 00000100:00100000:3.0:1783441504.118523:0:5785:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.13@tcp, seq: 138 00000100:00100000:3.0:1783441504.118532:0:5785:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a87da6a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d5aa2a25-c618-49e9-a833-85b3b4747e53+5:2354:x1870073673311872:12345-192.168.201.13@tcp:400:kworker.0 00000100:00100000:3.0:1783441504.118609:0:5785:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a87da6a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d5aa2a25-c618-49e9-a833-85b3b4747e53+5:2354:x1870073673311872:12345-192.168.201.13@tcp:400:kworker.0 Request processed in 78us (1426us total) trans 0 rc 0/0 00000100:00100000:3.0:1783441504.118616:0:5785:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.13@tcp, seq: 138 00000100:00100000:3.0:1783441504.118633:0:5785:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.13@tcp, seq: 139 00000100:00100000:3.0:1783441504.118640:0:5785:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a87da6b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:65454767-383a-4679-a788-eba05c6e0989+5:2354:x1870073673311744:12345-192.168.201.13@tcp:400:kworker.0 00000100:00100000:3.0:1783441504.118665:0:5785:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a87da6b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:65454767-383a-4679-a788-eba05c6e0989+5:2354:x1870073673311744:12345-192.168.201.13@tcp:400:kworker.0 Request processed in 25us (301us total) trans 0 rc 0/0 00000100:00100000:3.0:1783441504.118671:0:5785:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.13@tcp, seq: 139 00000100:00080000:3.0:1783441504.118691:0:5781:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1783441504.119282:0:5780:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073673311616 00000100:00100000:2.0:1783441504.119288:0:5780:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073673311616 00000100:00100000:2.0:1783441504.119326:0:5780:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.13@tcp, seq: 285 00000100:00100000:2.0:1783441504.119333:0:5780:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a848f72450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:51c2a82e-e792-4f56-84e8-12cc033e9e70+13:2354:x1870073673311616:12345-192.168.201.13@tcp:400:kworker.0 00000100:00100000:2.0:1783441504.119420:0:5780:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a848f72450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:51c2a82e-e792-4f56-84e8-12cc033e9e70+13:2354:x1870073673311616:12345-192.168.201.13@tcp:400:kworker.0 Request processed in 87us (2330us total) trans 0 rc 0/0 00000100:00100000:2.0:1783441504.119428:0:5780:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.13@tcp, seq: 285 00010000:00010000:3.0:1783441504.366600:0:5773:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783441505.389829:0:5772:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783441506.412947:0:5773:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:0.0:1783441506.557981:0:11694:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: == sanity-pcc test 1a: Test manual lfs pcc attach with manual HSM restore ========================================================== 12:25:05 (1783441505) 00010000:00010000:1.0:1783441507.437006:0:5772:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1783441507.694177:0:3303:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff91a87da6b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3303:1870073693274240:0@lo:400:kworker.0 00000100:00100000:2.0:1783441507.694185:0:3305:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff91a87da68000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3305:1870073693273984:0@lo:400:kworker.0 00000100:00100000:1.0:1783441507.696981:0:3306:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff91a87da68380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3306:1870073693274112:0@lo:400:kworker.0 00000100:00100000:0.0:1783441507.697066:0:3304:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff91a87da69500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:6c1ddb50-5795-40c6-a2b6-8f58add9da62:3304:1870073693273856:0@lo:400:kworker.0 00000100:00100000:3.0:1783441507.703556:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783441507.703669:0:6581:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073693274240 00000100:00100000:3.0:1783441507.703678:0:6581:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073693274240 00000100:00100000:3.0:1783441507.703974:0:6581:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 77 00000100:00100000:3.0:1783441507.703987:0:6581:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a87da6bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3303:x1870073693274240:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1783441507.704046:0:6581:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a87da6bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3303:x1870073693274240:12345-0@lo:400:kworker.0 Request processed in 63us (499us total) trans 0 rc 0/0 00000100:00100000:3.0:1783441507.704054:0:6581:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 77 00000100:00080000:3.0:1783441507.704075:0:5781:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1783441507.704119:0:3303:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff91a87da6b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3303:1870073693274240:0@lo:400:kworker.0 00000100:00100000:2.0:1783441507.708164:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783441507.708251:0:3305:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff91a87da6a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3305:1870073693274496:0@lo:400:kworker.0 00000100:00100000:3.0:1783441507.708255:0:5785:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073693273984 00000100:00100000:3.0:1783441507.708271:0:5785:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073693273984 00000100:00100000:3.0:1783441507.708325:0:5785:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 140 00000100:00100000:3.0:1783441507.708334:0:5785:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a87d4ddc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3305:x1870073693273984:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1783441507.708373:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783441507.708403:0:5785:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a87d4ddc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3305:x1870073693273984:12345-0@lo:400:kworker.0 Request processed in 69us (245us total) trans 0 rc 0/0 00000100:00100000:3.0:1783441507.708411:0:5785:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 140 00000100:00100000:3.0:1783441507.708464:0:6583:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073693274496 00000100:00100000:3.0:1783441507.708468:0:6583:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073693274496 00000100:00100000:2.0:1783441507.708498:0:3305:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff91a87da68000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3305:1870073693273984:0@lo:400:kworker.0 00000100:00100000:3.0:1783441507.708505:0:6583:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 78 00000100:00100000:3.0:1783441507.708514:0:6583:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a875693b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3305:x1870073693274496:12345-0@lo:400:kworker.0 00000100:00080000:2.0:1783441507.708539:0:5781:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1783441507.708572:0:6583:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a875693b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3305:x1870073693274496:12345-0@lo:400:kworker.0 Request processed in 59us (198us total) trans 0 rc 0/0 00000100:00100000:3.0:1783441507.708580:0:6583:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 78 00010000:00080000:2.0:1783441507.708585:0:3305:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff91a87da6a680 x1870073693274496/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1783441523 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1783441507.708597:0:3305:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff91a87da6a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3305:1870073693274496:0@lo:400:kworker.0 00000100:00100000:1.0:1783441507.709644:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783441507.709802:0:6605:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073693274112 00000100:00100000:3.0:1783441507.709808:0:6605:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073693274112 00000100:00100000:3.0:1783441507.709849:0:6605:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 141 00000100:00100000:3.0:1783441507.709858:0:6605:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a87531f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3306:x1870073693274112:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1783441507.709906:0:6605:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a87531f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3306:x1870073693274112:12345-0@lo:400:kworker.0 Request processed in 50us (266us total) trans 0 rc 0/0 00000100:00100000:3.0:1783441507.709913:0:6605:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 141 00000100:00100000:1.0:1783441507.710107:0:3306:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff91a87da68380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3306:1870073693274112:0@lo:400:kworker.0 00000100:00080000:2.0:1783441507.710526:0:5781:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1783441507.712234:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783441507.712291:0:3304:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff91a87da69880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3304:1870073693274368:0@lo:400:kworker.0 00000100:00100000:0.0:1783441507.712328:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783441507.712691:0:5778:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073693273856 00000100:00100000:3.0:1783441507.712699:0:5778:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073693273856 00000100:00100000:3.0:1783441507.712785:0:5778:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 286 00000100:00100000:3.0:1783441507.712795:0:5778:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a848f72c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6c1ddb50-5795-40c6-a2b6-8f58add9da62+19:3304:x1870073693273856:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1783441507.712850:0:5778:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a848f72c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6c1ddb50-5795-40c6-a2b6-8f58add9da62+19:3304:x1870073693273856:12345-0@lo:400:kworker.0 Request processed in 55us (623us total) trans 0 rc 0/0 00000100:00100000:3.0:1783441507.712856:0:5778:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 286 00000100:00100000:2.0:1783441507.713008:0:5785:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073693274368 00000100:00100000:2.0:1783441507.713021:0:5785:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073693274368 00000100:00100000:2.0:1783441507.713066:0:5785:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 142 00000100:00100000:2.0:1783441507.713072:0:5785:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a87d644000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3304:x1870073693274368:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1783441507.713117:0:5785:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a87d644000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3304:x1870073693274368:12345-0@lo:400:kworker.0 Request processed in 46us (788us total) trans 0 rc 0/0 00000100:00100000:2.0:1783441507.713123:0:5785:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 142 00000100:00080000:3.0:1783441507.713280:0:5781:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1783441507.713609:0:3304:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff91a87da69500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:6c1ddb50-5795-40c6-a2b6-8f58add9da62:3304:1870073693273856:0@lo:400:kworker.0 00000100:00100000:0.0:1783441507.713625:0:3304:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff91a87da69880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3304:1870073693274368:0@lo:400:kworker.0 00000100:00100000:2.0:1783441508.205696:0:3305:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1783441508.205720:0:3305:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff91a846f26a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3305:1870073693274624:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1783441508.205813:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783441508.205989:0:6585:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073693274624 00000100:00100000:0.0:1783441508.205997:0:6585:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073693274624 00000100:00100000:0.0:1783441508.206058:0:6585:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 62 00000100:00100000:0.0:1783441508.206068:0:6585:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a846f27100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3305:x1870073693274624:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1783441508.206113:0:6585:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3858759680 avail 3856662528 00000100:00100000:0.0:1783441508.206186:0:6585:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a846f27100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3305:x1870073693274624:12345-0@lo:13:osp-pre-1-0.0 Request processed in 118us (371us total) trans 0 rc 0/0 00000100:00100000:0.0:1783441508.206193:0:6585:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 62 00010000:00080000:1.0:1783441508.206214:0:3305:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff91a846f26a00 x1870073693274624/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1783441524 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1783441508.206236:0:3305:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff91a846f26a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3305:1870073693274624:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1783441508.311481:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.13@tcp (source: 12345-192.168.201.13@tcp) 00000100:00100000:0.0:1783441508.311636:0:6605:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073673312000 00000100:00100000:0.0:1783441508.311647:0:6605:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073673312000 00000100:00100000:0.0:1783441508.311738:0:6605:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.13@tcp, seq: 32 00000100:00100000:0.0:1783441508.311774:0:6605:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a87da6b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:65454767-383a-4679-a788-eba05c6e0989+5:10196:x1870073673312000:12345-192.168.201.13@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1783441508.311795:0:6605:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1783441508.311820:0:6605:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91a85fe58c00/0xa2426164df2c79dc lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x633a354aa4df4d6d expref: -99 pid: 6605 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783441508.311896:0:6605:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff91a85fe58e00/0xa2426164df2c79e3 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6605 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783441508.311909:0:6605:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91a85fe58e00/0xa2426164df2c79e3 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6605 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783441508.311922:0:6605:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91a85fe58e00/0xa2426164df2c79e3 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6605 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1783441508.312133:0:6605:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 7680 00000004:00200000:0.0:1783441508.312139:0:6605:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 1 stripe count 1 MDT count 1 00000004:00010000:0.0:1783441508.312248:0:6605:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff91a85fe58e00/0xa2426164df2c79e3 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6605 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783441508.312276:0:6605:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91a85fe58c00/0xa2426164df2c79dc lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.13@tcp remote: 0x633a354aa4df4d6d expref: 7 pid: 6605 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783441508.312293:0:6605:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff91a85fe58e00/0xa2426164df2c79e3 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.13@tcp remote: 0x633a354aa4df4d6d expref: 6 pid: 6605 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783441508.312302:0:6605:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff91a8439b0500) 00010000:00010000:0.0:1783441508.312304:0:6605:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1783441508.312307:0:6605:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91a85fe58e00, rc 0) 00000100:00100000:0.0:1783441508.312375:0:6605:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a87da6b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:65454767-383a-4679-a788-eba05c6e0989+6:10196:x1870073673312000:12345-192.168.201.13@tcp:101:lhsmtool_posix.0 Request processed in 604us (902us total) trans 0 rc 0/0 00000100:00100000:0.0:1783441508.312388:0:6605:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.13@tcp, seq: 32 00000100:00080000:3.0:1783441508.312683:0:5781:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1783441508.320315:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.13@tcp (source: 12345-192.168.201.13@tcp) 00000100:00100000:3.0:1783441508.320459:0:5786:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073673312128 00000100:00100000:3.0:1783441508.320469:0:5786:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073673312128 00000100:00100000:3.0:1783441508.320529:0:5786:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.13@tcp, seq: 33 00000100:00100000:3.0:1783441508.320538:0:5786:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a87d647480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:65454767-383a-4679-a788-eba05c6e0989+6:10197:x1870073673312128:12345-192.168.201.13@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1783441508.320559:0:5786:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1783441508.320581:0:5786:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91a841476000/0xa2426164df2c79ea lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x633a354aa4df4d74 expref: -99 pid: 5786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783441508.320645:0:5786:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff91a841477c00/0xa2426164df2c79f1 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783441508.320659:0:5786:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91a841477c00/0xa2426164df2c79f1 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783441508.320671:0:5786:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91a841477c00/0xa2426164df2c79f1 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783441508.320686:0:5786:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff91a841476e00/0xa2426164df2c79f8 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783441508.320693:0:5786:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91a841476e00/0xa2426164df2c79f8 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783441508.320700:0:5786:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91a841476e00/0xa2426164df2c79f8 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783441508.321148:0:5786:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff91a841476400/0xa2426164df2c79ff lrc: 3/1,0 mode: --/PR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783441508.321167:0:5786:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91a841476400/0xa2426164df2c79ff lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783441508.321174:0:5786:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91a841476400/0xa2426164df2c79ff lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1783441508.321367:0:5786:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000002:0x1:0x0]: returning size 6656 00000004:00200000:3.0:1783441508.321371:0:5786:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 2 stripe count 1 MDT count 1 00000004:00010000:3.0:1783441508.321455:0:5786:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff91a841476400/0xa2426164df2c79ff lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783441508.321468:0:5786:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff91a841477c00/0xa2426164df2c79f1 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783441508.321474:0:5786:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff91a841477c00/0xa2426164df2c79f1 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783441508.321480:0:5786:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff91a841477c00/0xa2426164df2c79f1 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783441508.321486:0:5786:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91a841477c00 already unused, calling callback (ffffffffc1f9b4f0) 00010000:00010000:3.0:1783441508.321490:0:5786:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91a841477c00/0xa2426164df2c79f1 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783441508.321498:0:5786:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91a841477c00/0xa2426164df2c79f1 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783441508.321511:0:5786:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff91a8439b0500) 00010000:00010000:3.0:1783441508.321514:0:5786:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1783441508.321518:0:5786:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff91a841477c00/0xa2426164df2c79f1 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783441508.321535:0:5786:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91a841477c00/0xa2426164df2c79f1 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783441508.321549:0:5786:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff91a841476e00/0xa2426164df2c79f8 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783441508.321554:0:5786:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff91a841476e00/0xa2426164df2c79f8 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783441508.321559:0:5786:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff91a841476e00/0xa2426164df2c79f8 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783441508.321565:0:5786:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91a841476e00 already unused, calling callback (ffffffffc1f9b4f0) 00010000:00010000:3.0:1783441508.321568:0:5786:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91a841476e00/0xa2426164df2c79f8 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783441508.321574:0:5786:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91a841476e00/0xa2426164df2c79f8 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783441508.321582:0:5786:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x3b979c7a (ffff91a85faee700) 00010000:00010000:3.0:1783441508.321585:0:5786:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1783441508.321588:0:5786:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff91a841476e00/0xa2426164df2c79f8 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783441508.321594:0:5786:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91a841476e00/0xa2426164df2c79f8 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783441508.321628:0:5786:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91a841476000/0xa2426164df2c79ea lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.13@tcp remote: 0x633a354aa4df4d74 expref: 8 pid: 5786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783441508.321641:0:5786:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff91a841476400/0xa2426164df2c79ff lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.13@tcp remote: 0x633a354aa4df4d74 expref: 7 pid: 5786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783441508.321656:0:5786:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x0 (ffff91a85faeee00) 00010000:00010000:3.0:1783441508.321658:0:5786:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1783441508.321661:0:5786:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91a841476400, rc 0) 00000100:00100000:3.0:1783441508.321733:0:5786:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a87d647480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:65454767-383a-4679-a788-eba05c6e0989+7:10197:x1870073673312128:12345-192.168.201.13@tcp:101:lhsmtool_posix.0 Request processed in 1194us (1429us total) trans 0 rc 0/0 00000100:00100000:3.0:1783441508.321782:0:5786:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.13@tcp, seq: 33 00000100:00100000:2.0:1783441508.331836:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.13@tcp (source: 12345-192.168.201.13@tcp) 00000100:00100000:1.0:1783441508.334870:0:5787:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073673312384 00000100:00100000:1.0:1783441508.334886:0:5787:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073673312384 00000100:00100000:1.0:1783441508.334964:0:5787:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.13@tcp, seq: 34 00000100:00100000:1.0:1783441508.334975:0:5787:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a846f27b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:65454767-383a-4679-a788-eba05c6e0989+7:10197:x1870073673312384:12345-192.168.201.13@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1783441508.334997:0:5787:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1783441508.335019:0:5787:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91a87da47e00/0xa2426164df2c7a06 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x633a354aa4df4d7b expref: -99 pid: 5787 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783441508.335124:0:5787:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff91a87da47000/0xa2426164df2c7a0d lrc: 3/1,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783441508.335138:0:5787:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91a87da47000/0xa2426164df2c7a0d lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783441508.335150:0:5787:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91a87da47000/0xa2426164df2c7a0d lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783441508.335164:0:5787:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff91a87da46200/0xa2426164df2c7a14 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783441508.335171:0:5787:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91a87da46200/0xa2426164df2c7a14 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783441508.335178:0:5787:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91a87da46200/0xa2426164df2c7a14 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783441508.335719:0:5787:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff91a87da46400/0xa2426164df2c7a1b lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783441508.335729:0:5787:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91a87da46400/0xa2426164df2c7a1b lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783441508.335737:0:5787:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91a87da46400/0xa2426164df2c7a1b lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1783441508.335793:0:5787:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000002:0x2:0x0]: returning size 6656 00010000:00010000:1.0:1783441508.336003:0:5787:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff91a87da47000/0xa2426164df2c7a0d lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783441508.336011:0:5787:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff91a87da47000/0xa2426164df2c7a0d lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783441508.336018:0:5787:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff91a87da47000/0xa2426164df2c7a0d lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783441508.336024:0:5787:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91a87da47000 already unused, calling callback (ffffffffc1f9b4f0) 00010000:00010000:1.0:1783441508.336028:0:5787:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91a87da47000/0xa2426164df2c7a0d lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783441508.336036:0:5787:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91a87da47000/0xa2426164df2c7a0d lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783441508.336050:0:5787:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x0 (ffff91a85faeee00) 00010000:00010000:1.0:1783441508.336052:0:5787:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1783441508.336057:0:5787:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff91a87da47000/0xa2426164df2c7a0d lrc: 2/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783441508.336072:0:5787:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91a87da47000/0xa2426164df2c7a0d lrc: 0/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783441508.336099:0:5787:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff91a87da46200/0xa2426164df2c7a14 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783441508.336105:0:5787:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff91a87da46200/0xa2426164df2c7a14 lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783441508.336111:0:5787:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff91a87da46200/0xa2426164df2c7a14 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783441508.336116:0:5787:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91a87da46200 already unused, calling callback (ffffffffc1f9b4f0) 00010000:00010000:1.0:1783441508.336120:0:5787:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91a87da46200/0xa2426164df2c7a14 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783441508.336125:0:5787:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91a87da46200/0xa2426164df2c7a14 lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783441508.336133:0:5787:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x8d45d6bc (ffff91a858b90f00) 00010000:00010000:1.0:1783441508.336135:0:5787:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1783441508.336138:0:5787:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff91a87da46200/0xa2426164df2c7a14 lrc: 2/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783441508.336143:0:5787:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91a87da46200/0xa2426164df2c7a14 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783441508.336541:0:5787:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91a87da47e00/0xa2426164df2c7a06 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.13@tcp remote: 0x633a354aa4df4d7b expref: 10 pid: 5787 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783441508.336556:0:5787:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff91a87da46400/0xa2426164df2c7a1b lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.13@tcp remote: 0x633a354aa4df4d7b expref: 9 pid: 5787 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783441508.336570:0:5787:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff91a858b90e00) 00010000:00010000:1.0:1783441508.336573:0:5787:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1783441508.336576:0:5787:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91a87da46400, rc 0) 00000100:00100000:1.0:1783441508.336663:0:5787:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a846f27b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:65454767-383a-4679-a788-eba05c6e0989+9:10197:x1870073673312384:12345-192.168.201.13@tcp:101:lhsmtool_posix.0 Request processed in 1688us (4837us total) trans 4294967309 rc 0/0 00000100:00100000:1.0:1783441508.336671:0:5787:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.13@tcp, seq: 34 00000100:00100000:2.0:1783441508.343881:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.13@tcp (source: 12345-192.168.201.13@tcp) 00000100:00100000:3.0:1783441508.344166:0:5785:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073673312512 00000100:00100000:3.0:1783441508.344178:0:5785:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073673312512 00000100:00100000:3.0:1783441508.344362:0:5785:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.13@tcp, seq: 35 00000100:00100000:3.0:1783441508.344372:0:5785:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a846f24e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:65454767-383a-4679-a788-eba05c6e0989+9:10197:x1870073673312512:12345-192.168.201.13@tcp:59:lhsmtool_posix.0 00000100:00100000:3.0:1783441508.344478:0:5785:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a846f24e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:65454767-383a-4679-a788-eba05c6e0989+9:10197:x1870073673312512:12345-192.168.201.13@tcp:59:lhsmtool_posix.0 Request processed in 108us (608us total) trans 0 rc 0/0 00000100:00100000:3.0:1783441508.344486:0:5785:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.13@tcp, seq: 35 00010000:00010000:1.0:1783441508.463529:0:5773:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:0.0:1783441509.231870:0:11531:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:0.0:1783441509.234219:0:3303:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff91a87531d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3303:1870073693274752:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1783441509.234294:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783441509.234475:0:6585:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073693274752 00000100:00100000:1.0:1783441509.234485:0:6585:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073693274752 00000100:00100000:1.0:1783441509.234564:0:6585:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 63 00000100:00100000:1.0:1783441509.234574:0:6585:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a87d645880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3303:x1870073693274752:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1783441509.234635:0:6585:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1783441509.234687:0:6585:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a87d645880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3303:x1870073693274752:12345-0@lo:13:osp-pre-0-0.0 Request processed in 114us (392us total) trans 0 rc 0/0 00000100:00100000:1.0:1783441509.234694:0:6585:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 63 00000100:00080000:0.0:1783441509.234828:0:5781:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1783441509.234866:0:3303:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff91a87531d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3303:1870073693274752:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1783441509.249314:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.13@tcp (source: 12345-192.168.201.13@tcp) 00000100:00100000:3.0:1783441509.249356:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.13@tcp (source: 12345-192.168.201.13@tcp) 00000100:00100000:3.0:1783441509.249389:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.13@tcp (source: 12345-192.168.201.13@tcp) 00000100:00100000:3.0:1783441509.249422:0:5787:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073673312896 00000100:00100000:3.0:1783441509.249433:0:5787:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073673312896 00000100:00100000:3.0:1783441509.249504:0:5787:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073673312768 00000100:00100000:3.0:1783441509.249508:0:5787:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073673312768 00000100:00100000:3.0:1783441509.249530:0:5787:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.13@tcp, seq: 143 00000100:00100000:3.0:1783441509.249539:0:5787:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a87da69180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d5aa2a25-c618-49e9-a833-85b3b4747e53+5:2355:x1870073673312896:12345-192.168.201.13@tcp:400:kworker.0 00000100:00100000:3.0:1783441509.249618:0:5787:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a87da69180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d5aa2a25-c618-49e9-a833-85b3b4747e53+5:2355:x1870073673312896:12345-192.168.201.13@tcp:400:kworker.0 Request processed in 79us (261us total) trans 0 rc 0/0 00000100:00100000:3.0:1783441509.249626:0:5787:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.13@tcp, seq: 143 00000100:00100000:3.0:1783441509.249652:0:5787:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.13@tcp, seq: 144 00000100:00100000:3.0:1783441509.249658:0:5787:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a87da6ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:65454767-383a-4679-a788-eba05c6e0989+9:2355:x1870073673312768:12345-192.168.201.13@tcp:400:kworker.0 00000100:00100000:3.0:1783441509.249685:0:5787:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a87da6ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:65454767-383a-4679-a788-eba05c6e0989+9:2355:x1870073673312768:12345-192.168.201.13@tcp:400:kworker.0 Request processed in 27us (295us total) trans 0 rc 0/0 00000100:00100000:3.0:1783441509.249691:0:5787:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.13@tcp, seq: 144 00000100:00080000:3.0:1783441509.249706:0:5781:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1783441509.250092:0:5779:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073673312640 00000100:00100000:2.0:1783441509.250097:0:5779:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073673312640 00000100:00100000:2.0:1783441509.250139:0:5779:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.13@tcp, seq: 287 00000100:00100000:2.0:1783441509.250147:0:5779:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a848f73c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:51c2a82e-e792-4f56-84e8-12cc033e9e70+13:2355:x1870073673312640:12345-192.168.201.13@tcp:400:kworker.0 00000100:00100000:2.0:1783441509.250189:0:5779:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a848f73c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:51c2a82e-e792-4f56-84e8-12cc033e9e70+13:2355:x1870073673312640:12345-192.168.201.13@tcp:400:kworker.0 Request processed in 44us (885us total) trans 0 rc 0/0 00000100:00100000:2.0:1783441509.250208:0:5779:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.13@tcp, seq: 287 00010000:00010000:1.0:1783441509.490706:0:5772:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:0.0:1783441510.326515:0:5807:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967309 is committed 00000100:00100000:1.0:1783441510.427328:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.13@tcp (source: 12345-192.168.201.13@tcp) 00000100:00100000:3.0:1783441510.427396:0:5787:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073673313024 00000100:00100000:3.0:1783441510.427406:0:5787:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073673313024 00000100:00100000:3.0:1783441510.427477:0:5787:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.13@tcp, seq: 36 00000100:00100000:3.0:1783441510.427488:0:5787:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a87531e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:65454767-383a-4679-a788-eba05c6e0989+8:10240:x1870073673313024:12345-192.168.201.13@tcp:101:lfs.0 00010000:00010000:3.0:1783441510.427509:0:5787:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1783441510.427595:0:5787:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91a841476000/0xa2426164df2c7a29 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x633a354aa4df4d82 expref: -99 pid: 5787 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783441510.427670:0:5787:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff91a841476e00/0xa2426164df2c7a30 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783441510.427687:0:5787:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91a841476e00/0xa2426164df2c7a30 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783441510.427701:0:5787:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91a841476e00/0xa2426164df2c7a30 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783441510.427717:0:5787:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff91a841477c00/0xa2426164df2c7a37 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783441510.427724:0:5787:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91a841477c00/0xa2426164df2c7a37 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783441510.427730:0:5787:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91a841477c00/0xa2426164df2c7a37 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783441510.428028:0:5787:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff91a841476e00/0xa2426164df2c7a30 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783441510.428037:0:5787:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff91a841476e00/0xa2426164df2c7a30 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783441510.428054:0:5787:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff91a841476e00/0xa2426164df2c7a30 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783441510.428060:0:5787:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91a841476e00 already unused, calling callback (ffffffffc1f9b4f0) 00010000:00010000:3.0:1783441510.428065:0:5787:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91a841476e00/0xa2426164df2c7a30 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783441510.428073:0:5787:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91a841476e00/0xa2426164df2c7a30 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783441510.428085:0:5787:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff91a8439b0500) 00010000:00010000:3.0:1783441510.428088:0:5787:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1783441510.428094:0:5787:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff91a841476e00/0xa2426164df2c7a30 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783441510.428100:0:5787:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91a841476e00/0xa2426164df2c7a30 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783441510.428112:0:5787:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff91a841477c00/0xa2426164df2c7a37 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783441510.428117:0:5787:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff91a841477c00/0xa2426164df2c7a37 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783441510.428123:0:5787:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff91a841477c00/0xa2426164df2c7a37 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783441510.428134:0:5787:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91a841477c00 already unused, calling callback (ffffffffc1f9b4f0) 00010000:00010000:3.0:1783441510.428136:0:5787:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91a841477c00/0xa2426164df2c7a37 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783441510.428143:0:5787:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91a841477c00/0xa2426164df2c7a37 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783441510.428151:0:5787:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x7aaf747d (ffff91a85faee500) 00010000:00010000:3.0:1783441510.428153:0:5787:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1783441510.428156:0:5787:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff91a841477c00/0xa2426164df2c7a37 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783441510.428162:0:5787:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91a841477c00/0xa2426164df2c7a37 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783441510.428209:0:5787:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff91a841476000/0xa2426164df2c7a29 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.13@tcp remote: 0x633a354aa4df4d82 expref: 9 pid: 5787 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783441510.428219:0:5787:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff91a8439b0500) 00010000:00010000:3.0:1783441510.428221:0:5787:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1783441510.428225:0:5787:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91a841476000/0xa2426164df2c7a29 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.13@tcp remote: 0x633a354aa4df4d82 expref: 9 pid: 5787 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783441510.428235:0:5787:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91a841476000, rc 0) 00000100:00100000:3.0:1783441510.428297:0:5787:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a87531e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:65454767-383a-4679-a788-eba05c6e0989+8:10240:x1870073673313024:12345-192.168.201.13@tcp:101:lfs.0 Request processed in 812us (979us total) trans 0 rc 301/301 00000100:00100000:3.0:1783441510.428305:0:5787:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.13@tcp, seq: 36 00000100:00080000:1.0:1783441510.428537:0:5781:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1783441510.435611:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.13@tcp (source: 12345-192.168.201.13@tcp) 00000100:00100000:3.0:1783441510.435691:0:5785:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073673313280 00000100:00100000:3.0:1783441510.435717:0:5785:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073673313280 00000100:00100000:3.0:1783441510.435801:0:5785:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.13@tcp, seq: 37 00000100:00100000:3.0:1783441510.435811:0:5785:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a87531fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:65454767-383a-4679-a788-eba05c6e0989+8:10240:x1870073673313280:12345-192.168.201.13@tcp:36:lfs.0 00010000:00010000:3.0:1783441510.435869:0:5785:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1783441510.435897:0:5785:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91a85fe58e00/0xa2426164df2c79e3 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.13@tcp remote: 0x633a354aa4df4d6d expref: 8 pid: 6605 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783441510.435918:0:5785:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff91a8439b0500) 00010000:00010000:3.0:1783441510.435928:0:5785:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1783441510.436338:0:5785:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff91a841477200/0xa2426164df2c7a3e lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783441510.436351:0:5785:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91a841477200/0xa2426164df2c7a3e lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783441510.436360:0:5785:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91a841477200/0xa2426164df2c7a3e lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783441510.436370:0:5785:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff91a841477e00/0xa2426164df2c7a45 lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783441510.436376:0:5785:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91a841477e00/0xa2426164df2c7a45 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783441510.436381:0:5785:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91a841477e00/0xa2426164df2c7a45 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1783441510.437620:0:5785:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x3:0x0]: returning size 512 00010000:00010000:3.0:1783441510.437635:0:5785:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff91a841477200/0xa2426164df2c7a3e lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783441510.437644:0:5785:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff91a841477200/0xa2426164df2c7a3e lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783441510.437657:0:5785:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff91a841477200/0xa2426164df2c7a3e lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783441510.437663:0:5785:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91a841477200 already unused, calling callback (ffffffffc1f9b4f0) 00010000:00010000:3.0:1783441510.437668:0:5785:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91a841477200/0xa2426164df2c7a3e lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783441510.437676:0:5785:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91a841477200/0xa2426164df2c7a3e lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783441510.437689:0:5785:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff91a85faee700) 00010000:00010000:3.0:1783441510.437693:0:5785:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1783441510.437696:0:5785:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff91a841477200/0xa2426164df2c7a3e lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783441510.437703:0:5785:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91a841477200/0xa2426164df2c7a3e lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1783441510.439021:0:5785:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 0000000029c4c86b reply state 0000000047665570 transno 4294967310 ns: mdt-lustre-MDT0000_UUID lock: ffff91a841477e00/0xa2426164df2c7a45 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783441510.439032:0:5785:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1783441510.443297:0:5785:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a87531fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:65454767-383a-4679-a788-eba05c6e0989+9:10240:x1870073673313280:12345-192.168.201.13@tcp:36:lfs.0 Request processed in 7476us (7684us total) trans 4294967310 rc 0/0 00000100:00100000:3.0:1783441510.443311:0:5785:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.13@tcp, seq: 37 00010000:00010000:1.0:1783441510.446099:0:3290:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff91a841477e00/0xa2426164df2c7a45 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783441510.446115:0:3290:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff91a841477e00/0xa2426164df2c7a45 lrc: 2/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783441510.446122:0:3290:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff91a841477e00/0xa2426164df2c7a45 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783441510.446142:0:3290:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91a841477e00 already unused, calling callback (ffffffffc1f9b4f0) 00010000:00010000:1.0:1783441510.446147:0:3290:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91a841477e00/0xa2426164df2c7a45 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783441510.446154:0:3290:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91a841477e00/0xa2426164df2c7a45 lrc: 4/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783441510.446170:0:3290:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x7aaf747d (ffff91a85faee800) 00010000:00010000:1.0:1783441510.446173:0:3290:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1783441510.446177:0:3290:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff91a841477e00/0xa2426164df2c7a45 lrc: 2/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783441510.446197:0:3290:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91a841477e00/0xa2426164df2c7a45 lrc: 0/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783441510.521504:0:5773:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1783441510.545107:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.13@tcp (source: 12345-192.168.201.13@tcp) 00000100:00100000:3.0:1783441510.545216:0:5787:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073673313408 00000100:00100000:3.0:1783441510.545233:0:5787:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073673313408 00000100:00100000:3.0:1783441510.545330:0:5787:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.13@tcp, seq: 38 00000100:00100000:3.0:1783441510.545342:0:5787:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a87531d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:65454767-383a-4679-a788-eba05c6e0989+8:10248:x1870073673313408:12345-192.168.201.13@tcp:101:lctl.0 00010000:00010000:3.0:1783441510.545399:0:5787:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1783441510.545430:0:5787:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91a841477200/0xa2426164df2c7a4c lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x633a354aa4df4d89 expref: -99 pid: 5787 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783441510.545519:0:5787:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff91a841476000/0xa2426164df2c7a53 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783441510.545537:0:5787:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91a841476000/0xa2426164df2c7a53 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783441510.545552:0:5787:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91a841476000/0xa2426164df2c7a53 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1783441510.545638:0:5787:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 7680 00000004:00200000:3.0:1783441510.545643:0:5787:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 2 stripe count 1 MDT count 1 00000004:00010000:3.0:1783441510.545693:0:5787:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff91a841476000/0xa2426164df2c7a53 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783441510.548251:0:5787:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91a841477200/0xa2426164df2c7a4c lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.13@tcp remote: 0x633a354aa4df4d89 expref: 10 pid: 5787 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783441510.548291:0:5787:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff91a841476000/0xa2426164df2c7a53 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.13@tcp remote: 0x633a354aa4df4d89 expref: 9 pid: 5787 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783441510.548302:0:5787:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff91a85faee700) 00010000:00010000:3.0:1783441510.548305:0:5787:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1783441510.548310:0:5787:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91a841476000, rc 0) 00000100:00100000:0.0:1783441510.548498:0:5787:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a87531d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:65454767-383a-4679-a788-eba05c6e0989+9:10248:x1870073673313408:12345-192.168.201.13@tcp:101:lctl.0 Request processed in 3147us (3391us total) trans 0 rc 0/0 00000100:00100000:0.0:1783441510.548509:0:5787:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.13@tcp, seq: 38 00000100:00100000:3.0:1783441510.614425:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.13@tcp (source: 12345-192.168.201.13@tcp) 00000100:00100000:1.0:1783441510.614632:0:6605:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073673313536 00000100:00100000:1.0:1783441510.614649:0:6605:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073673313536 00000100:00100000:1.0:1783441510.614734:0:6605:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.13@tcp, seq: 39 00000100:00100000:1.0:1783441510.614784:0:6605:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a87da68a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:65454767-383a-4679-a788-eba05c6e0989+9:10254:x1870073673313536:12345-192.168.201.13@tcp:101:bash.0 00010000:00010000:1.0:1783441510.614809:0:6605:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1783441510.614833:0:6605:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91a87da47800/0xa2426164df2c7a5a lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x633a354aa4df4d90 expref: -99 pid: 6605 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783441510.615006:0:6605:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff91a85fe58e00/0xa2426164df2c7a61 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6605 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783441510.615028:0:6605:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91a85fe58e00/0xa2426164df2c7a61 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6605 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783441510.615050:0:6605:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91a85fe58e00/0xa2426164df2c7a61 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6605 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783441510.615069:0:6605:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff91a85fe58a00/0xa2426164df2c7a68 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6605 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783441510.615077:0:6605:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91a85fe58a00/0xa2426164df2c7a68 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6605 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783441510.615085:0:6605:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91a85fe58a00/0xa2426164df2c7a68 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6605 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783441510.615257:0:6605:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff91a85fe59e00/0xa2426164df2c7a6f lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6605 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783441510.615266:0:6605:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91a85fe59e00/0xa2426164df2c7a6f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6605 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783441510.615274:0:6605:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91a85fe59e00/0xa2426164df2c7a6f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6605 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1783441510.615312:0:6605:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x3:0x0]: returning size 512 00000004:00200000:0.0:1783441510.615315:0:6605:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:0.0:1783441510.615361:0:6605:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff91a85fe59e00/0xa2426164df2c7a6f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6605 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783441510.615376:0:6605:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff91a85fe58e00/0xa2426164df2c7a61 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6605 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783441510.615384:0:6605:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff91a85fe58e00/0xa2426164df2c7a61 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6605 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783441510.615392:0:6605:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff91a85fe58e00/0xa2426164df2c7a61 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6605 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783441510.615398:0:6605:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91a85fe58e00 already unused, calling callback (ffffffffc1f9b4f0) 00010000:00010000:0.0:1783441510.615403:0:6605:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91a85fe58e00/0xa2426164df2c7a61 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6605 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783441510.615411:0:6605:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91a85fe58e00/0xa2426164df2c7a61 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6605 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783441510.615424:0:6605:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff91a85faee700) 00010000:00010000:0.0:1783441510.615433:0:6605:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1783441510.615439:0:6605:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff91a85fe58e00/0xa2426164df2c7a61 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6605 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783441510.615446:0:6605:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91a85fe58e00/0xa2426164df2c7a61 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6605 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783441510.615464:0:6605:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff91a85fe58a00/0xa2426164df2c7a68 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6605 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783441510.615470:0:6605:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff91a85fe58a00/0xa2426164df2c7a68 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6605 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783441510.615477:0:6605:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff91a85fe58a00/0xa2426164df2c7a68 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6605 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783441510.615482:0:6605:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91a85fe58a00 already unused, calling callback (ffffffffc1f9b4f0) 00010000:00010000:0.0:1783441510.615484:0:6605:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91a85fe58a00/0xa2426164df2c7a68 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6605 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783441510.615490:0:6605:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91a85fe58a00/0xa2426164df2c7a68 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6605 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783441510.615496:0:6605:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x7aaf747d (ffff91a8439b0b00) 00010000:00010000:0.0:1783441510.615498:0:6605:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1783441510.615501:0:6605:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff91a85fe58a00/0xa2426164df2c7a68 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6605 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783441510.615506:0:6605:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91a85fe58a00/0xa2426164df2c7a68 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6605 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783441510.615544:0:6605:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91a87da47800/0xa2426164df2c7a5a lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.13@tcp remote: 0x633a354aa4df4d90 expref: 11 pid: 6605 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783441510.615573:0:6605:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff91a85fe59e00/0xa2426164df2c7a6f lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.13@tcp remote: 0x633a354aa4df4d90 expref: 10 pid: 6605 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783441510.615581:0:6605:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff91a8439b0300) 00010000:00010000:0.0:1783441510.615584:0:6605:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:0.0:1783441510.615587:0:6605:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91a85fe59e00, rc 0) 00000100:00100000:0.0:1783441510.615683:0:6605:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a87da68a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:65454767-383a-4679-a788-eba05c6e0989+10:10254:x1870073673313536:12345-192.168.201.13@tcp:101:bash.0 Request processed in 939us (1274us total) trans 0 rc 0/0 00000100:00100000:0.0:1783441510.615692:0:6605:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.13@tcp, seq: 39 00000100:00100000:1.0:1783441510.621029:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.13@tcp (source: 12345-192.168.201.13@tcp) 00000100:00100000:2.0:1783441510.621163:0:5786:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073673313792 00000100:00100000:2.0:1783441510.621176:0:5786:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073673313792 00000100:00100000:2.0:1783441510.621259:0:5786:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.13@tcp, seq: 40 00000100:00100000:2.0:1783441510.621271:0:5786:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a87531ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:65454767-383a-4679-a788-eba05c6e0989+10:10254:x1870073673313792:12345-192.168.201.13@tcp:101:bash.0 00010000:00010000:2.0:1783441510.621298:0:5786:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1783441510.621326:0:5786:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91a85f83d000/0xa2426164df2c7a76 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x633a354aa4df4d97 expref: -99 pid: 5786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783441510.621529:0:5786:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff91a85f83da00/0xa2426164df2c7a7d lrc: 3/0,1 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783441510.621547:0:5786:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91a85f83da00/0xa2426164df2c7a7d lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783441510.621561:0:5786:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91a85f83da00/0xa2426164df2c7a7d lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783441510.621709:0:5786:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff91a85f83d600/0xa2426164df2c7a84 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783441510.621732:0:5786:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91a85f83d600/0xa2426164df2c7a84 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783441510.621802:0:5786:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91a85f83d600/0xa2426164df2c7a84 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:2.0:1783441510.624391:0:5786:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x2:0x0], index 1: 0 00010000:00010000:2.0:1783441510.624963:0:5786:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff91a85f83cc00/0xa2426164df2c7a8b lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783441510.624993:0:5786:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91a85f83cc00/0xa2426164df2c7a8b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783441510.625006:0:5786:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91a85f83cc00/0xa2426164df2c7a8b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783441510.625060:0:5786:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff91a85f83da00/0xa2426164df2c7a7d lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783441510.625068:0:5786:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff91a85f83da00/0xa2426164df2c7a7d lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783441510.625075:0:5786:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff91a85f83da00/0xa2426164df2c7a7d lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783441510.625081:0:5786:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91a85f83da00 already unused, calling callback (ffffffffc1f9b4f0) 00010000:00010000:2.0:1783441510.625085:0:5786:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91a85f83da00/0xa2426164df2c7a7d lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783441510.625092:0:5786:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91a85f83da00/0xa2426164df2c7a7d lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783441510.625104:0:5786:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff91a8439b0300) 00010000:00010000:2.0:1783441510.625107:0:5786:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1783441510.625112:0:5786:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff91a85f83da00/0xa2426164df2c7a7d lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783441510.625118:0:5786:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91a85f83da00/0xa2426164df2c7a7d lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1783441510.625132:0:5786:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 0000000003e8ac97 reply state 0000000044e5d6c9 transno 4294967311 ns: mdt-lustre-MDT0000_UUID lock: ffff91a85f83d600/0xa2426164df2c7a84 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783441510.625149:0:5786:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:2.0:1783441510.625193:0:5786:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91a85f83d000/0xa2426164df2c7a76 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.13@tcp remote: 0x633a354aa4df4d97 expref: 13 pid: 5786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783441510.625207:0:5786:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff91a85f83cc00/0xa2426164df2c7a8b lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.13@tcp remote: 0x633a354aa4df4d97 expref: 12 pid: 5786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783441510.625215:0:5786:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff91a8429bd100) 00010000:00010000:2.0:1783441510.625217:0:5786:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1783441510.625220:0:5786:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91a85f83cc00, rc 0) 00000100:00100000:2.0:1783441510.626219:0:5786:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a87531ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:65454767-383a-4679-a788-eba05c6e0989+13:10254:x1870073673313792:12345-192.168.201.13@tcp:101:bash.0 Request processed in 4942us (5197us total) trans 4294967311 rc 0/0 00000100:00100000:2.0:1783441510.626229:0:5786:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.13@tcp, seq: 40 00000100:00100000:1.0:1783441510.638099:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.13@tcp (source: 12345-192.168.201.13@tcp) 00010000:00010000:3.0:1783441510.638315:0:3289:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff91a85f83d600/0xa2426164df2c7a84 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783441510.638346:0:3289:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff91a85f83d600/0xa2426164df2c7a84 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783441510.638354:0:3289:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff91a85f83d600/0xa2426164df2c7a84 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783441510.638360:0:3289:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91a85f83d600 already unused, calling callback (ffffffffc1f9b4f0) 00010000:00010000:3.0:1783441510.638366:0:3289:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91a85f83d600/0xa2426164df2c7a84 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783441510.638373:0:3289:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91a85f83d600/0xa2426164df2c7a84 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783441510.638392:0:3289:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff91a8429bdd00) 00010000:00010000:3.0:1783441510.638395:0:3289:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1783441510.638401:0:3289:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff91a85f83d600/0xa2426164df2c7a84 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783441510.638407:0:3289:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91a85f83d600/0xa2426164df2c7a84 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783441510.638603:0:6581:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073673313920 00000100:00100000:2.0:1783441510.638613:0:6581:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073673313920 00000100:00100000:2.0:1783441510.638662:0:6581:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.13@tcp, seq: 21 00000100:00100000:2.0:1783441510.638671:0:6581:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a87531ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:2351:x1870073673313920:12345-192.168.201.13@tcp:8:bash.0 00010000:00080000:2.0:1783441510.638704:0:6581:0:(ldlm_lib.c:1432:target_handle_connect()) lustre-OST0001: connection from 65454767-383a-4679-a788-eba05c6e0989@192.168.201.13@tcp t0 exp 0000000000000000 cur 348 last 0 00000020:00000080:2.0:1783441510.638731:0:6581:0:(genops.c:1406:class_connect()) connect: client 65454767-383a-4679-a788-eba05c6e0989, cookie 0xa2426164df2c7a99 00002000:00100000:2.0:1783441510.638783:0:6581:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli 65454767-383a-4679-a788-eba05c6e0989/ffff91a8431d7000 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113669 ocd_grant: 3407872 ocd_index: 0 ocd_group 0 00002000:00100000:2.0:1783441510.638807:0:6581:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0001: cli supports cksum type f7, return f7 00002000:00080000:2.0:1783441510.639016:0:6581:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:2.0:1783441510.639058:0:6581:0:(import.c:65:import_set_state_nolock()) ffff91a8431d2000 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1783441510.639127:0:6581:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a87531ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:65454767-383a-4679-a788-eba05c6e0989+6:2351:x1870073673313920:12345-192.168.201.13@tcp:8:bash.0 Request processed in 456us (1044us total) trans 0 rc 0/0 00000100:00100000:2.0:1783441510.639146:0:6581:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.13@tcp, seq: 21 00000100:00100000:3.0:1783441510.643647:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.13@tcp (source: 12345-192.168.201.13@tcp) 00000100:00100000:2.0:1783441510.644398:0:8557:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073673314048 00000100:00100000:2.0:1783441510.644410:0:8557:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073673314048 00000100:00100000:3.0:1783441510.644619:0:8557:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.13@tcp, seq: 22 00000100:00100000:3.0:1783441510.644631:0:8557:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a87da6aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:65454767-383a-4679-a788-eba05c6e0989+6:0:x1870073673314048:12345-192.168.201.13@tcp:101:bash.0 00010000:00010000:3.0:1783441510.644653:0:8557:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1783441510.644679:0:8557:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000d813f77a/0xa2426164df2c7aa0 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x633a354aa4df4d9e expref: -99 pid: 8557 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1783441510.644709:0:8557:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x2:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1783441510.644777:0:8557:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2:0x0].0x0 since=348s v=(0 0) 00010000:00010000:3.0:1783441510.644783:0:8557:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1783441510.644792:0:8557:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000d813f77a/0xa2426164df2c7aa0 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.13@tcp remote: 0x633a354aa4df4d9e expref: 7 pid: 8557 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783441510.644817:0:8557:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000d813f77a/0xa2426164df2c7aa0 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.13@tcp remote: 0x633a354aa4df4d9e expref: 7 pid: 8557 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783441510.644836:0:8557:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91a841477200, rc 0) 00000100:00100000:3.0:1783441510.644915:0:8557:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a87da6aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:65454767-383a-4679-a788-eba05c6e0989+7:0:x1870073673314048:12345-192.168.201.13@tcp:101:bash.0 Request processed in 286us (1276us total) trans 0 rc 0/0 00000100:00100000:3.0:1783441510.644923:0:8557:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.13@tcp, seq: 22 00000100:00080000:1.0:1783441510.645482:0:5781:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1783441510.654633:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.13@tcp (source: 12345-192.168.201.13@tcp) 00000100:00100000:2.0:1783441510.654956:0:6581:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073673314176 00000100:00100000:2.0:1783441510.654966:0:6581:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073673314176 00000100:00100000:3.0:1783441510.655288:0:6581:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.13@tcp, seq: 23 00000100:00100000:3.0:1783441510.655300:0:6581:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a87531ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:65454767-383a-4679-a788-eba05c6e0989+7:10254:x1870073673314176:12345-192.168.201.13@tcp:101:bash.0 00010000:00010000:3.0:1783441510.655319:0:6581:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1783441510.655340:0:6581:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000802041fd/0xa2426164df2c7aa7 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x633a354aa4df4da5 expref: -99 pid: 6581 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783441510.655375:0:6581:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000d813f77a/0xa2426164df2c7aa0 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.13@tcp remote: 0x633a354aa4df4d9e expref: 8 pid: 8557 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783441510.655385:0:6581:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1783441510.655391:0:6581:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1783441510.655396:0:6581:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000802041fd/0xa2426164df2c7aa7 lrc: 4/0,0 mode: --/PW res: [0x280000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.201.13@tcp remote: 0x633a354aa4df4da5 expref: 8 pid: 6581 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783441510.655465:0:6581:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000d813f77a/0xa2426164df2c7aa0 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.201.13@tcp remote: 0x633a354aa4df4d9e expref: 8 pid: 8557 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783441510.655480:0:6581:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000d813f77a/0xa2426164df2c7aa0 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.201.13@tcp remote: 0x633a354aa4df4d9e expref: 8 pid: 8557 timeout: 448 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783441510.655494:0:6581:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff91a87da69f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:6581:1870073693274880:192.168.201.13@tcp:104: 00000100:00100000:3.0:1783441510.655597:0:6581:0:(client.c:2702:ptlrpc_set_wait()) set ffff91a8504a30c0 going to sleep for 11 seconds 00000100:00100000:3.0:1783441510.659533:0:6581:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff91a87da69f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:6581:1870073693274880:192.168.201.13@tcp:104: 00010000:00010000:3.0:1783441510.659571:0:6581:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000802041fd/0xa2426164df2c7aa7 lrc: 3/0,0 mode: --/PW res: [0x280000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.201.13@tcp remote: 0x633a354aa4df4da5 expref: 8 pid: 6581 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783441510.659592:0:6581:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91a841477c00, rc 0) 00000100:00100000:3.0:1783441510.659659:0:6581:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a87531ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:65454767-383a-4679-a788-eba05c6e0989+8:10254:x1870073673314176:12345-192.168.201.13@tcp:101:bash.0 Request processed in 4361us (5036us total) trans 0 rc 0/0 00000100:00100000:3.0:1783441510.659667:0:6581:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.13@tcp, seq: 23 00000100:00100000:0.0:1783441510.659792:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.13@tcp (source: 12345-192.168.201.13@tcp) 00000100:00100000:2.0:1783441510.660246:0:11514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073673314304 00000100:00100000:2.0:1783441510.660254:0:11514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073673314304 00010000:00010000:2.0:1783441510.660298:0:11514:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000d813f77a/0xa2426164df2c7aa0 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.201.13@tcp remote: 0x633a354aa4df4d9e expref: 8 pid: 8557 timeout: 448 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783441510.660334:0:11514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.13@tcp, seq: 35 00000100:00100000:2.0:1783441510.660344:0:11514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a87d646680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:65454767-383a-4679-a788-eba05c6e0989+8:2354:x1870073673314304:12345-192.168.201.13@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1783441510.660359:0:11514:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1783441510.660384:0:11514:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000d813f77a/0xa2426164df2c7aa0 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.201.13@tcp remote: 0x633a354aa4df4d9e expref: 8 pid: 8557 timeout: 448 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783441510.660397:0:11514:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000d813f77a/0xa2426164df2c7aa0 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.201.13@tcp remote: 0x633a354aa4df4d9e expref: 8 pid: 8557 timeout: 448 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783441510.660428:0:11514:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000d813f77a/0xa2426164df2c7aa0 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.201.13@tcp remote: 0x633a354aa4df4d9e expref: 8 pid: 8557 timeout: 448 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783441510.660448:0:11514:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1783441510.660453:0:11514:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1783441510.660461:0:11514:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000802041fd/0xa2426164df2c7aa7 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.201.13@tcp remote: 0x633a354aa4df4da5 expref: 7 pid: 6581 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783441510.660499:0:11514:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000802041fd/0xa2426164df2c7aa7 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.201.13@tcp remote: 0x633a354aa4df4da5 expref: 7 pid: 6581 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783441510.660531:0:11514:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 00000000802041fd/0xa2426164df2c7aa7 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.201.13@tcp remote: 0x633a354aa4df4da5 expref: 7 pid: 6581 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783441510.660541:0:11514:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff91a846f26a00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0001_UUID:11514:1870073693275008:192.168.201.13@tcp:105: 00000100:00100000:2.0:1783441510.660601:0:11514:0:(client.c:2702:ptlrpc_set_wait()) set ffff91a8501c6540 going to sleep for 11 seconds 00000100:00100000:0.0:1783441510.675094:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.13@tcp (source: 12345-192.168.201.13@tcp) 00000100:00100000:3.0:1783441510.675306:0:5789:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073673314560 00000100:00100000:3.0:1783441510.675323:0:5789:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073673314560 00000100:00100000:3.0:1783441510.675415:0:5789:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.13@tcp, seq: 6 00000100:00100000:3.0:1783441510.675427:0:5789:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a87d647b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:65454767-383a-4679-a788-eba05c6e0989+12:10254:x1870073673314560:12345-192.168.201.13@tcp:35:bash.0 00000100:00100000:3.0:1783441510.675990:0:5789:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a87d647b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:65454767-383a-4679-a788-eba05c6e0989+13:10254:x1870073673314560:12345-192.168.201.13@tcp:35:bash.0 Request processed in 563us (904us total) trans 4294967312 rc 0/0 00000100:00100000:3.0:1783441510.675999:0:5789:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.13@tcp, seq: 6 00000100:00100000:2.0:1783441510.678237:0:11514:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff91a846f26a00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0001_UUID:11514:1870073693275008:192.168.201.13@tcp:105: 00010000:00010000:2.0:1783441510.678268:0:11514:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1783441510.678348:0:11514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a87d646680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:65454767-383a-4679-a788-eba05c6e0989+7:2354:x1870073673314304:12345-192.168.201.13@tcp:103:ldlm_bl.0 Request processed in 18004us (18555us total) trans 0 rc 0/0 00000100:00100000:2.0:1783441510.678359:0:11514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.13@tcp, seq: 35 00000100:00100000:0.0:1783441510.785686:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.13@tcp (source: 12345-192.168.201.13@tcp) 00000100:00100000:3.0:1783441510.785805:0:5785:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073673314816 00000100:00100000:3.0:1783441510.785821:0:5785:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073673314816 00000100:00100000:3.0:1783441510.785937:0:5785:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.13@tcp, seq: 41 00000100:00100000:3.0:1783441510.785949:0:5785:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a87d645180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:65454767-383a-4679-a788-eba05c6e0989+13:10264:x1870073673314816:12345-192.168.201.13@tcp:101:lfs.0 00010000:00010000:3.0:1783441510.785994:0:5785:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1783441510.786024:0:5785:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91a841476e00/0xa2426164df2c7aae lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x633a354aa4df4dac expref: -99 pid: 5785 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1783441510.786215:0:5785:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x3:0x0]: returning size 512 00010000:00010000:3.0:1783441510.786361:0:5785:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff91a841476e00/0xa2426164df2c7aae lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.13@tcp remote: 0x633a354aa4df4dac expref: 15 pid: 5785 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783441510.786375:0:5785:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff91a85faee700) 00010000:00010000:3.0:1783441510.786377:0:5785:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1783441510.786383:0:5785:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91a841476e00/0xa2426164df2c7aae lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.13@tcp remote: 0x633a354aa4df4dac expref: 15 pid: 5785 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783441510.786398:0:5785:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91a841476e00, rc 0) 00000100:00100000:3.0:1783441510.786472:0:5785:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a87d645180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:65454767-383a-4679-a788-eba05c6e0989+14:10264:x1870073673314816:12345-192.168.201.13@tcp:101:lfs.0 Request processed in 526us (798us total) trans 4294967313 rc 301/301 00000100:00100000:3.0:1783441510.786480:0:5785:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.13@tcp, seq: 41 00000100:00100000:1.0:1783441510.788670:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.13@tcp (source: 12345-192.168.201.13@tcp) 00000100:00100000:3.0:1783441510.788789:0:5789:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073673315072 00000100:00100000:3.0:1783441510.788803:0:5789:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073673315072 00000100:00100000:3.0:1783441510.788864:0:5789:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.13@tcp, seq: 7 00000100:00100000:3.0:1783441510.788872:0:5789:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a87531df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:65454767-383a-4679-a788-eba05c6e0989+14:10264:x1870073673315072:12345-192.168.201.13@tcp:35:lfs.0 00000100:00100000:3.0:1783441510.789379:0:5789:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a87531df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:65454767-383a-4679-a788-eba05c6e0989+15:10264:x1870073673315072:12345-192.168.201.13@tcp:35:lfs.0 Request processed in 503us (722us total) trans 4294967314 rc 0/0 00000100:00100000:3.0:1783441510.789414:0:5789:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.13@tcp, seq: 7 00000100:00100000:0.0:1783441510.888281:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.13@tcp (source: 12345-192.168.201.13@tcp) 00000100:00100000:1.0:1783441510.888422:0:5787:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073673315200 00000100:00100000:1.0:1783441510.888436:0:5787:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073673315200 00000100:00100000:1.0:1783441510.888525:0:5787:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.13@tcp, seq: 42 00000100:00100000:1.0:1783441510.888538:0:5787:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a87d646d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:65454767-383a-4679-a788-eba05c6e0989+15:10270:x1870073673315200:12345-192.168.201.13@tcp:101:lfs.0 00010000:00010000:1.0:1783441510.888578:0:5787:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1783441510.888610:0:5787:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91a87da47000/0xa2426164df2c7abc lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x633a354aa4df4db3 expref: -99 pid: 5787 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783441510.888985:0:5787:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff91a87da46200/0xa2426164df2c7ac3 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783441510.889005:0:5787:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91a87da46200/0xa2426164df2c7ac3 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783441510.889021:0:5787:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91a87da46200/0xa2426164df2c7ac3 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1783441510.889130:0:5787:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x3:0x0]: returning size 512 00000004:00200000:1.0:1783441510.889136:0:5787:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 1 stripe count 1 MDT count 1 00000004:00010000:1.0:1783441510.889173:0:5787:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff91a87da46200/0xa2426164df2c7ac3 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783441510.889209:0:5787:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91a87da47000/0xa2426164df2c7abc lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.13@tcp remote: 0x633a354aa4df4db3 expref: 17 pid: 5787 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783441510.889237:0:5787:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff91a87da46200/0xa2426164df2c7ac3 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.13@tcp remote: 0x633a354aa4df4db3 expref: 16 pid: 5787 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783441510.889247:0:5787:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff91a8439b0300) 00010000:00010000:1.0:1783441510.889269:0:5787:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1783441510.889274:0:5787:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91a87da46200, rc 0) 00000100:00100000:1.0:1783441510.889436:0:5787:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a87d646d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:65454767-383a-4679-a788-eba05c6e0989+16:10270:x1870073673315200:12345-192.168.201.13@tcp:101:lfs.0 Request processed in 900us (1169us total) trans 0 rc 0/0 00000100:00100000:1.0:1783441510.889445:0:5787:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.13@tcp, seq: 42 00000100:00100000:0.0:1783441510.896810:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.13@tcp (source: 12345-192.168.201.13@tcp) 00000100:00100000:2.0:1783441510.897187:0:6605:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073673315456 00000100:00100000:2.0:1783441510.897203:0:6605:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073673315456 00000100:00100000:2.0:1783441510.897287:0:6605:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.13@tcp, seq: 43 00000100:00100000:2.0:1783441510.897299:0:6605:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a87d644a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:65454767-383a-4679-a788-eba05c6e0989+16:10270:x1870073673315456:12345-192.168.201.13@tcp:101:lfs.0 00010000:00010000:2.0:1783441510.897331:0:6605:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1783441510.897362:0:6605:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91a85f83da00/0xa2426164df2c7aca lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x633a354aa4df4dba expref: -99 pid: 6605 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783441510.897515:0:6605:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff91a85f83ca00/0xa2426164df2c7ad1 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6605 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783441510.897532:0:6605:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91a85f83ca00/0xa2426164df2c7ad1 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6605 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783441510.897565:0:6605:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91a85f83ca00/0xa2426164df2c7ad1 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6605 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1783441510.897580:0:6605:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 13 00010000:00010000:2.0:1783441510.897888:0:6605:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91a85f83da00/0xa2426164df2c7aca lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.13@tcp remote: 0x633a354aa4df4dba expref: 19 pid: 6605 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783441510.897914:0:6605:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff91a85f83ca00/0xa2426164df2c7ad1 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.13@tcp remote: 0x633a354aa4df4dba expref: 18 pid: 6605 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783441510.897925:0:6605:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff91a8429bd100) 00010000:00010000:2.0:1783441510.897929:0:6605:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1783441510.897934:0:6605:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91a85f83ca00, rc 0) 00000100:00100000:2.0:1783441510.898041:0:6605:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a87d644a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:65454767-383a-4679-a788-eba05c6e0989+18:10270:x1870073673315456:12345-192.168.201.13@tcp:101:lfs.0 Request processed in 734us (1305us total) trans 4294967315 rc 0/0 00000100:00100000:2.0:1783441510.898050:0:6605:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.13@tcp, seq: 43 00000100:00100000:3.0:1783441510.904290:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.13@tcp (source: 12345-192.168.201.13@tcp) 00000100:00100000:3.0:1783441510.904345:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.13@tcp (source: 12345-192.168.201.13@tcp) 00000100:00100000:2.0:1783441510.904428:0:5786:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073673315712 00000100:00100000:2.0:1783441510.904441:0:5786:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073673315712 00000100:00100000:2.0:1783441510.904529:0:5786:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.13@tcp, seq: 44 00000100:00100000:2.0:1783441510.904542:0:5786:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a87da69f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:65454767-383a-4679-a788-eba05c6e0989+18:10270:x1870073673315712:12345-192.168.201.13@tcp:101:lfs.0 00010000:00010000:2.0:1783441510.904574:0:5786:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1783441510.904605:0:5786:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91a85f83d000/0xa2426164df2c7adf lrc: 2/0,0 mode: --/CR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x633a354aa4df4dc1 expref: -99 pid: 5786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783441510.904790:0:5786:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff91a85f83d600/0xa2426164df2c7ae6 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783441510.904820:0:5786:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91a85f83d600/0xa2426164df2c7ae6 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783441510.904834:0:5786:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91a85f83d600/0xa2426164df2c7ae6 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1783441510.904851:0:5786:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 13 00010000:00010000:2.0:1783441510.905006:0:5786:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91a85f83d000/0xa2426164df2c7adf lrc: 0/0,0 mode: --/CR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.13@tcp remote: 0x633a354aa4df4dc1 expref: 21 pid: 5786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783441510.905028:0:5786:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff91a85f83d600/0xa2426164df2c7ae6 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.13@tcp remote: 0x633a354aa4df4dc1 expref: 20 pid: 5786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783441510.905051:0:5786:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff91a8429bd100) 00010000:00010000:2.0:1783441510.905054:0:5786:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:2.0:1783441510.905058:0:5786:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91a85f83d600, rc 0) 00000100:00100000:2.0:1783441510.905133:0:5786:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a87da69f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:65454767-383a-4679-a788-eba05c6e0989+20:10270:x1870073673315712:12345-192.168.201.13@tcp:101:lfs.0 Request processed in 593us (857us total) trans 4294967316 rc 0/0 00000100:00100000:2.0:1783441510.905140:0:5786:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.13@tcp, seq: 44 00000100:00100000:1.0:1783441510.905388:0:5769:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073673315840 00000100:00100000:1.0:1783441510.905394:0:5769:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073673315840 00000100:00100000:1.0:1783441510.905435:0:5769:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.13@tcp, seq: 2 00000100:00100000:1.0:1783441510.905443:0:5769:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a87da68700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:65454767-383a-4679-a788-eba05c6e0989+20:2353:x1870073673315840:12345-192.168.201.13@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1783441510.905454:0:5769:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1783441510.905469:0:5769:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91a85f83ca00/0xa2426164df2c7ad1 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.13@tcp remote: 0x633a354aa4df4dba expref: 20 pid: 6605 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783441510.905482:0:5769:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff91a8429bd100) 00010000:00010000:1.0:1783441510.905486:0:5769:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1783441510.905510:0:5769:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a87da68700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:65454767-383a-4679-a788-eba05c6e0989+19:2353:x1870073673315840:12345-192.168.201.13@tcp:103:ldlm_bl.0 Request processed in 68us (1164us total) trans 0 rc 0/0 00000100:00100000:1.0:1783441510.905517:0:5769:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.13@tcp, seq: 2 00000100:00100000:0.0:1783441510.920232:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.13@tcp (source: 12345-192.168.201.13@tcp) 00000100:00100000:3.0:1783441510.920345:0:8557:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073673315968 00000100:00100000:3.0:1783441510.920358:0:8557:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073673315968 00000100:00100000:3.0:1783441510.920436:0:8557:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.13@tcp, seq: 24 00000100:00100000:3.0:1783441510.920448:0:8557:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a87d646a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:65454767-383a-4679-a788-eba05c6e0989+7:2354:x1870073673315968:12345-192.168.201.13@tcp:1:lfs.0 00010000:00010000:3.0:1783441510.920518:0:8557:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000089a42abc/0xa2426164df2c7af4 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8557 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783441510.920545:0:8557:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000802041fd/0xa2426164df2c7aa7 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.201.13@tcp remote: 0x633a354aa4df4da5 expref: 7 pid: 6581 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783441510.920555:0:8557:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1783441510.920560:0:8557:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1783441510.920565:0:8557:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000089a42abc/0xa2426164df2c7af4 lrc: 4/0,1 mode: --/PW res: [0x280000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8557 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783441510.920613:0:8557:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000802041fd/0xa2426164df2c7aa7 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.201.13@tcp remote: 0x633a354aa4df4da5 expref: 7 pid: 6581 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783441510.920643:0:8557:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000802041fd/0xa2426164df2c7aa7 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.201.13@tcp remote: 0x633a354aa4df4da5 expref: 7 pid: 6581 timeout: 448 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783441510.920662:0:8557:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff91a87da69c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:8557:1870073693275136:192.168.201.13@tcp:104: 00000100:00100000:3.0:1783441510.920887:0:8557:0:(client.c:2702:ptlrpc_set_wait()) set ffff91a8504a30c0 going to sleep for 11 seconds 00000100:00100000:0.0:1783441510.923809:0:8557:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff91a87da69c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:8557:1870073693275136:192.168.201.13@tcp:104: 00010000:00010000:0.0:1783441510.923853:0:8557:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 0000000089a42abc/0xa2426164df2c7af4 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8557 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783441510.929696:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.13@tcp (source: 12345-192.168.201.13@tcp) 00000100:00100000:2.0:1783441510.929821:0:6586:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073673316096 00000100:00100000:2.0:1783441510.929838:0:6586:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073673316096 00002000:00100000:2.0:1783441510.929909:0:6586:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0x2:0x0] (0->12) req@ffff91a87d645f80 x1870073673316096/t0(0) o4->65454767-383a-4679-a788-eba05c6e0989@192.168.201.13@tcp:151/0 lens 504/0 e 0 to 0 dl 1783441521 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1783441510.929922:0:6586:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff91a87d645f80 with x1870073673316096 ext(0->12) 00010000:00010000:2.0:1783441510.929934:0:6586:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 00000000802041fd/0xa2426164df2c7aa7 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.201.13@tcp remote: 0x633a354aa4df4da5 expref: 8 pid: 6581 timeout: 448 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783441510.929984:0:6586:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 00000000802041fd/0xa2426164df2c7aa7 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.201.13@tcp remote: 0x633a354aa4df4da5 expref: 8 pid: 6581 timeout: 448 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1783441510.929992:0:6586:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff91a87d645f80 00000100:00100000:2.0:1783441510.930046:0:6586:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.13@tcp, seq: 0 00000100:00100000:2.0:1783441510.930066:0:6586:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a87d645f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:65454767-383a-4679-a788-eba05c6e0989+8:2354:x1870073673316096:12345-192.168.201.13@tcp:4:lfs.0 00000001:00100000:3.0:1783441511.034706:0:7492:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of 65454767-383a-4679-a788-eba05c6e0989 00000100:00100000:0.0:1783441511.035648:0:6586:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a87d645f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:65454767-383a-4679-a788-eba05c6e0989+9:2354:x1870073673316096:12345-192.168.201.13@tcp:4:lfs.0 Request processed in 105577us (105956us total) trans 4294967299 rc 0/0 00000100:00100000:0.0:1783441511.035668:0:6586:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.13@tcp, seq: 0 00002000:00100000:0.0:1783441511.035682:0:6586:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0x2:0x0] (0->12) req@ffff91a87d645f80 x1870073673316096/t4294967299(0) o4->65454767-383a-4679-a788-eba05c6e0989@192.168.201.13@tcp:151/0 lens 504/448 e 0 to 0 dl 1783441521 ref 1 fl Complete:H/600/0 rc 0/0 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1783441511.035707:0:6586:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff91a87d645f80 with x1870073673316096 ext(0->12) 00010000:00010000:0.0:1783441511.035717:0:6586:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 00000000802041fd/0xa2426164df2c7aa7 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.201.13@tcp remote: 0x633a354aa4df4da5 expref: 9 pid: 6581 timeout: 448 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783441511.035736:0:6586:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 00000000802041fd/0xa2426164df2c7aa7 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.201.13@tcp remote: 0x633a354aa4df4da5 expref: 9 pid: 6581 timeout: 448 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1783441511.035777:0:6586:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff91a87d645f80 00000100:00100000:3.0:1783441511.051889:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.13@tcp (source: 12345-192.168.201.13@tcp) 00000100:00100000:0.0:1783441511.052095:0:5771:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073673316224 00000100:00100000:0.0:1783441511.052105:0:5771:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073673316224 00010000:00010000:0.0:1783441511.052152:0:5771:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000802041fd/0xa2426164df2c7aa7 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.201.13@tcp remote: 0x633a354aa4df4da5 expref: 9 pid: 6581 timeout: 448 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783441511.052205:0:5771:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.13@tcp, seq: 36 00000100:00100000:0.0:1783441511.052215:0:5771:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a87da6b100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:65454767-383a-4679-a788-eba05c6e0989+9:2354:x1870073673316224:12345-192.168.201.13@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1783441511.052230:0:5771:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00002000:00010000:0.0:1783441511.052249:0:5771:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0x2:0x0] updating lvb size from disk: 0 -> 13 00002000:00010000:0.0:1783441511.052252:0:5771:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000400:0x2:0x0] updating lvb mtime from disk: 0 -> 1783441511 00002000:00010000:0.0:1783441511.052254:0:5771:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000400:0x2:0x0] updating lvb atime from disk: 0 -> 1783441511 00002000:00010000:0.0:1783441511.052256:0:5771:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000400:0x2:0x0] updating lvb ctime from disk: 0 -> 1783441511 00010000:00010000:0.0:1783441511.052262:0:5771:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000802041fd/0xa2426164df2c7aa7 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.201.13@tcp remote: 0x633a354aa4df4da5 expref: 9 pid: 6581 timeout: 448 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783441511.052277:0:5771:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000802041fd/0xa2426164df2c7aa7 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.201.13@tcp remote: 0x633a354aa4df4da5 expref: 9 pid: 6581 timeout: 448 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783441511.052322:0:5771:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000802041fd/0xa2426164df2c7aa7 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.201.13@tcp remote: 0x633a354aa4df4da5 expref: 9 pid: 6581 timeout: 448 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783441511.052339:0:5771:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1783441511.052344:0:5771:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1783441511.052350:0:5771:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 0000000089a42abc/0xa2426164df2c7af4 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 8557 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783441511.052360:0:5771:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000089a42abc/0xa2426164df2c7af4 lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 8557 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783441511.052403:0:5771:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1783441511.052465:0:5771:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a87da6b100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:65454767-383a-4679-a788-eba05c6e0989+8:2354:x1870073673316224:12345-192.168.201.13@tcp:103:ldlm_bl.0 Request processed in 251us (587us total) trans 0 rc 0/0 00000100:00100000:0.0:1783441511.052474:0:5771:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.13@tcp, seq: 36 00010000:00010000:1.0:1783441511.052972:0:8557:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 0000000089a42abc/0xa2426164df2c7af4 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8557 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783441511.052985:0:8557:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000089a42abc/0xa2426164df2c7af4 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8557 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783441511.053015:0:8557:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000089a42abc/0xa2426164df2c7af4 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8557 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783441511.053050:0:8557:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000089a42abc/0xa2426164df2c7af4 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8557 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783441511.053059:0:8557:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000089a42abc/0xa2426164df2c7af4 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8557 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783441511.053066:0:8557:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91a841476e00 already unused, calling callback (ffffffffc155ff90) 00010000:00010000:1.0:1783441511.053071:0:8557:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000089a42abc/0xa2426164df2c7af4 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8557 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783441511.053081:0:8557:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000089a42abc/0xa2426164df2c7af4 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8557 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783441511.053098:0:8557:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000089a42abc/0xa2426164df2c7af4 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8557 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783441511.053106:0:8557:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000089a42abc/0xa2426164df2c7af4 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8557 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783441511.053177:0:8557:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a87d646a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:65454767-383a-4679-a788-eba05c6e0989+7:2354:x1870073673315968:12345-192.168.201.13@tcp:1:lfs.0 Request processed in 132730us (132961us total) trans 0 rc 0/0 00000100:00100000:1.0:1783441511.053198:0:8557:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.13@tcp, seq: 24 00000100:00100000:0.0:1783441511.068074:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.13@tcp (source: 12345-192.168.201.13@tcp) 00000100:00100000:3.0:1783441511.077324:0:5789:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073673316480 00000100:00100000:3.0:1783441511.077338:0:5789:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073673316480 00000100:00100000:2.0:1783441511.078170:0:5789:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.13@tcp, seq: 8 00000100:00100000:2.0:1783441511.078182:0:5789:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a87d644700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:65454767-383a-4679-a788-eba05c6e0989+19:10270:x1870073673316480:12345-192.168.201.13@tcp:35:lfs.0 00000004:00010000:2.0:1783441511.078269:0:5789:0:(mdt_open.c:1998:mdt_hsm_release()) ### [0x200000401:0x4:0x0] lease broken? 0 ns: mdt-lustre-MDT0000_UUID lock: ffff91a85f83d600/0xa2426164df2c7ae6 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.13@tcp remote: 0x633a354aa4df4dc1 expref: 19 pid: 5786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1783441511.078582:0:5789:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967317 00000001:00080000:2.0:1783441511.078637:0:5789:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967318 00000001:00080000:2.0:1783441511.079328:0:5789:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967319 00010000:00010000:2.0:1783441511.079386:0:5789:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff91a85f83da00/0xa2426164df2c7afb lrc: 3/0,1 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5789 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783441511.079403:0:5789:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff91a85f83cc00/0xa2426164df2c7a8b lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.13@tcp remote: 0x633a354aa4df4d97 expref: 23 pid: 5786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783441511.079412:0:5789:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff91a85f83da00/0xa2426164df2c7afb lrc: 4/0,1 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5789 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783441511.079447:0:5789:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff91a85f83cc00/0xa2426164df2c7a8b lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.13@tcp remote: 0x633a354aa4df4d97 expref: 23 pid: 5786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783441511.079475:0:5789:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff91a85f83cc00/0xa2426164df2c7a8b lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.13@tcp remote: 0x633a354aa4df4d97 expref: 23 pid: 5786 timeout: 448 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783441511.079490:0:5789:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff91a846f26a00 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000_UUID:5789:1870073693275264:192.168.201.13@tcp:104: 00000100:00100000:2.0:1783441511.079582:0:5789:0:(client.c:2702:ptlrpc_set_wait()) set ffff91a8501c6600 going to sleep for 11 seconds 00000100:00100000:2.0:1783441511.085255:0:5789:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff91a846f26a00 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000_UUID:5789:1870073693275264:192.168.201.13@tcp:104: 00010000:00010000:2.0:1783441511.085299:0:5789:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff91a85f83da00/0xa2426164df2c7afb lrc: 3/0,1 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5789 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783441511.087560:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.13@tcp (source: 12345-192.168.201.13@tcp) 00000100:00100000:2.0:1783441511.087677:0:11514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073673316608 00000100:00100000:2.0:1783441511.087691:0:11514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073673316608 00010000:00010000:2.0:1783441511.087876:0:11514:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff91a85f83cc00/0xa2426164df2c7a8b lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.13@tcp remote: 0x633a354aa4df4d97 expref: 24 pid: 5786 timeout: 448 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783441511.087928:0:11514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.13@tcp, seq: 37 00000100:00100000:2.0:1783441511.088081:0:11514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a87d645c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:65454767-383a-4679-a788-eba05c6e0989+24:2355:x1870073673316608:12345-192.168.201.13@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1783441511.088103:0:11514:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1783441511.088112:0:11514:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff91a85f83cc00/0xa2426164df2c7a8b lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.13@tcp remote: 0x633a354aa4df4d97 expref: 24 pid: 5786 timeout: 448 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783441511.088128:0:11514:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff91a85f83cc00/0xa2426164df2c7a8b lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.13@tcp remote: 0x633a354aa4df4d97 expref: 24 pid: 5786 timeout: 448 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783441511.088157:0:11514:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91a85f83cc00/0xa2426164df2c7a8b lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.13@tcp remote: 0x633a354aa4df4d97 expref: 24 pid: 5786 timeout: 448 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783441511.088263:0:11514:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff91a8429bd100) 00010000:00010000:2.0:1783441511.088270:0:11514:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff91a85f83da00/0xa2426164df2c7afb lrc: 3/0,1 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5789 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783441511.088282:0:11514:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff91a85f83da00/0xa2426164df2c7afb lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5789 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783441511.088291:0:11514:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91a85f83da00/0xa2426164df2c7afb lrc: 4/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5789 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783441511.088382:0:11514:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1783441511.088458:0:11514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a87d645c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:65454767-383a-4679-a788-eba05c6e0989+23:2355:x1870073673316608:12345-192.168.201.13@tcp:103:ldlm_bl.0 Request processed in 520us (910us total) trans 0 rc 0/0 00000100:00100000:2.0:1783441511.088467:0:11514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.13@tcp, seq: 37 00010000:00010000:0.0:1783441511.088520:0:5789:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff91a85f83da00/0xa2426164df2c7afb lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5789 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783441511.088529:0:5789:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91a85f83da00/0xa2426164df2c7afb lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5789 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1783441511.088911:0:5789:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967320 00000001:00080000:0.0:1783441511.089316:0:5789:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967321 00000100:00100000:0.0:1783441511.089474:0:5789:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff91a87d647100 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:5789:1870073693275392:0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:0.0:1783441511.089568:0:5789:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783441511.089616:0:5789:0:(client.c:2702:ptlrpc_set_wait()) set ffff91a87d7f9480 going to sleep for 11 seconds 00000100:00100000:1.0:1783441511.090130:0:5790:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073693275392 00000100:00100000:1.0:1783441511.090147:0:5790:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073693275392 00000100:00100000:1.0:1783441511.090242:0:5790:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1783441511.090267:0:5790:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a87d644e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:5789:x1870073693275392:12345-0@lo:1000:mdt_rdpg00_001.0 00000100:00080000:0.0:1783441511.090300:0:5781:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1783441511.090398:0:5790:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a87d644e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:5789:x1870073693275392:12345-0@lo:1000:mdt_rdpg00_001.0 Request processed in 133us (829us total) trans 0 rc 0/0 00000100:00100000:1.0:1783441511.090408:0:5790:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1783441511.090456:0:5789:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff91a87d647100 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:5789:1870073693275392:0@lo:1000:mdt_rdpg00_001.0 00000001:00080000:0.0:1783441511.091624:0:5789:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967322 00000100:00100000:0.0:1783441511.092144:0:5789:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff91a87d647100 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:5789:1870073693275520:0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:0.0:1783441511.092321:0:5789:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783441511.092366:0:5789:0:(client.c:2702:ptlrpc_set_wait()) set ffff91a87d7f9180 going to sleep for 11 seconds 00000100:00100000:1.0:1783441511.092453:0:5790:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073693275520 00000100:00100000:1.0:1783441511.092462:0:5790:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073693275520 00000100:00100000:1.0:1783441511.092533:0:5790:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1783441511.092543:0:5790:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a87d646300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:5789:x1870073693275520:12345-0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:1.0:1783441511.092839:0:5790:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a87d646300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:5789:x1870073693275520:12345-0@lo:1000:mdt_rdpg00_001.0 Request processed in 297us (517us total) trans 4294967300 rc 0/0 00000100:00100000:1.0:1783441511.092848:0:5790:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1783441511.092904:0:5789:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff91a87d647100 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:5789:1870073693275520:0@lo:1000:mdt_rdpg00_001.0 00000001:00080000:1.0:1783441511.093316:0:5789:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967323 00010000:00010000:1.0:1783441511.093376:0:5789:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff91a85f83da00/0xa2426164df2c7afb lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5789 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783441511.093389:0:5789:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff91a85f83da00/0xa2426164df2c7afb lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5789 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783441511.093397:0:5789:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff91a85f83da00/0xa2426164df2c7afb lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5789 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783441511.093404:0:5789:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91a85f83da00 already unused, calling callback (ffffffffc1f9b4f0) 00010000:00010000:1.0:1783441511.093410:0:5789:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91a85f83da00/0xa2426164df2c7afb lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5789 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783441511.093420:0:5789:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91a85f83da00/0xa2426164df2c7afb lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5789 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783441511.093461:0:5789:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff91a8429bd100) 00010000:00010000:1.0:1783441511.093465:0:5789:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 28 00010000:00010000:1.0:1783441511.093470:0:5789:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff91a85f83da00/0xa2426164df2c7afb lrc: 2/0,0 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5789 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783441511.093478:0:5789:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91a85f83da00/0xa2426164df2c7afb lrc: 0/0,0 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5789 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:1.0:1783441511.093731:0:5789:0:(mdd_object.c:4010:mdd_close()) Object [0x200000401:0x5:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000040:00080000:0.0:1783441511.098645:0:5789:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].2, 64 off8320 00000004:00080000:0.0:1783441511.098673:0:5789:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 348972930273ns, next at 349972925677ns, rc = 0 00000001:00080000:0.0:1783441511.098692:0:5789:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967324 00010000:00010000:0.0:1783441511.098821:0:5789:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff91a8429bd100) 00010000:00010000:0.0:1783441511.098837:0:5789:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:0.0:1783441511.098853:0:5789:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91a85f83d600/0xa2426164df2c7ae6 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x4/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.13@tcp remote: 0x633a354aa4df4dc1 expref: 27 pid: 5786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783441511.099401:0:5789:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a87d644700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:65454767-383a-4679-a788-eba05c6e0989+26:10270:x1870073673316480:12345-192.168.201.13@tcp:35:lfs.0 Request processed in 21216us (31333us total) trans 4294967325 rc 0/0 00000100:00100000:0.0:1783441511.099420:0:5789:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.13@tcp, seq: 8 00000020:00080000:0.0:1783441511.099429:0:5789:0:(tgt_main.c:784:tgt_ses_key_exit()) total 9 transactions per RPC 00000100:00100000:0.0:1783441511.109407:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.13@tcp (source: 12345-192.168.201.13@tcp) 00000100:00100000:2.0:1783441511.109534:0:6605:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073673316736 00000100:00100000:2.0:1783441511.109549:0:6605:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073673316736 00000100:00100000:2.0:1783441511.109634:0:6605:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.13@tcp, seq: 45 00000100:00100000:2.0:1783441511.109648:0:6605:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a8749a7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:65454767-383a-4679-a788-eba05c6e0989+26:10270:x1870073673316736:12345-192.168.201.13@tcp:101:lfs.0 00010000:00010000:2.0:1783441511.109685:0:6605:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1783441511.109721:0:6605:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91a85f83cc00/0xa2426164df2c7b02 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x633a354aa4df4dc8 expref: -99 pid: 6605 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783441511.110088:0:6605:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91a85f83cc00/0xa2426164df2c7b02 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.201.13@tcp remote: 0x633a354aa4df4dc8 expref: 27 pid: 6605 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783441511.110106:0:6605:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff91a85f83cc00/0xa2426164df2c7b02 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.13@tcp remote: 0x633a354aa4df4dc8 expref: 27 pid: 6605 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783441511.110147:0:6605:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff91a8429bdf00) 00010000:00010000:2.0:1783441511.110151:0:6605:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1783441511.110155:0:6605:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91a85f83cc00, rc 0) 00000100:00100000:2.0:1783441511.110335:0:6605:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a8749a7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:65454767-383a-4679-a788-eba05c6e0989+27:10270:x1870073673316736:12345-192.168.201.13@tcp:101:lfs.0 Request processed in 689us (942us total) trans 0 rc 0/0 00000100:00100000:2.0:1783441511.110343:0:6605:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.13@tcp, seq: 45 00000100:00100000:2.0:1783441511.130222:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.13@tcp (source: 12345-192.168.201.13@tcp) 00000100:00100000:1.0:1783441511.130368:0:5788:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073673316992 00000100:00100000:1.0:1783441511.130382:0:5788:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073673316992 00000100:00100000:1.0:1783441511.130464:0:5788:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.13@tcp, seq: 9 00000100:00100000:1.0:1783441511.130476:0:5788:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a8468a9450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:65454767-383a-4679-a788-eba05c6e0989+27:10270:x1870073673316992:12345-192.168.201.13@tcp:35:lfs.0 00000100:00100000:1.0:1783441511.132276:0:5788:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a8468a9450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:65454767-383a-4679-a788-eba05c6e0989+28:10270:x1870073673316992:12345-192.168.201.13@tcp:35:lfs.0 Request processed in 1790us (2059us total) trans 4294967326 rc 0/0 00000100:00100000:1.0:1783441511.132293:0:5788:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.13@tcp, seq: 9 00000100:00100000:1.0:1783441511.304020:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.13@tcp (source: 12345-192.168.201.13@tcp) 00000100:00100000:2.0:1783441511.304156:0:5786:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073673317248 00000100:00100000:2.0:1783441511.304176:0:5786:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073673317248 00000100:00100000:2.0:1783441511.304274:0:5786:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.13@tcp, seq: 46 00000100:00100000:2.0:1783441511.304286:0:5786:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a87531df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:65454767-383a-4679-a788-eba05c6e0989+28:10280:x1870073673317248:12345-192.168.201.13@tcp:101:lfs.0 00010000:00010000:2.0:1783441511.304323:0:5786:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1783441511.304370:0:5786:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91a85f83c400/0xa2426164df2c7b09 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x633a354aa4df4dcf expref: -99 pid: 5786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1783441511.304556:0:5786:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x3:0x0]: returning size 512 00010000:00010000:2.0:1783441511.304952:0:5786:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff91a85f83c400/0xa2426164df2c7b09 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.13@tcp remote: 0x633a354aa4df4dcf expref: 30 pid: 5786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783441511.304971:0:5786:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff91a85faee700) 00010000:00010000:2.0:1783441511.304975:0:5786:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1783441511.304982:0:5786:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91a85f83c400/0xa2426164df2c7b09 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.13@tcp remote: 0x633a354aa4df4dcf expref: 30 pid: 5786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783441511.305002:0:5786:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91a85f83c400, rc 0) 00000100:00100000:2.0:1783441511.305117:0:5786:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a87531df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:65454767-383a-4679-a788-eba05c6e0989+29:10280:x1870073673317248:12345-192.168.201.13@tcp:101:lfs.0 Request processed in 833us (1112us total) trans 4294967327 rc 301/301 00000100:00100000:2.0:1783441511.305144:0:5786:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.13@tcp, seq: 46 00000100:00100000:2.0:1783441511.310050:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.13@tcp (source: 12345-192.168.201.13@tcp) 00000100:00100000:3.0:1783441511.310231:0:5785:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073673317376 00000100:00100000:3.0:1783441511.310248:0:5785:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073673317376 00000100:00100000:3.0:1783441511.310322:0:5785:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.13@tcp, seq: 47 00000100:00100000:3.0:1783441511.310332:0:5785:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a846f26a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:65454767-383a-4679-a788-eba05c6e0989+29:10280:x1870073673317376:12345-192.168.201.13@tcp:34:lfs.0 00010000:00010000:3.0:1783441511.310537:0:5785:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff91a841476800/0xa2426164df2c7b17 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783441511.310556:0:5785:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91a841476800/0xa2426164df2c7b17 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783441511.310571:0:5785:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91a841476800/0xa2426164df2c7b17 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783441511.310591:0:5785:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff91a841477c00/0xa2426164df2c7b1e lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783441511.310599:0:5785:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91a841477c00/0xa2426164df2c7b1e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783441511.310606:0:5785:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91a841477c00/0xa2426164df2c7b1e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783441511.310839:0:5785:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff91a841476e00/0xa2426164df2c7b25 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783441511.310848:0:5785:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91a841476e00/0xa2426164df2c7b25 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783441511.310870:0:5785:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91a841476e00/0xa2426164df2c7b25 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1783441511.310916:0:5785:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff91a841476e00/0xa2426164df2c7b25 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783441511.310929:0:5785:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff91a841476800/0xa2426164df2c7b17 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783441511.310935:0:5785:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff91a841476800/0xa2426164df2c7b17 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783441511.310942:0:5785:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff91a841476800/0xa2426164df2c7b17 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783441511.310948:0:5785:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91a841476800 already unused, calling callback (ffffffffc1f9b4f0) 00010000:00010000:3.0:1783441511.310952:0:5785:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91a841476800/0xa2426164df2c7b17 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783441511.310960:0:5785:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91a841476800/0xa2426164df2c7b17 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783441511.310972:0:5785:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff91a8439b0300) 00010000:00010000:3.0:1783441511.310974:0:5785:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1783441511.310979:0:5785:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff91a841476800/0xa2426164df2c7b17 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783441511.310984:0:5785:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91a841476800/0xa2426164df2c7b17 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783441511.310997:0:5785:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff91a841477c00/0xa2426164df2c7b1e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783441511.311008:0:5785:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff91a841477c00/0xa2426164df2c7b1e lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783441511.311014:0:5785:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff91a841477c00/0xa2426164df2c7b1e lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783441511.311019:0:5785:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91a841477c00 already unused, calling callback (ffffffffc1f9b4f0) 00010000:00010000:3.0:1783441511.311023:0:5785:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91a841477c00/0xa2426164df2c7b1e lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783441511.311041:0:5785:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91a841477c00/0xa2426164df2c7b1e lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783441511.311048:0:5785:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff91a85faeeb00) 00010000:00010000:3.0:1783441511.311051:0:5785:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1783441511.311054:0:5785:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff91a841477c00/0xa2426164df2c7b1e lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783441511.311060:0:5785:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91a841477c00/0xa2426164df2c7b1e lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783441511.311084:0:5785:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff91a841476e00/0xa2426164df2c7b25 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783441511.311090:0:5785:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff91a841476e00/0xa2426164df2c7b25 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783441511.311096:0:5785:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff91a841476e00/0xa2426164df2c7b25 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783441511.311101:0:5785:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91a841476e00 already unused, calling callback (ffffffffc1f9b4f0) 00010000:00010000:3.0:1783441511.311109:0:5785:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91a841476e00/0xa2426164df2c7b25 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783441511.311115:0:5785:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91a841476e00/0xa2426164df2c7b25 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783441511.311123:0:5785:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff91a8429bdf00) 00010000:00010000:3.0:1783441511.311126:0:5785:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1783441511.311129:0:5785:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff91a841476e00/0xa2426164df2c7b25 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783441511.311135:0:5785:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91a841476e00/0xa2426164df2c7b25 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783441511.311845:0:5785:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a846f26a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:65454767-383a-4679-a788-eba05c6e0989+29:10280:x1870073673317376:12345-192.168.201.13@tcp:34:lfs.0 Request processed in 1509us (1817us total) trans 0 rc 0/0 00000100:00100000:3.0:1783441511.311855:0:5785:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.13@tcp, seq: 47 00000100:00100000:3.0:1783441511.317465:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.13@tcp (source: 12345-192.168.201.13@tcp) 00000100:00100000:2.0:1783441511.317616:0:5789:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073673317632 00000100:00100000:2.0:1783441511.317627:0:5789:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073673317632 00000100:00100000:2.0:1783441511.317697:0:5789:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.13@tcp, seq: 10 00000100:00100000:2.0:1783441511.317707:0:5789:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a87da69c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:65454767-383a-4679-a788-eba05c6e0989+29:10280:x1870073673317632:12345-192.168.201.13@tcp:35:lfs.0 00000100:00100000:2.0:1783441511.318010:0:5789:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a87da69c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:65454767-383a-4679-a788-eba05c6e0989+30:10280:x1870073673317632:12345-192.168.201.13@tcp:35:lfs.0 Request processed in 304us (557us total) trans 4294967328 rc 0/0 00000100:00100000:2.0:1783441511.318018:0:5789:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.13@tcp, seq: 10 00000100:00100000:2.0:1783441511.383666:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.13@tcp (source: 12345-192.168.201.13@tcp) 00000100:00100000:3.0:1783441511.383914:0:5786:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073673317888 00000100:00100000:3.0:1783441511.383923:0:5786:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073673317888 00000100:00100000:3.0:1783441511.384205:0:5786:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.13@tcp, seq: 48 00000100:00100000:3.0:1783441511.384217:0:5786:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a745906680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:65454767-383a-4679-a788-eba05c6e0989+30:10283:x1870073673317888:12345-192.168.201.13@tcp:101:lfs.0 00010000:00010000:3.0:1783441511.384244:0:5786:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1783441511.384267:0:5786:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91a841476e00/0xa2426164df2c7b2c lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x633a354aa4df4dd6 expref: -99 pid: 5786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783441511.384342:0:5786:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff91a841477c00/0xa2426164df2c7b33 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783441511.384357:0:5786:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91a841477c00/0xa2426164df2c7b33 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783441511.384382:0:5786:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91a841477c00/0xa2426164df2c7b33 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783441511.384398:0:5786:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff91a841476800/0xa2426164df2c7b3a lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783441511.384405:0:5786:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91a841476800/0xa2426164df2c7b3a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783441511.384411:0:5786:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91a841476800/0xa2426164df2c7b3a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783441511.384545:0:5786:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff91a841477200/0xa2426164df2c7b41 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783441511.384555:0:5786:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91a841477200/0xa2426164df2c7b41 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783441511.384562:0:5786:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91a841477200/0xa2426164df2c7b41 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1783441511.384573:0:5786:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 13 00010000:00010000:3.0:1783441511.384676:0:5786:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff91a841477c00/0xa2426164df2c7b33 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783441511.384684:0:5786:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff91a841477c00/0xa2426164df2c7b33 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783441511.384692:0:5786:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff91a841477c00/0xa2426164df2c7b33 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783441511.384698:0:5786:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91a841477c00 already unused, calling callback (ffffffffc1f9b4f0) 00010000:00010000:3.0:1783441511.384709:0:5786:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91a841477c00/0xa2426164df2c7b33 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783441511.384717:0:5786:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91a841477c00/0xa2426164df2c7b33 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783441511.384729:0:5786:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff91a8439b0300) 00010000:00010000:3.0:1783441511.384731:0:5786:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1783441511.384735:0:5786:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff91a841477c00/0xa2426164df2c7b33 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783441511.384763:0:5786:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91a841477c00/0xa2426164df2c7b33 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783441511.384777:0:5786:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff91a841476800/0xa2426164df2c7b3a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783441511.384784:0:5786:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff91a841476800/0xa2426164df2c7b3a lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783441511.384789:0:5786:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff91a841476800/0xa2426164df2c7b3a lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783441511.384794:0:5786:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91a841476800 already unused, calling callback (ffffffffc1f9b4f0) 00010000:00010000:3.0:1783441511.384797:0:5786:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91a841476800/0xa2426164df2c7b3a lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783441511.384803:0:5786:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91a841476800/0xa2426164df2c7b3a lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783441511.384810:0:5786:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff91a85faeeb00) 00010000:00010000:3.0:1783441511.384813:0:5786:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1783441511.384823:0:5786:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff91a841476800/0xa2426164df2c7b3a lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783441511.384829:0:5786:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91a841476800/0xa2426164df2c7b3a lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783441511.384871:0:5786:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91a841476e00/0xa2426164df2c7b2c lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.13@tcp remote: 0x633a354aa4df4dd6 expref: 33 pid: 5786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783441511.384884:0:5786:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff91a841477200/0xa2426164df2c7b41 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.13@tcp remote: 0x633a354aa4df4dd6 expref: 32 pid: 5786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783441511.384891:0:5786:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff91a8429bdf00) 00010000:00010000:3.0:1783441511.384893:0:5786:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1783441511.384895:0:5786:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91a841477200, rc 0) 00000100:00100000:3.0:1783441511.385070:0:5786:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a745906680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:65454767-383a-4679-a788-eba05c6e0989+32:10283:x1870073673317888:12345-192.168.201.13@tcp:101:lfs.0 Request processed in 855us (1412us total) trans 4294967329 rc 0/0 00000100:00100000:3.0:1783441511.385078:0:5786:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.13@tcp, seq: 48 00000100:00100000:0.0:1783441511.387870:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.13@tcp (source: 12345-192.168.201.13@tcp) 00000100:00100000:3.0:1783441511.387971:0:5785:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073673318016 00000100:00100000:3.0:1783441511.387981:0:5785:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073673318016 00000100:00100000:3.0:1783441511.388146:0:5785:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.13@tcp, seq: 49 00000100:00100000:3.0:1783441511.388157:0:5785:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a8749a4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:65454767-383a-4679-a788-eba05c6e0989+32:10283:x1870073673318016:12345-192.168.201.13@tcp:54:lfs.0 00010000:00010000:3.0:1783441511.388221:0:5785:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff91a841477e00/0xa2426164df2c7b4f lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783441511.388238:0:5785:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91a841477e00/0xa2426164df2c7b4f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783441511.388250:0:5785:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91a841477e00/0xa2426164df2c7b4f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783441511.388293:0:5785:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff91a841477e00/0xa2426164df2c7b4f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783441511.388300:0:5785:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff91a841477e00/0xa2426164df2c7b4f lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783441511.388306:0:5785:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff91a841477e00/0xa2426164df2c7b4f lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783441511.388312:0:5785:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91a841477e00 already unused, calling callback (ffffffffc1f9b4f0) 00010000:00010000:3.0:1783441511.388316:0:5785:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91a841477e00/0xa2426164df2c7b4f lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783441511.388324:0:5785:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91a841477e00/0xa2426164df2c7b4f lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783441511.388337:0:5785:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff91a8429bdf00) 00010000:00010000:3.0:1783441511.388340:0:5785:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1783441511.388344:0:5785:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff91a841477e00/0xa2426164df2c7b4f lrc: 2/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783441511.388350:0:5785:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91a841477e00/0xa2426164df2c7b4f lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783441511.388421:0:5785:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a8749a4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:65454767-383a-4679-a788-eba05c6e0989+32:10283:x1870073673318016:12345-192.168.201.13@tcp:54:lfs.0 Request processed in 266us (560us total) trans 0 rc 0/0 00000100:00100000:3.0:1783441511.388429:0:5785:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.13@tcp, seq: 49 00000100:00100000:2.0:1783441511.391157:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.13@tcp (source: 12345-192.168.201.13@tcp) 00000100:00100000:0.0:1783441511.391243:0:5789:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073673318272 00000100:00100000:0.0:1783441511.391253:0:5789:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073673318272 00000100:00100000:0.0:1783441511.391310:0:5789:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.13@tcp, seq: 11 00000100:00100000:0.0:1783441511.391320:0:5789:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a745905180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:65454767-383a-4679-a788-eba05c6e0989+32:10283:x1870073673318272:12345-192.168.201.13@tcp:35:lfs.0 00000100:00100000:0.0:1783441511.391573:0:5789:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a745905180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:65454767-383a-4679-a788-eba05c6e0989+33:10283:x1870073673318272:12345-192.168.201.13@tcp:35:lfs.0 Request processed in 253us (429us total) trans 4294967330 rc 0/0 00000100:00100000:0.0:1783441511.391596:0:5789:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.13@tcp, seq: 11 00010000:00010000:1.0:1783441511.533235:0:5772:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1783441511.763376:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.13@tcp (source: 12345-192.168.201.13@tcp) 00000100:00100000:0.0:1783441511.763889:0:5787:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073673318528 00000100:00100000:0.0:1783441511.763901:0:5787:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073673318528 00000100:00100000:0.0:1783441511.763994:0:5787:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.13@tcp, seq: 50 00000100:00100000:0.0:1783441511.764005:0:5787:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a745906a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:65454767-383a-4679-a788-eba05c6e0989+33:10314:x1870073673318528:12345-192.168.201.13@tcp:101:cat.0 00010000:00010000:0.0:1783441511.764050:0:5787:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1783441511.764079:0:5787:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91a85fe58600/0xa2426164df2c7b56 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x633a354aa4df4ddd expref: -99 pid: 5787 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783441511.764209:0:5787:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff91a85fe58000/0xa2426164df2c7b5d lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783441511.764224:0:5787:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91a85fe58000/0xa2426164df2c7b5d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783441511.764236:0:5787:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91a85fe58000/0xa2426164df2c7b5d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1783441511.764249:0:5787:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 13 00010000:00010000:0.0:1783441511.764403:0:5787:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91a85fe58600/0xa2426164df2c7b56 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.13@tcp remote: 0x633a354aa4df4ddd expref: 36 pid: 5787 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783441511.764423:0:5787:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff91a85fe58000/0xa2426164df2c7b5d lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.13@tcp remote: 0x633a354aa4df4ddd expref: 35 pid: 5787 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783441511.764431:0:5787:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff91a8429bdf00) 00010000:00010000:0.0:1783441511.764434:0:5787:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1783441511.764438:0:5787:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91a85fe58000, rc 0) 00000100:00100000:0.0:1783441511.764527:0:5787:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a745906a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:65454767-383a-4679-a788-eba05c6e0989+35:10314:x1870073673318528:12345-192.168.201.13@tcp:101:cat.0 Request processed in 523us (1161us total) trans 4294967331 rc 0/0 00000100:00100000:0.0:1783441511.764534:0:5787:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.13@tcp, seq: 50 00000100:00100000:2.0:1783441511.772003:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.13@tcp (source: 12345-192.168.201.13@tcp) 00000100:00100000:0.0:1783441511.773468:0:5789:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073673318784 00000100:00100000:0.0:1783441511.773484:0:5789:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073673318784 00000100:00100000:0.0:1783441511.773565:0:5789:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.13@tcp, seq: 12 00000100:00100000:0.0:1783441511.773575:0:5789:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a745907800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:65454767-383a-4679-a788-eba05c6e0989+35:10314:x1870073673318784:12345-192.168.201.13@tcp:35:cat.0 00000100:00100000:0.0:1783441511.773940:0:5789:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a745907800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:65454767-383a-4679-a788-eba05c6e0989+36:10314:x1870073673318784:12345-192.168.201.13@tcp:35:cat.0 Request processed in 365us (1944us total) trans 4294967332 rc 0/0 00000100:00100000:0.0:1783441511.773959:0:5789:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.13@tcp, seq: 12 00000100:00100000:2.0:1783441511.780492:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.13@tcp (source: 12345-192.168.201.13@tcp) 00000100:00100000:3.0:1783441511.780618:0:11015:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073673318912 00000100:00100000:3.0:1783441511.780632:0:11015:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073673318912 00000100:00100000:3.0:1783441511.780714:0:11015:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.13@tcp, seq: 3 00000100:00100000:3.0:1783441511.780772:0:11015:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a845459850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:65454767-383a-4679-a788-eba05c6e0989+36:2353:x1870073673318912:12345-192.168.201.13@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1783441511.780792:0:11015:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1783441511.780825:0:11015:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91a85fe58000/0xa2426164df2c7b5d lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.13@tcp remote: 0x633a354aa4df4ddd expref: 36 pid: 5787 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783441511.780846:0:11015:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff91a8429bdf00) 00010000:00010000:3.0:1783441511.780851:0:11015:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1783441511.780914:0:11015:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a845459850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:65454767-383a-4679-a788-eba05c6e0989+35:2353:x1870073673318912:12345-192.168.201.13@tcp:103:ldlm_bl.0 Request processed in 176us (433us total) trans 0 rc 0/0 00000100:00100000:3.0:1783441511.780922:0:11015:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.13@tcp, seq: 3 00000100:00100000:2.0:1783441511.883980:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.13@tcp (source: 12345-192.168.201.13@tcp) 00000100:00100000:1.0:1783441511.884157:0:6605:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073673319168 00000100:00100000:1.0:1783441511.884166:0:6605:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073673319168 00000100:00100000:1.0:1783441511.884222:0:6605:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.13@tcp, seq: 51 00000100:00100000:1.0:1783441511.884232:0:6605:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a875364a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:65454767-383a-4679-a788-eba05c6e0989+35:10320:x1870073673319168:12345-192.168.201.13@tcp:101:dd.0 00010000:00010000:1.0:1783441511.884255:0:6605:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1783441511.884258:0:6605:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:1.0:1783441511.884283:0:6605:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91a87da46200/0xa2426164df2c7ac3 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.13@tcp remote: 0x633a354aa4df4db3 expref: 35 pid: 5787 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783441511.884316:0:6605:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff91a8439b0300) 00010000:00010000:1.0:1783441511.884322:0:6605:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1783441511.884336:0:6605:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91a87da46600/0xa2426164df2c7b6b lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x633a354aa4df4de4 expref: -99 pid: 6605 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783441511.884432:0:6605:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff91a87da47200/0xa2426164df2c7b72 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6605 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783441511.884447:0:6605:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff91a841477200/0xa2426164df2c7b41 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.13@tcp remote: 0x633a354aa4df4dd6 expref: 35 pid: 5786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783441511.884454:0:6605:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff91a87da47200/0xa2426164df2c7b72 lrc: 4/0,1 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6605 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783441511.884491:0:6605:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff91a841477200/0xa2426164df2c7b41 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.13@tcp remote: 0x633a354aa4df4dd6 expref: 35 pid: 5786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783441511.884502:0:6605:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff91a841477200/0xa2426164df2c7b41 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.13@tcp remote: 0x633a354aa4df4dd6 expref: 35 pid: 5786 timeout: 449 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783441511.884515:0:6605:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff91a87531c700 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:6605:1870073693275648:192.168.201.13@tcp:104: 00000100:00100000:1.0:1783441511.884622:0:6605:0:(client.c:2702:ptlrpc_set_wait()) set ffff91a8501fff00 going to sleep for 11 seconds 00000100:00100000:1.0:1783441511.894791:0:6605:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff91a87531c700 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:6605:1870073693275648:192.168.201.13@tcp:104: 00010000:00010000:1.0:1783441511.894827:0:6605:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff91a87da47200/0xa2426164df2c7b72 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6605 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783441511.898724:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.13@tcp (source: 12345-192.168.201.13@tcp) 00000100:00100000:3.0:1783441511.899106:0:5770:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073673319296 00000100:00100000:3.0:1783441511.899117:0:5770:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073673319296 00010000:00010000:3.0:1783441511.899159:0:5770:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff91a841477200/0xa2426164df2c7b41 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.13@tcp remote: 0x633a354aa4df4dd6 expref: 36 pid: 5786 timeout: 449 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783441511.899201:0:5770:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.13@tcp, seq: 38 00000100:00100000:3.0:1783441511.899212:0:5770:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a875366a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:65454767-383a-4679-a788-eba05c6e0989+36:2354:x1870073673319296:12345-192.168.201.13@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1783441511.899225:0:5770:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1783441511.899232:0:5770:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff91a841477200/0xa2426164df2c7b41 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.13@tcp remote: 0x633a354aa4df4dd6 expref: 36 pid: 5786 timeout: 449 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783441511.899245:0:5770:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff91a841477200/0xa2426164df2c7b41 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.13@tcp remote: 0x633a354aa4df4dd6 expref: 36 pid: 5786 timeout: 449 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783441511.899269:0:5770:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91a841477200/0xa2426164df2c7b41 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.13@tcp remote: 0x633a354aa4df4dd6 expref: 36 pid: 5786 timeout: 449 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783441511.899305:0:5770:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff91a8429bdf00) 00010000:00010000:3.0:1783441511.899311:0:5770:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff91a87da47200/0xa2426164df2c7b72 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6605 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783441511.899320:0:5770:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff91a87da47200/0xa2426164df2c7b72 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 6605 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783441511.899326:0:5770:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91a87da47200/0xa2426164df2c7b72 lrc: 4/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 6605 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783441511.899359:0:5770:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1783441511.899421:0:5770:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a875366a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:65454767-383a-4679-a788-eba05c6e0989+35:2354:x1870073673319296:12345-192.168.201.13@tcp:103:ldlm_bl.0 Request processed in 211us (713us total) trans 0 rc 0/0 00000100:00100000:3.0:1783441511.899429:0:5770:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.13@tcp, seq: 38 00010000:00010000:1.0:1783441511.899549:0:6605:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff91a87da47200/0xa2426164df2c7b72 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6605 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783441511.899563:0:6605:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91a87da47200/0xa2426164df2c7b72 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6605 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1783441511.899583:0:6605:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 13 00010000:00010000:1.0:1783441511.899791:0:6605:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91a87da46600/0xa2426164df2c7b6b lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.13@tcp remote: 0x633a354aa4df4de4 expref: 36 pid: 6605 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783441511.899808:0:6605:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff91a87da47200/0xa2426164df2c7b72 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.13@tcp remote: 0x633a354aa4df4de4 expref: 35 pid: 6605 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783441511.899816:0:6605:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff91a8429bdf00) 00010000:00010000:1.0:1783441511.899818:0:6605:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:1.0:1783441511.899821:0:6605:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91a87da47200, rc 0) 00000100:00100000:1.0:1783441511.899850:0:6605:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a875364a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:65454767-383a-4679-a788-eba05c6e0989+35:10320:x1870073673319168:12345-192.168.201.13@tcp:101:dd.0 Request processed in 15620us (15882us total) trans 4294967333 rc 0/0 00000100:00100000:1.0:1783441511.899858:0:6605:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.13@tcp, seq: 51 00000100:00100000:0.0:1783441511.905125:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.13@tcp (source: 12345-192.168.201.13@tcp) 00000100:00100000:1.0:1783441511.908320:0:5787:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073673319552 00000100:00100000:1.0:1783441511.908338:0:5787:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073673319552 00000100:00100000:1.0:1783441511.908416:0:5787:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.13@tcp, seq: 52 00000100:00100000:1.0:1783441511.908426:0:5787:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a8749a6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:65454767-383a-4679-a788-eba05c6e0989+35:10320:x1870073673319552:12345-192.168.201.13@tcp:36:dd.0 00010000:00010000:1.0:1783441511.908714:0:5787:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff91a87da46600/0xa2426164df2c7b80 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783441511.908730:0:5787:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91a87da46600/0xa2426164df2c7b80 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783441511.908772:0:5787:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91a87da46600/0xa2426164df2c7b80 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1783441511.908847:0:5787:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967334 00000004:00010000:1.0:1783441511.908873:0:5787:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 000000005e0cffc6 reply state 000000002b9cc384 transno 4294967335 ns: mdt-lustre-MDT0000_UUID lock: ffff91a87da46600/0xa2426164df2c7b80 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783441511.908881:0:5787:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1783441511.908985:0:5787:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a8749a6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:65454767-383a-4679-a788-eba05c6e0989+38:10320:x1870073673319552:12345-192.168.201.13@tcp:36:dd.0 Request processed in 559us (3870us total) trans 4294967335 rc 0/0 00000100:00100000:1.0:1783441511.908993:0:5787:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.13@tcp, seq: 52 00000020:00080000:1.0:1783441511.908998:0:5787:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:1.0:1783441511.917416:0:3290:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff91a87da46600/0xa2426164df2c7b80 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783441511.917437:0:3290:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff91a87da46600/0xa2426164df2c7b80 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783441511.917445:0:3290:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff91a87da46600/0xa2426164df2c7b80 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783441511.917451:0:3290:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91a87da46600 already unused, calling callback (ffffffffc1f9b4f0) 00010000:00010000:1.0:1783441511.917456:0:3290:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91a87da46600/0xa2426164df2c7b80 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783441511.917465:0:3290:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91a87da46600/0xa2426164df2c7b80 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783441511.917485:0:3290:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff91a8429bdf00) 00010000:00010000:1.0:1783441511.917488:0:3290:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1783441511.917493:0:3290:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff91a87da46600/0xa2426164df2c7b80 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783441511.917499:0:3290:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91a87da46600/0xa2426164df2c7b80 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783441512.335405:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.13@tcp (source: 12345-192.168.201.13@tcp) 00000100:00100000:3.0:1783441512.335509:0:5785:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073673319680 00000100:00100000:3.0:1783441512.335519:0:5785:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073673319680 00000100:00100000:3.0:1783441512.335665:0:5785:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.13@tcp, seq: 53 00000100:00100000:3.0:1783441512.335676:0:5785:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a8749a7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:65454767-383a-4679-a788-eba05c6e0989+37:10334:x1870073673319680:12345-192.168.201.13@tcp:101:stat.0 00010000:00010000:3.0:1783441512.335702:0:5785:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1783441512.335724:0:5785:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91a841477200/0xa2426164df2c7b87 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x633a354aa4df4deb expref: -99 pid: 5785 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783441512.335814:0:5785:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff91a841477e00/0xa2426164df2c7b8e lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783441512.335829:0:5785:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91a841477e00/0xa2426164df2c7b8e lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783441512.335842:0:5785:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91a841477e00/0xa2426164df2c7b8e lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783441512.335869:0:5785:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff91a841476e00/0xa2426164df2c7b95 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783441512.335876:0:5785:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91a841476e00/0xa2426164df2c7b95 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783441512.335883:0:5785:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91a841476e00/0xa2426164df2c7b95 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00080000:0.0:1783441512.336127:0:5781:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:3.0:1783441512.336344:0:5785:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff91a841476800/0xa2426164df2c7b9c lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783441512.336357:0:5785:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff91a87da47200/0xa2426164df2c7b72 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.13@tcp remote: 0x633a354aa4df4de4 expref: 38 pid: 6605 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783441512.336365:0:5785:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff91a841476800/0xa2426164df2c7b9c lrc: 4/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783441512.336401:0:5785:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff91a87da47200/0xa2426164df2c7b72 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.13@tcp remote: 0x633a354aa4df4de4 expref: 38 pid: 6605 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783441512.336415:0:5785:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff91a87da47200/0xa2426164df2c7b72 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.13@tcp remote: 0x633a354aa4df4de4 expref: 38 pid: 6605 timeout: 450 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783441512.336431:0:5785:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff91a87da68700 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5785:1870073693275776:192.168.201.13@tcp:104: 00000100:00100000:3.0:1783441512.336649:0:5785:0:(client.c:2702:ptlrpc_set_wait()) set ffff91a8504a3480 going to sleep for 11 seconds 00000100:00100000:0.0:1783441512.354518:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.13@tcp (source: 12345-192.168.201.13@tcp) 00000100:00100000:2.0:1783441512.354681:0:5789:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073673319936 00000100:00100000:2.0:1783441512.354692:0:5789:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073673319936 00000100:00100000:2.0:1783441512.354786:0:5789:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.13@tcp, seq: 13 00000100:00100000:2.0:1783441512.354797:0:5789:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a8749a5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:65454767-383a-4679-a788-eba05c6e0989+39:5569:x1870073673319936:12345-192.168.201.13@tcp:35:ldlm_bl.0 00000100:00100000:2.0:1783441512.355180:0:5789:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a8749a5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:65454767-383a-4679-a788-eba05c6e0989+40:5569:x1870073673319936:12345-192.168.201.13@tcp:35:ldlm_bl.0 Request processed in 384us (678us total) trans 4294967336 rc 0/0 00000100:00100000:2.0:1783441512.355187:0:5789:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.13@tcp, seq: 13 00000100:00100000:3.0:1783441512.356736:0:5785:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff91a87da68700 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5785:1870073693275776:192.168.201.13@tcp:104: 00010000:00010000:3.0:1783441512.356793:0:5785:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff91a841476800/0xa2426164df2c7b9c lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783441512.359138:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.13@tcp (source: 12345-192.168.201.13@tcp) 00000100:00100000:3.0:1783441512.359334:0:5769:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073673320064 00000100:00100000:3.0:1783441512.359344:0:5769:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073673320064 00010000:00010000:3.0:1783441512.359391:0:5769:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff91a87da47200/0xa2426164df2c7b72 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.13@tcp remote: 0x633a354aa4df4de4 expref: 40 pid: 6605 timeout: 450 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783441512.359489:0:5769:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.13@tcp, seq: 39 00000100:00100000:3.0:1783441512.359500:0:5769:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a875365f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:65454767-383a-4679-a788-eba05c6e0989+40:2355:x1870073673320064:12345-192.168.201.13@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1783441512.359516:0:5769:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1783441512.359531:0:5769:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff91a87da47200/0xa2426164df2c7b72 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.13@tcp remote: 0x633a354aa4df4de4 expref: 40 pid: 6605 timeout: 450 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783441512.359543:0:5769:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff91a87da47200/0xa2426164df2c7b72 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.13@tcp remote: 0x633a354aa4df4de4 expref: 40 pid: 6605 timeout: 450 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783441512.359565:0:5769:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91a87da47200/0xa2426164df2c7b72 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.13@tcp remote: 0x633a354aa4df4de4 expref: 40 pid: 6605 timeout: 450 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783441512.359586:0:5769:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff91a8429bdf00) 00010000:00010000:3.0:1783441512.359591:0:5769:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff91a841476800/0xa2426164df2c7b9c lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783441512.359601:0:5769:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff91a841476800/0xa2426164df2c7b9c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783441512.359608:0:5769:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91a841476800/0xa2426164df2c7b9c lrc: 4/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783441512.359641:0:5769:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1783441512.359718:0:5769:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a875365f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:65454767-383a-4679-a788-eba05c6e0989+39:2355:x1870073673320064:12345-192.168.201.13@tcp:103:ldlm_bl.0 Request processed in 219us (592us total) trans 0 rc 0/0 00000100:00100000:3.0:1783441512.359724:0:5769:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.13@tcp, seq: 39 00010000:00010000:1.0:1783441512.359793:0:5785:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff91a841476800/0xa2426164df2c7b9c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783441512.359801:0:5785:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91a841476800/0xa2426164df2c7b9c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1783441512.359854:0:5785:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 0 00000004:00200000:1.0:1783441512.359859:0:5785:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:1.0:1783441512.359900:0:5785:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff91a841476800/0xa2426164df2c7b9c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783441512.359912:0:5785:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91a841476800/0xa2426164df2c7b9c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783441512.359922:0:5785:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff91a841477e00/0xa2426164df2c7b8e lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783441512.359927:0:5785:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff91a841477e00/0xa2426164df2c7b8e lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783441512.359943:0:5785:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff91a841477e00/0xa2426164df2c7b8e lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783441512.359950:0:5785:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91a841477e00 already unused, calling callback (ffffffffc1f9b4f0) 00010000:00010000:1.0:1783441512.359961:0:5785:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91a841477e00/0xa2426164df2c7b8e lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783441512.359970:0:5785:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91a841477e00/0xa2426164df2c7b8e lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783441512.359980:0:5785:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff91a8439b0300) 00010000:00010000:1.0:1783441512.359989:0:5785:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1783441512.359994:0:5785:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff91a841477e00/0xa2426164df2c7b8e lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783441512.360000:0:5785:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91a841477e00/0xa2426164df2c7b8e lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783441512.360022:0:5785:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff91a841476e00/0xa2426164df2c7b95 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783441512.360041:0:5785:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff91a841476e00/0xa2426164df2c7b95 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783441512.360047:0:5785:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff91a841476e00/0xa2426164df2c7b95 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783441512.360052:0:5785:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91a841476e00 already unused, calling callback (ffffffffc1f9b4f0) 00010000:00010000:1.0:1783441512.360055:0:5785:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91a841476e00/0xa2426164df2c7b95 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783441512.360061:0:5785:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91a841476e00/0xa2426164df2c7b95 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783441512.360069:0:5785:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff91a85faeeb00) 00010000:00010000:1.0:1783441512.360071:0:5785:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1783441512.360074:0:5785:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff91a841476e00/0xa2426164df2c7b95 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783441512.360078:0:5785:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91a841476e00/0xa2426164df2c7b95 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783441512.360115:0:5785:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91a841477200/0xa2426164df2c7b87 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.13@tcp remote: 0x633a354aa4df4deb expref: 39 pid: 5785 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783441512.360148:0:5785:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff91a841476800/0xa2426164df2c7b9c lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.13@tcp remote: 0x633a354aa4df4deb expref: 38 pid: 5785 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783441512.360155:0:5785:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff91a8429bdf00) 00010000:00010000:1.0:1783441512.360157:0:5785:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1783441512.360160:0:5785:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91a841476800, rc 0) 00000100:00100000:1.0:1783441512.360187:0:5785:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a8749a7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:65454767-383a-4679-a788-eba05c6e0989+38:10334:x1870073673319680:12345-192.168.201.13@tcp:101:stat.0 Request processed in 24514us (24794us total) trans 0 rc 0/0 00000100:00100000:1.0:1783441512.360193:0:5785:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.13@tcp, seq: 53 00000100:00100000:0.0:1783441512.506935:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.13@tcp (source: 12345-192.168.201.13@tcp) 00000100:00100000:1.0:1783441512.507050:0:5787:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073673320320 00000100:00100000:1.0:1783441512.507062:0:5787:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073673320320 00000100:00100000:1.0:1783441512.507129:0:5787:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.13@tcp, seq: 54 00000100:00100000:1.0:1783441512.507139:0:5787:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a8749a4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:65454767-383a-4679-a788-eba05c6e0989+38:10340:x1870073673320320:12345-192.168.201.13@tcp:36:truncate.0 00010000:00010000:1.0:1783441512.507199:0:5787:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1783441512.507235:0:5787:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91a841476800/0xa2426164df2c7b9c lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.13@tcp remote: 0x633a354aa4df4deb expref: 38 pid: 5785 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783441512.507254:0:5787:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff91a8429bdf00) 00010000:00010000:1.0:1783441512.507259:0:5787:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1783441512.507518:0:5787:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff91a87da46600/0xa2426164df2c7ba3 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783441512.507548:0:5787:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91a87da46600/0xa2426164df2c7ba3 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783441512.507558:0:5787:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91a87da46600/0xa2426164df2c7ba3 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1783441512.507622:0:5787:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967337 00000004:00010000:1.0:1783441512.507648:0:5787:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000b27131bc reply state 000000004ce71791 transno 4294967338 ns: mdt-lustre-MDT0000_UUID lock: ffff91a87da46600/0xa2426164df2c7ba3 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783441512.507657:0:5787:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1783441512.507831:0:5787:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a8749a4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:65454767-383a-4679-a788-eba05c6e0989+40:10340:x1870073673320320:12345-192.168.201.13@tcp:36:truncate.0 Request processed in 692us (905us total) trans 4294967338 rc 0/0 00000100:00100000:1.0:1783441512.507839:0:5787:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.13@tcp, seq: 54 00000020:00080000:1.0:1783441512.507844:0:5787:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:3.0:1783441512.526813:0:3289:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff91a87da46600/0xa2426164df2c7ba3 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783441512.526832:0:3289:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff91a87da46600/0xa2426164df2c7ba3 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783441512.526840:0:3289:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff91a87da46600/0xa2426164df2c7ba3 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783441512.526846:0:3289:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91a87da46600 already unused, calling callback (ffffffffc1f9b4f0) 00010000:00010000:3.0:1783441512.526851:0:3289:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91a87da46600/0xa2426164df2c7ba3 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783441512.526859:0:3289:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91a87da46600/0xa2426164df2c7ba3 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783441512.526877:0:3289:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff91a8429bdf00) 00010000:00010000:3.0:1783441512.526880:0:3289:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1783441512.526885:0:3289:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff91a87da46600/0xa2426164df2c7ba3 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783441512.526891:0:3289:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91a87da46600/0xa2426164df2c7ba3 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783441512.556895:0:5773:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1783441512.720653:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.13@tcp (source: 12345-192.168.201.13@tcp) 00000100:00100000:1.0:1783441512.720885:0:6605:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073673320448 00000100:00100000:1.0:1783441512.720896:0:6605:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073673320448 00000100:00100000:1.0:1783441512.720979:0:6605:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.13@tcp, seq: 55 00000100:00100000:1.0:1783441512.720990:0:6605:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a8749a4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:65454767-383a-4679-a788-eba05c6e0989+39:10354:x1870073673320448:12345-192.168.201.13@tcp:101:stat.0 00010000:00010000:1.0:1783441512.721027:0:6605:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1783441512.721051:0:6605:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91a87da46200/0xa2426164df2c7baa lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x633a354aa4df4df2 expref: -99 pid: 6605 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783441512.721120:0:6605:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff91a87da46600/0xa2426164df2c7bb1 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6605 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783441512.721135:0:6605:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91a87da46600/0xa2426164df2c7bb1 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6605 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783441512.721146:0:6605:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91a87da46600/0xa2426164df2c7bb1 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6605 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783441512.721161:0:6605:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff91a87da47200/0xa2426164df2c7bb8 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6605 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783441512.721188:0:6605:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91a87da47200/0xa2426164df2c7bb8 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6605 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783441512.721196:0:6605:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91a87da47200/0xa2426164df2c7bb8 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6605 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783441512.721313:0:6605:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff91a87da47e00/0xa2426164df2c7bbf lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6605 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783441512.721322:0:6605:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91a87da47e00/0xa2426164df2c7bbf lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6605 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783441512.721329:0:6605:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91a87da47e00/0xa2426164df2c7bbf lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6605 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1783441512.721367:0:6605:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 1234567 00000004:00200000:1.0:1783441512.721371:0:6605:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:1.0:1783441512.721394:0:6605:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff91a87da47e00/0xa2426164df2c7bbf lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6605 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783441512.721407:0:6605:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91a87da47e00/0xa2426164df2c7bbf lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6605 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783441512.721416:0:6605:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff91a87da46600/0xa2426164df2c7bb1 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6605 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783441512.721422:0:6605:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff91a87da46600/0xa2426164df2c7bb1 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6605 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783441512.721428:0:6605:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff91a87da46600/0xa2426164df2c7bb1 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6605 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783441512.721442:0:6605:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91a87da46600 already unused, calling callback (ffffffffc1f9b4f0) 00010000:00010000:1.0:1783441512.721446:0:6605:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91a87da46600/0xa2426164df2c7bb1 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6605 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783441512.721454:0:6605:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91a87da46600/0xa2426164df2c7bb1 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6605 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783441512.721467:0:6605:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff91a8439b0300) 00010000:00010000:1.0:1783441512.721470:0:6605:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1783441512.721474:0:6605:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff91a87da46600/0xa2426164df2c7bb1 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6605 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783441512.721481:0:6605:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91a87da46600/0xa2426164df2c7bb1 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6605 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783441512.721498:0:6605:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff91a87da47200/0xa2426164df2c7bb8 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6605 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783441512.721519:0:6605:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff91a87da47200/0xa2426164df2c7bb8 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6605 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783441512.721526:0:6605:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff91a87da47200/0xa2426164df2c7bb8 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6605 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783441512.721531:0:6605:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91a87da47200 already unused, calling callback (ffffffffc1f9b4f0) 00010000:00010000:1.0:1783441512.721534:0:6605:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91a87da47200/0xa2426164df2c7bb8 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6605 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783441512.721540:0:6605:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91a87da47200/0xa2426164df2c7bb8 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6605 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783441512.721559:0:6605:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff91a858b90f00) 00010000:00010000:1.0:1783441512.721562:0:6605:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1783441512.721575:0:6605:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff91a87da47200/0xa2426164df2c7bb8 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6605 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783441512.721581:0:6605:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91a87da47200/0xa2426164df2c7bb8 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6605 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783441512.721621:0:6605:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91a87da46200/0xa2426164df2c7baa lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.13@tcp remote: 0x633a354aa4df4df2 expref: 41 pid: 6605 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783441512.721634:0:6605:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff91a87da47e00/0xa2426164df2c7bbf lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.13@tcp remote: 0x633a354aa4df4df2 expref: 40 pid: 6605 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783441512.721642:0:6605:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff91a8429bdf00) 00010000:00010000:1.0:1783441512.721644:0:6605:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1783441512.721646:0:6605:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91a87da47e00, rc 0) 00000100:00100000:1.0:1783441512.721720:0:6605:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a8749a4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:65454767-383a-4679-a788-eba05c6e0989+40:10354:x1870073673320448:12345-192.168.201.13@tcp:101:stat.0 Request processed in 732us (1081us total) trans 0 rc 0/0 00000100:00100000:1.0:1783441512.721729:0:6605:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.13@tcp, seq: 55 00000100:00100000:3.0:1783441512.813151:0:3306:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff91a87da69880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3306:1870073693276160:0@lo:400:kworker.0 00000100:00100000:2.0:1783441512.813313:0:3305:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff91a87da6b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3305:1870073693276032:0@lo:400:kworker.0 00000100:00100000:3.0:1783441512.813364:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783441512.813416:0:3304:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff91a87da68700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:6c1ddb50-5795-40c6-a2b6-8f58add9da62:3304:1870073693275904:0@lo:400:kworker.0 00000100:00100000:1.0:1783441512.813469:0:3303:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff91a87da69500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3303:1870073693276288:0@lo:400:kworker.0 00000100:00100000:2.0:1783441512.818415:0:5787:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073693276160 00000100:00100000:2.0:1783441512.818430:0:5787:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073693276160 00000100:00100000:2.0:1783441512.818518:0:5787:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 145 00000100:00100000:2.0:1783441512.818527:0:5787:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a87da68000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3306:x1870073693276160:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1783441512.818664:0:5787:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a87da68000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3306:x1870073693276160:12345-0@lo:400:kworker.0 Request processed in 138us (5300us total) trans 0 rc 0/0 00000100:00100000:2.0:1783441512.818671:0:5787:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 145 00000100:00080000:2.0:1783441512.818714:0:5781:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1783441512.819596:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783441512.819652:0:6605:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073693276032 00000100:00100000:2.0:1783441512.819659:0:6605:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073693276032 00000100:00100000:2.0:1783441512.819696:0:6605:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 146 00000100:00100000:2.0:1783441512.819705:0:6605:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a875364700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3305:x1870073693276032:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1783441512.819779:0:6605:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a875364700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3305:x1870073693276032:12345-0@lo:400:kworker.0 Request processed in 75us (187us total) trans 0 rc 0/0 00000100:00100000:2.0:1783441512.819787:0:6605:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 146 00000100:00100000:3.0:1783441512.819914:0:3306:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff91a87da69880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3306:1870073693276160:0@lo:400:kworker.0 00000100:00100000:2.0:1783441512.820069:0:3305:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff91a87da6b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3305:1870073693276032:0@lo:400:kworker.0 00000100:00100000:2.0:1783441512.820080:0:3305:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff91a87da6a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3305:1870073693276544:0@lo:400:kworker.0 00000100:00100000:2.0:1783441512.820113:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783441512.820158:0:6582:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073693276544 00000100:00100000:2.0:1783441512.820162:0:6582:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073693276544 00000100:00100000:2.0:1783441512.820190:0:6582:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 79 00000100:00100000:2.0:1783441512.820196:0:6582:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a875365c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:3305:x1870073693276544:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1783441512.820251:0:6582:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a875365c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:3305:x1870073693276544:12345-0@lo:400:kworker.0 Request processed in 55us (137us total) trans 0 rc 0/0 00000100:00100000:2.0:1783441512.820257:0:6582:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 79 00000100:00100000:2.0:1783441512.820301:0:3305:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff91a87da6a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3305:1870073693276544:0@lo:400:kworker.0 00000100:00100000:0.0:1783441512.820714:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783441512.820753:0:3304:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff91a87da68380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3304:1870073693276416:0@lo:400:kworker.0 00000100:00100000:0.0:1783441512.820778:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783441512.821354:0:5780:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073693275904 00000100:00100000:2.0:1783441512.821360:0:5780:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073693275904 00000100:00100000:2.0:1783441512.821403:0:5780:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 288 00000100:00100000:2.0:1783441512.821412:0:5780:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a848f72050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6c1ddb50-5795-40c6-a2b6-8f58add9da62+19:3304:x1870073693275904:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1783441512.821467:0:5780:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a848f72050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6c1ddb50-5795-40c6-a2b6-8f58add9da62+19:3304:x1870073693275904:12345-0@lo:400:kworker.0 Request processed in 56us (753us total) trans 0 rc 0/0 00000100:00100000:2.0:1783441512.821474:0:5780:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 288 00000100:00100000:2.0:1783441512.821504:0:5787:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073693276416 00000100:00100000:2.0:1783441512.821508:0:5787:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073693276416 00000100:00080000:2.0:1783441512.821531:0:5781:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1783441512.821559:0:5786:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 147 00000100:00100000:2.0:1783441512.821578:0:5786:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a8749a7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3304:x1870073693276416:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1783441512.821611:0:5786:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a8749a7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3304:x1870073693276416:12345-0@lo:400:kworker.0 Request processed in 36us (832us total) trans 0 rc 0/0 00000100:00100000:2.0:1783441512.821617:0:5786:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 147 00000100:00100000:0.0:1783441512.821770:0:3304:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff91a87da68700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:6c1ddb50-5795-40c6-a2b6-8f58add9da62:3304:1870073693275904:0@lo:400:kworker.0 00000100:00100000:0.0:1783441512.821785:0:3304:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff91a87da68380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3304:1870073693276416:0@lo:400:kworker.0 00000100:00100000:1.0:1783441512.823779:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783441512.824542:0:6583:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073693276288 00000100:00100000:0.0:1783441512.824552:0:6583:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073693276288 00000100:00100000:0.0:1783441512.824651:0:6583:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 80 00000100:00100000:0.0:1783441512.824662:0:6583:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a87531c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3303:x1870073693276288:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1783441512.824827:0:6583:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a87531c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3303:x1870073693276288:12345-0@lo:400:kworker.0 Request processed in 168us (1055us total) trans 0 rc 0/0 00000100:00100000:0.0:1783441512.824834:0:6583:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 80 00000100:00080000:2.0:1783441512.824975:0:5781:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1783441512.825236:0:3303:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff91a87da69500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3303:1870073693276288:0@lo:400:kworker.0 00000100:00100000:2.0:1783441512.864880:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.13@tcp (source: 12345-192.168.201.13@tcp) 00000100:00100000:1.0:1783441512.865048:0:6605:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073673320704 00000100:00100000:1.0:1783441512.865059:0:6605:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073673320704 00000100:00100000:1.0:1783441512.865122:0:6605:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.13@tcp, seq: 56 00000100:00100000:1.0:1783441512.865133:0:6605:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a875367100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:65454767-383a-4679-a788-eba05c6e0989+40:10364:x1870073673320704:12345-192.168.201.13@tcp:101:lfs.0 00010000:00010000:1.0:1783441512.865155:0:6605:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1783441512.865195:0:6605:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91a87da46200/0xa2426164df2c7bc6 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x633a354aa4df4df9 expref: -99 pid: 6605 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1783441512.865484:0:6605:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x3:0x0]: returning size 512 00010000:00010000:1.0:1783441512.865681:0:6605:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff91a87da46200/0xa2426164df2c7bc6 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.13@tcp remote: 0x633a354aa4df4df9 expref: 42 pid: 6605 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783441512.865699:0:6605:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff91a85faee700) 00010000:00010000:1.0:1783441512.865702:0:6605:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1783441512.865707:0:6605:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91a87da46200/0xa2426164df2c7bc6 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.13@tcp remote: 0x633a354aa4df4df9 expref: 42 pid: 6605 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783441512.865725:0:6605:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91a87da46200, rc 0) 00000100:00100000:1.0:1783441512.865885:0:6605:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a875367100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:65454767-383a-4679-a788-eba05c6e0989+41:10364:x1870073673320704:12345-192.168.201.13@tcp:101:lfs.0 Request processed in 754us (1015us total) trans 4294967339 rc 301/301 00000100:00100000:1.0:1783441512.865893:0:6605:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.13@tcp, seq: 56 00000100:00100000:3.0:1783441512.879667:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.13@tcp (source: 12345-192.168.201.13@tcp) 00000100:00100000:0.0:1783441512.879872:0:5789:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073673320960 00000100:00100000:0.0:1783441512.879882:0:5789:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073673320960 00000100:00100000:0.0:1783441512.879953:0:5789:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.13@tcp, seq: 14 00000100:00100000:0.0:1783441512.879964:0:5789:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a87da69500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:65454767-383a-4679-a788-eba05c6e0989+41:10364:x1870073673320960:12345-192.168.201.13@tcp:35:lfs.0 00000100:00100000:0.0:1783441512.880387:0:5789:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a87da69500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:65454767-383a-4679-a788-eba05c6e0989+42:10364:x1870073673320960:12345-192.168.201.13@tcp:35:lfs.0 Request processed in 424us (727us total) trans 4294967340 rc 0/0 00000100:00100000:0.0:1783441512.880395:0:5789:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.13@tcp, seq: 14 00000100:00100000:3.0:1783441512.963910:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.13@tcp (source: 12345-192.168.201.13@tcp) 00000100:00100000:2.0:1783441512.965525:0:5786:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073673321216 00000100:00100000:2.0:1783441512.965539:0:5786:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073673321216 00000100:00100000:2.0:1783441512.965727:0:5786:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.13@tcp, seq: 57 00000100:00100000:2.0:1783441512.965738:0:5786:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a87da69880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:65454767-383a-4679-a788-eba05c6e0989+42:10370:x1870073673321216:12345-192.168.201.13@tcp:101:bash.0 00010000:00010000:2.0:1783441512.965777:0:5786:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1783441512.965799:0:5786:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91a85f83d600/0xa2426164df2c7bd4 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x633a354aa4df4e00 expref: -99 pid: 5786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783441512.965909:0:5786:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff91a85f83c400/0xa2426164df2c7bdb lrc: 3/0,1 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783441512.966456:0:5786:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff91a87da47e00/0xa2426164df2c7bbf lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.13@tcp remote: 0x633a354aa4df4df2 expref: 43 pid: 6605 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783441512.966465:0:5786:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff91a85f83c400/0xa2426164df2c7bdb lrc: 4/0,1 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783441512.966504:0:5786:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff91a87da47e00/0xa2426164df2c7bbf lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.13@tcp remote: 0x633a354aa4df4df2 expref: 43 pid: 6605 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783441512.966519:0:5786:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff91a87da47e00/0xa2426164df2c7bbf lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.13@tcp remote: 0x633a354aa4df4df2 expref: 43 pid: 6605 timeout: 450 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783441512.966535:0:5786:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff91a875364e00 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5786:1870073693276672:192.168.201.13@tcp:104: 00000100:00100000:2.0:1783441512.966847:0:5786:0:(client.c:2702:ptlrpc_set_wait()) set ffff91a8501c6d80 going to sleep for 11 seconds 00000100:00100000:3.0:1783441512.974094:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.13@tcp (source: 12345-192.168.201.13@tcp) 00000100:00100000:2.0:1783441512.974227:0:5786:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff91a875364e00 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5786:1870073693276672:192.168.201.13@tcp:104: 00010000:00010000:2.0:1783441512.974257:0:5786:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff91a85f83c400/0xa2426164df2c7bdb lrc: 3/0,1 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783441512.974447:0:5771:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073673321344 00000100:00100000:0.0:1783441512.974454:0:5771:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073673321344 00010000:00010000:0.0:1783441512.974495:0:5771:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff91a87da47e00/0xa2426164df2c7bbf lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.13@tcp remote: 0x633a354aa4df4df2 expref: 44 pid: 6605 timeout: 450 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783441512.974535:0:5771:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.13@tcp, seq: 40 00000100:00100000:0.0:1783441512.974544:0:5771:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a87da68380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:65454767-383a-4679-a788-eba05c6e0989+44:2355:x1870073673321344:12345-192.168.201.13@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1783441512.974559:0:5771:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1783441512.974577:0:5771:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff91a87da47e00/0xa2426164df2c7bbf lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.13@tcp remote: 0x633a354aa4df4df2 expref: 44 pid: 6605 timeout: 450 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783441512.974590:0:5771:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff91a87da47e00/0xa2426164df2c7bbf lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.13@tcp remote: 0x633a354aa4df4df2 expref: 44 pid: 6605 timeout: 450 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783441512.974610:0:5771:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91a87da47e00/0xa2426164df2c7bbf lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.13@tcp remote: 0x633a354aa4df4df2 expref: 44 pid: 6605 timeout: 450 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783441512.974642:0:5771:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff91a8429bdf00) 00010000:00010000:0.0:1783441512.974647:0:5771:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff91a85f83c400/0xa2426164df2c7bdb lrc: 3/0,1 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783441512.974657:0:5771:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff91a85f83c400/0xa2426164df2c7bdb lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783441512.974664:0:5771:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91a85f83c400/0xa2426164df2c7bdb lrc: 4/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783441512.974695:0:5771:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1783441512.974795:0:5771:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a87da68380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:65454767-383a-4679-a788-eba05c6e0989+43:2355:x1870073673321344:12345-192.168.201.13@tcp:103:ldlm_bl.0 Request processed in 251us (712us total) trans 0 rc 0/0 00000100:00100000:0.0:1783441512.974802:0:5771:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.13@tcp, seq: 40 00010000:00010000:2.0:1783441512.974881:0:5786:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff91a85f83c400/0xa2426164df2c7bdb lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783441512.974888:0:5786:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91a85f83c400/0xa2426164df2c7bdb lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1783441512.974907:0:5786:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 1234567 00010000:00010000:2.0:1783441512.975078:0:5786:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91a85f83d600/0xa2426164df2c7bd4 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.13@tcp remote: 0x633a354aa4df4e00 expref: 44 pid: 5786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783441512.975107:0:5786:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff91a85f83c400/0xa2426164df2c7bdb lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.13@tcp remote: 0x633a354aa4df4e00 expref: 43 pid: 5786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783441512.975114:0:5786:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff91a8429bdf00) 00010000:00010000:2.0:1783441512.975117:0:5786:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:2.0:1783441512.975119:0:5786:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91a85f83c400, rc 0) 00000100:00100000:2.0:1783441512.975146:0:5786:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a87da69880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:65454767-383a-4679-a788-eba05c6e0989+43:10370:x1870073673321216:12345-192.168.201.13@tcp:101:bash.0 Request processed in 9411us (11247us total) trans 4294967341 rc 0/0 00000100:00100000:2.0:1783441512.975152:0:5786:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.13@tcp, seq: 57 00000100:00100000:3.0:1783441512.981862:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.13@tcp (source: 12345-192.168.201.13@tcp) 00000100:00100000:1.0:1783441512.982276:0:6605:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073673321600 00000100:00100000:1.0:1783441512.982287:0:6605:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073673321600 00000100:00100000:1.0:1783441512.982364:0:6605:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.13@tcp, seq: 58 00000100:00100000:1.0:1783441512.982375:0:6605:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a87da68700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:65454767-383a-4679-a788-eba05c6e0989+43:10370:x1870073673321600:12345-192.168.201.13@tcp:36:bash.0 00010000:00010000:1.0:1783441512.982665:0:6605:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff91a87da47200/0xa2426164df2c7be9 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6605 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783441512.982682:0:6605:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91a87da47200/0xa2426164df2c7be9 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6605 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783441512.982693:0:6605:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91a87da47200/0xa2426164df2c7be9 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6605 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1783441512.982820:0:6605:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967342 00000004:00010000:1.0:1783441512.982844:0:6605:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 000000006d4e0fa8 reply state 00000000a9c9f408 transno 4294967343 ns: mdt-lustre-MDT0000_UUID lock: ffff91a87da47200/0xa2426164df2c7be9 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6605 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783441512.982852:0:6605:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1783441512.982951:0:6605:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a87da68700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:65454767-383a-4679-a788-eba05c6e0989+46:10370:x1870073673321600:12345-192.168.201.13@tcp:36:bash.0 Request processed in 577us (1097us total) trans 4294967343 rc 0/0 00000100:00100000:1.0:1783441512.982969:0:6605:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.13@tcp, seq: 58 00000020:00080000:1.0:1783441512.982975:0:6605:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:0.0:1783441512.985546:0:3290:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff91a87da47200/0xa2426164df2c7be9 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6605 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783441512.985631:0:3290:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff91a87da47200/0xa2426164df2c7be9 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6605 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783441512.985639:0:3290:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff91a87da47200/0xa2426164df2c7be9 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6605 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783441512.985646:0:3290:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91a87da47200 already unused, calling callback (ffffffffc1f9b4f0) 00010000:00010000:0.0:1783441512.985650:0:3290:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91a87da47200/0xa2426164df2c7be9 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6605 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783441512.985658:0:3290:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91a87da47200/0xa2426164df2c7be9 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6605 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783441512.985695:0:3290:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff91a8429bdf00) 00010000:00010000:0.0:1783441512.985698:0:3290:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1783441512.985704:0:3290:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff91a87da47200/0xa2426164df2c7be9 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6605 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783441512.985711:0:3290:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91a87da47200/0xa2426164df2c7be9 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6605 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783441512.990730:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.13@tcp (source: 12345-192.168.201.13@tcp) 00000100:00100000:0.0:1783441512.992369:0:5787:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073673321728 00000100:00100000:0.0:1783441512.992383:0:5787:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073673321728 00000100:00100000:1.0:1783441512.992771:0:5787:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.13@tcp, seq: 59 00000100:00100000:1.0:1783441512.992783:0:5787:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a87da6a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:65454767-383a-4679-a788-eba05c6e0989+45:10370:x1870073673321728:12345-192.168.201.13@tcp:101:bash.0 00010000:00010000:1.0:1783441512.992811:0:5787:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1783441512.992834:0:5787:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91a87da46600/0xa2426164df2c7bf0 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x633a354aa4df4e07 expref: -99 pid: 5787 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783441512.992921:0:5787:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff91a87da47000/0xa2426164df2c7bf7 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783441512.992949:0:5787:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff91a85f83c400/0xa2426164df2c7bdb lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.13@tcp remote: 0x633a354aa4df4e00 expref: 46 pid: 5786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783441512.992969:0:5787:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff91a87da47000/0xa2426164df2c7bf7 lrc: 4/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x8 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783441512.993025:0:5787:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff91a85f83c400/0xa2426164df2c7bdb lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.13@tcp remote: 0x633a354aa4df4e00 expref: 46 pid: 5786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783441512.993040:0:5787:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff91a85f83c400/0xa2426164df2c7bdb lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.13@tcp remote: 0x633a354aa4df4e00 expref: 46 pid: 5786 timeout: 450 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783441512.993070:0:5787:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff91a87531dc00 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5787:1870073693276800:192.168.201.13@tcp:104: 00000100:00100000:1.0:1783441512.993178:0:5787:0:(client.c:2702:ptlrpc_set_wait()) set ffff91a87563b9c0 going to sleep for 11 seconds 00000100:00100000:3.0:1783441512.997574:0:5787:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff91a87531dc00 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5787:1870073693276800:192.168.201.13@tcp:104: 00010000:00010000:3.0:1783441512.997610:0:5787:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff91a87da47000/0xa2426164df2c7bf7 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x8 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783441512.999995:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.13@tcp (source: 12345-192.168.201.13@tcp) 00000100:00100000:2.0:1783441513.000118:0:11514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073673321856 00000100:00100000:2.0:1783441513.000129:0:11514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073673321856 00010000:00010000:2.0:1783441513.000181:0:11514:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff91a85f83c400/0xa2426164df2c7bdb lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.13@tcp remote: 0x633a354aa4df4e00 expref: 47 pid: 5786 timeout: 450 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783441513.000239:0:11514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.13@tcp, seq: 41 00000100:00100000:2.0:1783441513.000250:0:11514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a87da6b100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:65454767-383a-4679-a788-eba05c6e0989+47:2355:x1870073673321856:12345-192.168.201.13@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1783441513.000265:0:11514:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1783441513.000272:0:11514:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff91a85f83c400/0xa2426164df2c7bdb lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.13@tcp remote: 0x633a354aa4df4e00 expref: 47 pid: 5786 timeout: 450 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783441513.000285:0:11514:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff91a85f83c400/0xa2426164df2c7bdb lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.13@tcp remote: 0x633a354aa4df4e00 expref: 47 pid: 5786 timeout: 450 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783441513.000306:0:11514:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91a85f83c400/0xa2426164df2c7bdb lrc: 0/0,0 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.13@tcp remote: 0x633a354aa4df4e00 expref: 47 pid: 5786 timeout: 450 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783441513.000341:0:11514:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff91a8429bdf00) 00010000:00010000:2.0:1783441513.000346:0:11514:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff91a87da47000/0xa2426164df2c7bf7 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x8 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783441513.000356:0:11514:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff91a87da47000/0xa2426164df2c7bf7 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783441513.000364:0:11514:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91a87da47000/0xa2426164df2c7bf7 lrc: 4/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783441513.000396:0:11514:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1783441513.000458:0:11514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a87da6b100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:65454767-383a-4679-a788-eba05c6e0989+46:2355:x1870073673321856:12345-192.168.201.13@tcp:103:ldlm_bl.0 Request processed in 209us (474us total) trans 0 rc 0/0 00000100:00100000:2.0:1783441513.000466:0:11514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.13@tcp, seq: 41 00010000:00010000:3.0:1783441513.001089:0:5787:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff91a87da47000/0xa2426164df2c7bf7 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783441513.001101:0:5787:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91a87da47000/0xa2426164df2c7bf7 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1783441513.001150:0:5787:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 0 00000004:00200000:3.0:1783441513.001154:0:5787:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:3.0:1783441513.001176:0:5787:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff91a87da47000/0xa2426164df2c7bf7 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783441513.001230:0:5787:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91a87da46600/0xa2426164df2c7bf0 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.13@tcp remote: 0x633a354aa4df4e07 expref: 46 pid: 5787 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783441513.001249:0:5787:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff91a87da47000/0xa2426164df2c7bf7 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.13@tcp remote: 0x633a354aa4df4e07 expref: 45 pid: 5787 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783441513.001258:0:5787:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff91a8429bdf00) 00010000:00010000:3.0:1783441513.001260:0:5787:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1783441513.001272:0:5787:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91a87da47000, rc 0) 00000100:00100000:3.0:1783441513.001317:0:5787:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a87da6a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:65454767-383a-4679-a788-eba05c6e0989+45:10370:x1870073673321728:12345-192.168.201.13@tcp:101:bash.0 Request processed in 8536us (10599us total) trans 0 rc 0/0 00000100:00100000:3.0:1783441513.001326:0:5787:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.13@tcp, seq: 59 00000100:00100000:3.0:1783441513.008081:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.13@tcp (source: 12345-192.168.201.13@tcp) 00000100:00100000:0.0:1783441513.008239:0:5789:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073673322112 00000100:00100000:0.0:1783441513.008252:0:5789:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073673322112 00000100:00100000:0.0:1783441513.008323:0:5789:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.13@tcp, seq: 15 00000100:00100000:0.0:1783441513.008333:0:5789:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a8468a9850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:65454767-383a-4679-a788-eba05c6e0989+45:10370:x1870073673322112:12345-192.168.201.13@tcp:35:bash.0 00000100:00100000:0.0:1783441513.008599:0:5789:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a8468a9850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:65454767-383a-4679-a788-eba05c6e0989+46:10370:x1870073673322112:12345-192.168.201.13@tcp:35:bash.0 Request processed in 266us (527us total) trans 4294967344 rc 0/0 00000100:00100000:0.0:1783441513.008608:0:5789:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.13@tcp, seq: 15 00000100:00100000:1.0:1783441513.106309:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.13@tcp (source: 12345-192.168.201.13@tcp) 00000100:00100000:2.0:1783441513.106444:0:6605:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073673322368 00000100:00100000:2.0:1783441513.106454:0:6605:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073673322368 00000100:00100000:2.0:1783441513.106527:0:6605:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.13@tcp, seq: 60 00000100:00100000:2.0:1783441513.106537:0:6605:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a87531dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:65454767-383a-4679-a788-eba05c6e0989+46:10380:x1870073673322368:12345-192.168.201.13@tcp:101:lfs.0 00010000:00010000:2.0:1783441513.106565:0:6605:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1783441513.106592:0:6605:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91a85f83c400/0xa2426164df2c7bfe lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x633a354aa4df4e0e expref: -99 pid: 6605 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1783441513.106725:0:6605:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x3:0x0]: returning size 512 00010000:00010000:2.0:1783441513.106884:0:6605:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff91a85f83c400/0xa2426164df2c7bfe lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.13@tcp remote: 0x633a354aa4df4e0e expref: 48 pid: 6605 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783441513.106895:0:6605:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff91a85faee700) 00010000:00010000:2.0:1783441513.106910:0:6605:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1783441513.106915:0:6605:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91a85f83c400/0xa2426164df2c7bfe lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.13@tcp remote: 0x633a354aa4df4e0e expref: 48 pid: 6605 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783441513.106929:0:6605:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91a85f83c400, rc 0) 00000100:00100000:2.0:1783441513.107241:0:6605:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a87531dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:65454767-383a-4679-a788-eba05c6e0989+47:10380:x1870073673322368:12345-192.168.201.13@tcp:101:lfs.0 Request processed in 705us (939us total) trans 4294967345 rc 301/301 00000100:00100000:2.0:1783441513.107247:0:6605:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.13@tcp, seq: 60 00000100:00100000:3.0:1783441513.121590:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.13@tcp (source: 12345-192.168.201.13@tcp) 00000100:00100000:2.0:1783441513.121683:0:5786:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073673322496 00000100:00100000:2.0:1783441513.121693:0:5786:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073673322496 00000100:00100000:2.0:1783441513.121775:0:5786:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.13@tcp, seq: 61 00000100:00100000:2.0:1783441513.121784:0:5786:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a87da69c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:65454767-383a-4679-a788-eba05c6e0989+47:10380:x1870073673322496:12345-192.168.201.13@tcp:34:lfs.0 00010000:00010000:2.0:1783441513.121855:0:5786:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff91a85f83c400/0xa2426164df2c7c0c lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783441513.121870:0:5786:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91a85f83c400/0xa2426164df2c7c0c lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783441513.121881:0:5786:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91a85f83c400/0xa2426164df2c7c0c lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783441513.121896:0:5786:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff91a85f83d600/0xa2426164df2c7c13 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783441513.121903:0:5786:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91a85f83d600/0xa2426164df2c7c13 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783441513.121909:0:5786:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91a85f83d600/0xa2426164df2c7c13 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783441513.122219:0:5786:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff91a85f83c000/0xa2426164df2c7c1a lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783441513.122241:0:5786:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91a85f83c000/0xa2426164df2c7c1a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783441513.122249:0:5786:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91a85f83c000/0xa2426164df2c7c1a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1783441513.122354:0:5786:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff91a85f83c000/0xa2426164df2c7c1a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783441513.122367:0:5786:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff91a85f83c400/0xa2426164df2c7c0c lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783441513.122374:0:5786:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff91a85f83c400/0xa2426164df2c7c0c lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783441513.122381:0:5786:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff91a85f83c400/0xa2426164df2c7c0c lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783441513.122386:0:5786:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91a85f83c400 already unused, calling callback (ffffffffc1f9b4f0) 00010000:00010000:2.0:1783441513.122390:0:5786:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91a85f83c400/0xa2426164df2c7c0c lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783441513.122397:0:5786:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91a85f83c400/0xa2426164df2c7c0c lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783441513.122408:0:5786:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff91a8439b0300) 00010000:00010000:2.0:1783441513.122411:0:5786:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1783441513.122415:0:5786:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff91a85f83c400/0xa2426164df2c7c0c lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783441513.122421:0:5786:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91a85f83c400/0xa2426164df2c7c0c lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783441513.122439:0:5786:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff91a85f83d600/0xa2426164df2c7c13 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783441513.122445:0:5786:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff91a85f83d600/0xa2426164df2c7c13 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783441513.122451:0:5786:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff91a85f83d600/0xa2426164df2c7c13 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783441513.122456:0:5786:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91a85f83d600 already unused, calling callback (ffffffffc1f9b4f0) 00010000:00010000:2.0:1783441513.122459:0:5786:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91a85f83d600/0xa2426164df2c7c13 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783441513.122464:0:5786:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91a85f83d600/0xa2426164df2c7c13 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783441513.122471:0:5786:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff91a8429bd000) 00010000:00010000:2.0:1783441513.122473:0:5786:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1783441513.122475:0:5786:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff91a85f83d600/0xa2426164df2c7c13 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783441513.122481:0:5786:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91a85f83d600/0xa2426164df2c7c13 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783441513.122492:0:5786:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff91a85f83c000/0xa2426164df2c7c1a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783441513.122498:0:5786:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff91a85f83c000/0xa2426164df2c7c1a lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783441513.122504:0:5786:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff91a85f83c000/0xa2426164df2c7c1a lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783441513.122512:0:5786:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91a85f83c000 already unused, calling callback (ffffffffc1f9b4f0) 00010000:00010000:2.0:1783441513.122515:0:5786:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91a85f83c000/0xa2426164df2c7c1a lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783441513.122521:0:5786:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91a85f83c000/0xa2426164df2c7c1a lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783441513.122527:0:5786:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff91a8429bdf00) 00010000:00010000:2.0:1783441513.122529:0:5786:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1783441513.122532:0:5786:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff91a85f83c000/0xa2426164df2c7c1a lrc: 2/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783441513.122537:0:5786:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91a85f83c000/0xa2426164df2c7c1a lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783441513.122614:0:5786:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a87da69c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:65454767-383a-4679-a788-eba05c6e0989+47:10380:x1870073673322496:12345-192.168.201.13@tcp:34:lfs.0 Request processed in 829us (1033us total) trans 0 rc 0/0 00000100:00100000:2.0:1783441513.122622:0:5786:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.13@tcp, seq: 61 00000100:00100000:1.0:1783441513.127530:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.13@tcp (source: 12345-192.168.201.13@tcp) 00000100:00100000:0.0:1783441513.127676:0:5789:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073673322752 00000100:00100000:0.0:1783441513.127687:0:5789:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073673322752 00000100:00100000:0.0:1783441513.127770:0:5789:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.13@tcp, seq: 16 00000100:00100000:0.0:1783441513.127782:0:5789:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a87531d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:65454767-383a-4679-a788-eba05c6e0989+47:10380:x1870073673322752:12345-192.168.201.13@tcp:35:lfs.0 00000100:00100000:0.0:1783441513.128073:0:5789:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a87531d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:65454767-383a-4679-a788-eba05c6e0989+48:10380:x1870073673322752:12345-192.168.201.13@tcp:35:lfs.0 Request processed in 293us (565us total) trans 4294967346 rc 0/0 00000100:00100000:0.0:1783441513.128081:0:5789:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.13@tcp, seq: 16 00000100:00100000:1.0:1783441513.179849:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.13@tcp (source: 12345-192.168.201.13@tcp) 00000100:00100000:3.0:1783441513.179943:0:5785:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073673323008 00000100:00100000:3.0:1783441513.179953:0:5785:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073673323008 00000100:00100000:3.0:1783441513.180190:0:5785:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.13@tcp, seq: 62 00000100:00100000:3.0:1783441513.180201:0:5785:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a87d7c7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:65454767-383a-4679-a788-eba05c6e0989+48:10383:x1870073673323008:12345-192.168.201.13@tcp:101:lfs.0 00010000:00010000:3.0:1783441513.180230:0:5785:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1783441513.180253:0:5785:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91a841477c00/0xa2426164df2c7c21 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x633a354aa4df4e15 expref: -99 pid: 5785 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783441513.180336:0:5785:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff91a841476800/0xa2426164df2c7c28 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783441513.180349:0:5785:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91a841476800/0xa2426164df2c7c28 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783441513.180361:0:5785:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91a841476800/0xa2426164df2c7c28 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783441513.180375:0:5785:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff91a841477200/0xa2426164df2c7c2f lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783441513.180381:0:5785:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91a841477200/0xa2426164df2c7c2f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783441513.180387:0:5785:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91a841477200/0xa2426164df2c7c2f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783441513.180528:0:5785:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff91a841476e00/0xa2426164df2c7c36 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783441513.180538:0:5785:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91a841476e00/0xa2426164df2c7c36 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783441513.180545:0:5785:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91a841476e00/0xa2426164df2c7c36 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1783441513.180554:0:5785:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 0 00010000:00010000:3.0:1783441513.180658:0:5785:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff91a841476800/0xa2426164df2c7c28 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783441513.180665:0:5785:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff91a841476800/0xa2426164df2c7c28 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783441513.180672:0:5785:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff91a841476800/0xa2426164df2c7c28 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783441513.180677:0:5785:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91a841476800 already unused, calling callback (ffffffffc1f9b4f0) 00010000:00010000:3.0:1783441513.180682:0:5785:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91a841476800/0xa2426164df2c7c28 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783441513.180689:0:5785:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91a841476800/0xa2426164df2c7c28 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783441513.180702:0:5785:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff91a8439b0300) 00010000:00010000:3.0:1783441513.180705:0:5785:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1783441513.180709:0:5785:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff91a841476800/0xa2426164df2c7c28 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783441513.180725:0:5785:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91a841476800/0xa2426164df2c7c28 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783441513.180783:0:5785:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff91a841477200/0xa2426164df2c7c2f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783441513.180789:0:5785:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff91a841477200/0xa2426164df2c7c2f lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783441513.180795:0:5785:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff91a841477200/0xa2426164df2c7c2f lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783441513.180799:0:5785:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91a841477200 already unused, calling callback (ffffffffc1f9b4f0) 00010000:00010000:3.0:1783441513.180802:0:5785:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91a841477200/0xa2426164df2c7c2f lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783441513.180808:0:5785:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91a841477200/0xa2426164df2c7c2f lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783441513.180817:0:5785:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff91a85faeea00) 00010000:00010000:3.0:1783441513.180819:0:5785:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1783441513.180822:0:5785:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff91a841477200/0xa2426164df2c7c2f lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783441513.180827:0:5785:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91a841477200/0xa2426164df2c7c2f lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783441513.180876:0:5785:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91a841477c00/0xa2426164df2c7c21 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.13@tcp remote: 0x633a354aa4df4e15 expref: 51 pid: 5785 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783441513.180890:0:5785:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff91a841476e00/0xa2426164df2c7c36 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.13@tcp remote: 0x633a354aa4df4e15 expref: 50 pid: 5785 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783441513.180903:0:5785:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff91a8429bdf00) 00010000:00010000:3.0:1783441513.180905:0:5785:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1783441513.180908:0:5785:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91a841476e00, rc 0) 00000100:00100000:3.0:1783441513.181630:0:5785:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a87d7c7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:65454767-383a-4679-a788-eba05c6e0989+50:10383:x1870073673323008:12345-192.168.201.13@tcp:101:lfs.0 Request processed in 1426us (1789us total) trans 4294967347 rc 0/0 00000100:00100000:3.0:1783441513.181640:0:5785:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.13@tcp, seq: 62 00000100:00100000:3.0:1783441513.186879:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.13@tcp (source: 12345-192.168.201.13@tcp) 00000100:00100000:1.0:1783441513.187501:0:5787:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073673323136 00000100:00100000:1.0:1783441513.187512:0:5787:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073673323136 00000100:00100000:1.0:1783441513.187583:0:5787:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.13@tcp, seq: 63 00000100:00100000:1.0:1783441513.187594:0:5787:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a87da69500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:65454767-383a-4679-a788-eba05c6e0989+50:10383:x1870073673323136:12345-192.168.201.13@tcp:54:lfs.0 00010000:00010000:1.0:1783441513.187667:0:5787:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff91a87da46000/0xa2426164df2c7c44 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783441513.187684:0:5787:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91a87da46000/0xa2426164df2c7c44 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783441513.187696:0:5787:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91a87da46000/0xa2426164df2c7c44 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783441513.187723:0:5787:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff91a87da46000/0xa2426164df2c7c44 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783441513.187729:0:5787:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff91a87da46000/0xa2426164df2c7c44 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783441513.187735:0:5787:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff91a87da46000/0xa2426164df2c7c44 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783441513.187787:0:5787:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91a87da46000 already unused, calling callback (ffffffffc1f9b4f0) 00010000:00010000:1.0:1783441513.187806:0:5787:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91a87da46000/0xa2426164df2c7c44 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783441513.187815:0:5787:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91a87da46000/0xa2426164df2c7c44 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783441513.187827:0:5787:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff91a8429bdf00) 00010000:00010000:1.0:1783441513.187831:0:5787:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1783441513.187835:0:5787:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff91a87da46000/0xa2426164df2c7c44 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783441513.187842:0:5787:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91a87da46000/0xa2426164df2c7c44 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783441513.187926:0:5787:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a87da69500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:65454767-383a-4679-a788-eba05c6e0989+50:10383:x1870073673323136:12345-192.168.201.13@tcp:54:lfs.0 Request processed in 333us (1061us total) trans 0 rc 0/0 00000100:00100000:1.0:1783441513.187945:0:5787:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.13@tcp, seq: 63 00000100:00100000:1.0:1783441513.190172:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.13@tcp (source: 12345-192.168.201.13@tcp) 00000100:00100000:3.0:1783441513.190296:0:5769:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073673323264 00000100:00100000:3.0:1783441513.190306:0:5769:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073673323264 00000100:00100000:3.0:1783441513.190370:0:5769:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.13@tcp, seq: 4 00000100:00100000:3.0:1783441513.190379:0:5769:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a87d646680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:65454767-383a-4679-a788-eba05c6e0989+50:2354:x1870073673323264:12345-192.168.201.13@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1783441513.190393:0:5769:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1783441513.190417:0:5769:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91a841476e00/0xa2426164df2c7c36 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.13@tcp remote: 0x633a354aa4df4e15 expref: 50 pid: 5785 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783441513.190436:0:5769:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff91a8429bdf00) 00010000:00010000:3.0:1783441513.190441:0:5769:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1783441513.190499:0:5769:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a87d646680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:65454767-383a-4679-a788-eba05c6e0989+49:2354:x1870073673323264:12345-192.168.201.13@tcp:103:ldlm_bl.0 Request processed in 121us (337us total) trans 0 rc 0/0 00000100:00100000:3.0:1783441513.190507:0:5769:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.13@tcp, seq: 4 00000100:00100000:3.0:1783441513.193820:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.13@tcp (source: 12345-192.168.201.13@tcp) 00000100:00100000:0.0:1783441513.194088:0:5789:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073673323520 00000100:00100000:0.0:1783441513.194098:0:5789:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073673323520 00000100:00100000:0.0:1783441513.194167:0:5789:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.13@tcp, seq: 17 00000100:00100000:0.0:1783441513.194194:0:5789:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a8476b3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:65454767-383a-4679-a788-eba05c6e0989+49:10383:x1870073673323520:12345-192.168.201.13@tcp:35:lfs.0 00000100:00100000:0.0:1783441513.194498:0:5789:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a8476b3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:65454767-383a-4679-a788-eba05c6e0989+50:10383:x1870073673323520:12345-192.168.201.13@tcp:35:lfs.0 Request processed in 305us (694us total) trans 4294967348 rc 0/0 00000100:00100000:0.0:1783441513.194506:0:5789:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.13@tcp, seq: 17 00000004:00080000:2.0:1783441513.325251:0:7787:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 351199507081ns, next at 352199504551ns, rc = 0 00000100:00100000:0.0:1783441513.325384:0:3305:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1783441513.325402:0:3305:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff91a875364e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3305:1870073693276928:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1783441513.325465:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000040:00080000:1.0:1783441513.325761:0:11531:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:2.0:1783441513.325865:0:6585:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073693276928 00000100:00100000:2.0:1783441513.325874:0:6585:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073693276928 00000100:00100000:2.0:1783441513.325950:0:6585:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 64 00000100:00100000:2.0:1783441513.325958:0:6585:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a8749a5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3305:x1870073693276928:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1783441513.326003:0:6585:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47644672 pending 1703936 free 3859808256 avail 3857711104 00000100:00080000:0.0:1783441513.326138:0:5781:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1783441513.327112:0:6585:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a8749a5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3305:x1870073693276928:12345-0@lo:13:osp-pre-1-0.0 Request processed in 1150us (1641us total) trans 0 rc 0/0 00000100:00100000:2.0:1783441513.327121:0:6585:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 64 00000100:00100000:1.0:1783441513.327301:0:3305:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff91a875364e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3305:1870073693276928:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1783441513.367810:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.13@tcp (source: 12345-192.168.201.13@tcp) 00000100:00100000:2.0:1783441513.368129:0:6605:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073673323776 00000100:00100000:2.0:1783441513.368154:0:6605:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073673323776 00000100:00100000:2.0:1783441513.368215:0:6605:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.13@tcp, seq: 64 00000100:00100000:2.0:1783441513.368225:0:6605:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a87d645c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:65454767-383a-4679-a788-eba05c6e0989+50:10401:x1870073673323776:12345-192.168.201.13@tcp:101:cat.0 00010000:00010000:2.0:1783441513.368252:0:6605:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1783441513.368275:0:6605:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91a85f83c000/0xa2426164df2c7c4b lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x633a354aa4df4e1c expref: -99 pid: 6605 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783441513.368381:0:6605:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff91a85f83d600/0xa2426164df2c7c52 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6605 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783441513.368395:0:6605:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91a85f83d600/0xa2426164df2c7c52 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x4:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6605 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783441513.368407:0:6605:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91a85f83d600/0xa2426164df2c7c52 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x4:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6605 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1783441513.368420:0:6605:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 0 00010000:00010000:2.0:1783441513.368558:0:6605:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91a85f83c000/0xa2426164df2c7c4b lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.13@tcp remote: 0x633a354aa4df4e1c expref: 53 pid: 6605 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783441513.368579:0:6605:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff91a85f83d600/0xa2426164df2c7c52 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x4:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.13@tcp remote: 0x633a354aa4df4e1c expref: 52 pid: 6605 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783441513.368588:0:6605:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff91a8429bdf00) 00010000:00010000:2.0:1783441513.368591:0:6605:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint d 00010000:00010000:2.0:1783441513.368595:0:6605:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91a85f83d600, rc 0) 00000100:00100000:2.0:1783441513.368660:0:6605:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a87d645c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:65454767-383a-4679-a788-eba05c6e0989+52:10401:x1870073673323776:12345-192.168.201.13@tcp:101:cat.0 Request processed in 436us (860us total) trans 4294967349 rc 0/0 00000100:00100000:2.0:1783441513.368668:0:6605:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.13@tcp, seq: 64 00000100:00100000:3.0:1783441513.410656:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.13@tcp (source: 12345-192.168.201.13@tcp) 00000100:00100000:1.0:1783441513.412223:0:5787:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073673323904 00000100:00100000:1.0:1783441513.412237:0:5787:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073673323904 00000100:00100000:1.0:1783441513.412317:0:5787:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.13@tcp, seq: 65 00000100:00100000:1.0:1783441513.412328:0:5787:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a87d807800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:65454767-383a-4679-a788-eba05c6e0989+52:10402:x1870073673323904:12345-192.168.201.13@tcp:101:lfs.0 00010000:00010000:1.0:1783441513.412359:0:5787:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1783441513.412382:0:5787:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91a87da47200/0xa2426164df2c7c60 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x633a354aa4df4e23 expref: -99 pid: 5787 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783441513.412481:0:5787:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff91a87da46200/0xa2426164df2c7c67 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783441513.412494:0:5787:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91a87da46200/0xa2426164df2c7c67 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783441513.412505:0:5787:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91a87da46200/0xa2426164df2c7c67 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1783441513.412574:0:5787:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x3:0x0]: returning size 512 00000004:00200000:1.0:1783441513.412579:0:5787:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 1 stripe count 1 MDT count 1 00000004:00010000:1.0:1783441513.412602:0:5787:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff91a87da46200/0xa2426164df2c7c67 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783441513.412627:0:5787:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91a87da47200/0xa2426164df2c7c60 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.13@tcp remote: 0x633a354aa4df4e23 expref: 54 pid: 5787 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783441513.412651:0:5787:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff91a87da46200/0xa2426164df2c7c67 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.13@tcp remote: 0x633a354aa4df4e23 expref: 53 pid: 5787 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783441513.412660:0:5787:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff91a8439b0300) 00010000:00010000:1.0:1783441513.412663:0:5787:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1783441513.412667:0:5787:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91a87da46200, rc 0) 00000100:00100000:1.0:1783441513.412854:0:5787:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a87d807800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:65454767-383a-4679-a788-eba05c6e0989+53:10402:x1870073673323904:12345-192.168.201.13@tcp:101:lfs.0 Request processed in 527us (2209us total) trans 0 rc 0/0 00000100:00100000:1.0:1783441513.412861:0:5787:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.13@tcp, seq: 65 00000100:00100000:1.0:1783441513.423265:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.13@tcp (source: 12345-192.168.201.13@tcp) 00000100:00100000:2.0:1783441513.423364:0:5789:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073673324288 00000100:00100000:2.0:1783441513.423375:0:5789:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073673324288 00000100:00100000:2.0:1783441513.423439:0:5789:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.13@tcp, seq: 18 00000100:00100000:2.0:1783441513.423450:0:5789:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a87d647b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:65454767-383a-4679-a788-eba05c6e0989+53:10402:x1870073673324288:12345-192.168.201.13@tcp:35:lfs.0 00000001:00080000:2.0:1783441513.423821:0:5789:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967350 00000100:00100000:2.0:1783441513.423935:0:5789:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a87d647b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:65454767-383a-4679-a788-eba05c6e0989+55:10402:x1870073673324288:12345-192.168.201.13@tcp:35:lfs.0 Request processed in 487us (682us total) trans 4294967351 rc 0/0 00000100:00100000:2.0:1783441513.423943:0:5789:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.13@tcp, seq: 18 00000020:00080000:2.0:1783441513.423949:0:5789:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:3.0:1783441513.432881:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.13@tcp (source: 12345-192.168.201.13@tcp) 00000100:00100000:1.0:1783441513.433271:0:5770:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073673324416 00000100:00100000:1.0:1783441513.433304:0:5770:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073673324416 00000100:00100000:1.0:1783441513.433388:0:5770:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.13@tcp, seq: 5 00000100:00100000:1.0:1783441513.433400:0:5770:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a867cd5f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:65454767-383a-4679-a788-eba05c6e0989+55:10402:x1870073673324416:12345-192.168.201.13@tcp:103:lfs.0 00010000:00010000:1.0:1783441513.433417:0:5770:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 3 locks, starting at 0 00010000:00010000:1.0:1783441513.433446:0:5770:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91a87da47000/0xa2426164df2c7bf7 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.13@tcp remote: 0x633a354aa4df4e07 expref: 55 pid: 5787 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783441513.433472:0:5770:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91a85f83d600/0xa2426164df2c7c52 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x4:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.13@tcp remote: 0x633a354aa4df4e1c expref: 54 pid: 6605 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783441513.433485:0:5770:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91a85f83cc00/0xa2426164df2c7b02 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.13@tcp remote: 0x633a354aa4df4dc8 expref: 53 pid: 6605 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783441513.433495:0:5770:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff91a8429bdf00) 00010000:00010000:1.0:1783441513.433507:0:5770:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1783441513.433579:0:5770:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a867cd5f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:65454767-383a-4679-a788-eba05c6e0989+52:10402:x1870073673324416:12345-192.168.201.13@tcp:103:lfs.0 Request processed in 181us (710us total) trans 0 rc 0/0 00000100:00100000:1.0:1783441513.433587:0:5770:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.13@tcp, seq: 5 00000100:00100000:3.0:1783441513.437023:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.13@tcp (source: 12345-192.168.201.13@tcp) 00000100:00100000:2.0:1783441513.437168:0:6605:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073673324544 00000100:00100000:2.0:1783441513.437178:0:6605:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073673324544 00000100:00100000:2.0:1783441513.437238:0:6605:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.13@tcp, seq: 66 00000100:00100000:2.0:1783441513.437248:0:6605:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a877fac000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:65454767-383a-4679-a788-eba05c6e0989+52:10402:x1870073673324544:12345-192.168.201.13@tcp:58:lfs.0 00010000:00010000:2.0:1783441513.437354:0:6605:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff91a85f83c000/0xa2426164df2c7c6e lrc: 3/0,1 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6605 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783441513.437371:0:6605:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91a85f83c000/0xa2426164df2c7c6e lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6605 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783441513.437383:0:6605:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91a85f83c000/0xa2426164df2c7c6e lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6605 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1783441513.437674:0:6605:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1783441513.439274:0:6605:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].1, 64 off8256 00000040:00080000:2.0:1783441513.439362:0:6605:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].1, 136 off8328 00000100:00100000:2.0:1783441513.439499:0:6605:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a877fac000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:65454767-383a-4679-a788-eba05c6e0989+52:10402:x1870073673324544:12345-192.168.201.13@tcp:58:lfs.0 Request processed in 2245us (2485us total) trans 0 rc 0/0 00000100:00100000:2.0:1783441513.439512:0:6605:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.13@tcp, seq: 66 00000100:00100000:3.0:1783441513.474195:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.13@tcp (source: 12345-192.168.201.13@tcp) 00000100:00100000:1.0:1783441513.474409:0:5787:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073673324672 00000100:00100000:1.0:1783441513.474421:0:5787:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073673324672 00000100:00100000:1.0:1783441513.474490:0:5787:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.13@tcp, seq: 67 00000100:00100000:1.0:1783441513.474501:0:5787:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a877fad880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:65454767-383a-4679-a788-eba05c6e0989+52:10404:x1870073673324672:12345-192.168.201.13@tcp:101:lfs.0 00010000:00010000:1.0:1783441513.474526:0:5787:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1783441513.474551:0:5787:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91a87da47000/0xa2426164df2c7c75 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x633a354aa4df4e2a expref: -99 pid: 5787 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783441513.474630:0:5787:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff91a87da47e00/0xa2426164df2c7c7c lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783441513.474651:0:5787:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91a87da47e00/0xa2426164df2c7c7c lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783441513.474663:0:5787:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91a87da47e00/0xa2426164df2c7c7c lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783441513.474681:0:5787:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff91a87da47200/0xa2426164df2c7c83 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783441513.474688:0:5787:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91a87da47200/0xa2426164df2c7c83 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783441513.474694:0:5787:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91a87da47200/0xa2426164df2c7c83 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783441513.474834:0:5787:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff91a87da46000/0xa2426164df2c7c8a lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783441513.474842:0:5787:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91a87da46000/0xa2426164df2c7c8a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x53/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783441513.474850:0:5787:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91a87da46000/0xa2426164df2c7c8a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x53/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1783441513.474884:0:5787:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 0 00000004:00200000:1.0:1783441513.474888:0:5787:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:1.0:1783441513.474907:0:5787:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff91a87da46000/0xa2426164df2c7c8a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x53/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783441513.474931:0:5787:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91a87da46000/0xa2426164df2c7c8a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783441513.474951:0:5787:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff91a87da47e00/0xa2426164df2c7c7c lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783441513.474968:0:5787:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff91a87da47e00/0xa2426164df2c7c7c lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783441513.474975:0:5787:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff91a87da47e00/0xa2426164df2c7c7c lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783441513.474980:0:5787:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91a87da47e00 already unused, calling callback (ffffffffc1f9b4f0) 00010000:00010000:1.0:1783441513.474985:0:5787:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91a87da47e00/0xa2426164df2c7c7c lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783441513.475001:0:5787:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91a87da47e00/0xa2426164df2c7c7c lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783441513.475119:0:5787:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff91a8439b0300) 00010000:00010000:1.0:1783441513.475122:0:5787:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1783441513.475127:0:5787:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff91a87da47e00/0xa2426164df2c7c7c lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783441513.475132:0:5787:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91a87da47e00/0xa2426164df2c7c7c lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783441513.475149:0:5787:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff91a87da47200/0xa2426164df2c7c83 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783441513.475156:0:5787:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff91a87da47200/0xa2426164df2c7c83 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783441513.475162:0:5787:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff91a87da47200/0xa2426164df2c7c83 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783441513.475173:0:5787:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91a87da47200 already unused, calling callback (ffffffffc1f9b4f0) 00010000:00010000:1.0:1783441513.475176:0:5787:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91a87da47200/0xa2426164df2c7c83 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783441513.475182:0:5787:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91a87da47200/0xa2426164df2c7c83 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783441513.475190:0:5787:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff91a858b90f00) 00010000:00010000:1.0:1783441513.475192:0:5787:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1783441513.475194:0:5787:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff91a87da47200/0xa2426164df2c7c83 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783441513.475200:0:5787:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91a87da47200/0xa2426164df2c7c83 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783441513.475238:0:5787:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91a87da47000/0xa2426164df2c7c75 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.13@tcp remote: 0x633a354aa4df4e2a expref: 54 pid: 5787 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783441513.475251:0:5787:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff91a87da46000/0xa2426164df2c7c8a lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.13@tcp remote: 0x633a354aa4df4e2a expref: 53 pid: 5787 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783441513.475262:0:5787:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff91a8429bd000) 00010000:00010000:1.0:1783441513.475264:0:5787:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1783441513.475266:0:5787:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91a87da46000, rc 0) 00000100:00100000:1.0:1783441513.475336:0:5787:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a877fad880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:65454767-383a-4679-a788-eba05c6e0989+53:10404:x1870073673324672:12345-192.168.201.13@tcp:101:lfs.0 Request processed in 836us (1153us total) trans 0 rc 0/0 00000100:00100000:1.0:1783441513.475344:0:5787:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.13@tcp, seq: 67 00010000:00010000:1.0:1783441513.587037:0:5772:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:2.0:1783441514.299190:0:11846:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:2.0:1783441514.299207:0:11846:0:(llog_cat.c:841:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1783441514.299326:0:11846:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 2 count 2 00000040:00080000:2.0:1783441514.299333:0:11846:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000040:00080000:1.0:1783441514.349333:0:11531:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:1.0:1783441514.349341:0:11531:0:(llog_cat.c:841:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1783441514.349409:0:11531:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 2 count 2 00000040:00080000:1.0:1783441514.349415:0:11531:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:1.0:1783441514.351277:0:11531:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff91a87d644700 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:11531:1870073693277056:192.168.201.13@tcp:107:hsm_cdtr.0 00000100:00100000:1.0:1783441514.351388:0:11531:0:(client.c:2702:ptlrpc_set_wait()) set ffff91a847066c00 going to sleep for 11 seconds 00000100:00100000:0.0:1783441514.356358:0:3303:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff91a87d681f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3303:1870073693277184:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1783441514.356437:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783441514.357614:0:6584:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073693277184 00000100:00100000:1.0:1783441514.357625:0:6584:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073693277184 00000100:00100000:1.0:1783441514.357697:0:6584:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 65 00000100:00100000:1.0:1783441514.357707:0:6584:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a8749a5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3303:x1870073693277184:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1783441514.357770:0:6584:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1783441514.357911:0:6584:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a8749a5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3303:x1870073693277184:12345-0@lo:13:osp-pre-0-0.0 Request processed in 205us (1473us total) trans 0 rc 0/0 00000100:00100000:1.0:1783441514.357918:0:6584:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 65 00000100:00100000:1.0:1783441514.357983:0:3303:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff91a87d681f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3303:1870073693277184:0@lo:13:osp-pre-0-0.0 00000100:00080000:0.0:1783441514.358405:0:5781:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1783441514.358959:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.13@tcp (source: 12345-192.168.201.13@tcp) 00000100:00100000:0.0:1783441514.359018:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.13@tcp (source: 12345-192.168.201.13@tcp) 00000100:00100000:1.0:1783441514.359280:0:5778:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073673324800 00000100:00100000:1.0:1783441514.359288:0:5778:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073673324800 00000100:00100000:1.0:1783441514.359335:0:5778:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.13@tcp, seq: 289 00000100:00100000:1.0:1783441514.359344:0:5778:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a848f73850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:51c2a82e-e792-4f56-84e8-12cc033e9e70+13:2355:x1870073673324800:12345-192.168.201.13@tcp:400:kworker.0 00000100:00100000:1.0:1783441514.359409:0:5778:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a848f73850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:51c2a82e-e792-4f56-84e8-12cc033e9e70+13:2355:x1870073673324800:12345-192.168.201.13@tcp:400:kworker.0 Request processed in 65us (453us total) trans 0 rc 0/0 00000100:00100000:1.0:1783441514.359416:0:5778:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.13@tcp, seq: 289 00000100:00100000:2.0:1783441514.359795:0:6582:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073673325056 00000100:00100000:2.0:1783441514.359800:0:6582:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073673325056 00000100:00100000:2.0:1783441514.359839:0:6582:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.13@tcp, seq: 81 00000100:00100000:2.0:1783441514.359847:0:6582:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a8749a6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:65454767-383a-4679-a788-eba05c6e0989+7:2355:x1870073673325056:12345-192.168.201.13@tcp:400:kworker.0 00000100:00100000:2.0:1783441514.359879:0:6582:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a8749a6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:65454767-383a-4679-a788-eba05c6e0989+7:2355:x1870073673325056:12345-192.168.201.13@tcp:400:kworker.0 Request processed in 33us (861us total) trans 0 rc 0/0 00000100:00100000:2.0:1783441514.359885:0:6582:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.13@tcp, seq: 81 00000100:00080000:0.0:1783441514.360196:0:5781:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1783441514.363843:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.13@tcp (source: 12345-192.168.201.13@tcp) 00000100:00100000:0.0:1783441514.363881:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.13@tcp (source: 12345-192.168.201.13@tcp) 00000100:00100000:2.0:1783441514.364236:0:6605:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073673324928 00000100:00100000:2.0:1783441514.364248:0:6605:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073673324928 00000100:00100000:2.0:1783441514.364367:0:6605:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073673325184 00000100:00100000:2.0:1783441514.364371:0:6605:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073673325184 00000100:00100000:2.0:1783441514.364396:0:6605:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.13@tcp, seq: 148 00000100:00100000:2.0:1783441514.364406:0:6605:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a8749a7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:65454767-383a-4679-a788-eba05c6e0989+54:2355:x1870073673324928:12345-192.168.201.13@tcp:400:kworker.0 00000100:00100000:2.0:1783441514.364473:0:6605:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a8749a7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:65454767-383a-4679-a788-eba05c6e0989+54:2355:x1870073673324928:12345-192.168.201.13@tcp:400:kworker.0 Request processed in 68us (640us total) trans 0 rc 0/0 00000100:00100000:2.0:1783441514.364479:0:6605:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.13@tcp, seq: 148 00000100:00100000:2.0:1783441514.364495:0:6605:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.13@tcp, seq: 149 00000100:00100000:2.0:1783441514.364501:0:6605:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a8749a5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:d5aa2a25-c618-49e9-a833-85b3b4747e53+5:2355:x1870073673325184:12345-192.168.201.13@tcp:400:kworker.0 00000100:00100000:2.0:1783441514.364525:0:6605:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a8749a5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:d5aa2a25-c618-49e9-a833-85b3b4747e53+5:2355:x1870073673325184:12345-192.168.201.13@tcp:400:kworker.0 Request processed in 24us (643us total) trans 0 rc 0/0 00000100:00100000:2.0:1783441514.364531:0:6605:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.13@tcp, seq: 149 00000100:00080000:0.0:1783441514.366819:0:5781:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1783441514.376681:0:11531:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff91a87d644700 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:11531:1870073693277056:192.168.201.13@tcp:107:hsm_cdtr.0 00000100:00100000:0.0:1783441514.392128:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.13@tcp (source: 12345-192.168.201.13@tcp) 00000100:00100000:2.0:1783441514.393910:0:5797:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073673325312 00000100:00100000:2.0:1783441514.393932:0:5797:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073673325312 00000100:00100000:2.0:1783441514.394009:0:5797:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.13@tcp, seq: 1 00000100:00100000:2.0:1783441514.394020:0:5797:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a8749a6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:65454767-383a-4679-a788-eba05c6e0989+53:10415:x1870073673325312:12345-192.168.201.13@tcp:900:lhsmtool_posix.0 00000100:00100000:2.0:1783441514.394114:0:5797:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a8749a6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:65454767-383a-4679-a788-eba05c6e0989+53:10415:x1870073673325312:12345-192.168.201.13@tcp:900:lhsmtool_posix.0 Request processed in 96us (1996us total) trans 0 rc 0/0 00000100:00100000:2.0:1783441514.394123:0:5797:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.13@tcp, seq: 1 00000100:00100000:0.0:1783441514.402601:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.13@tcp (source: 12345-192.168.201.13@tcp) 00000100:00100000:2.0:1783441514.402687:0:6605:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073673325440 00000100:00100000:2.0:1783441514.402698:0:6605:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073673325440 00000100:00100000:2.0:1783441514.402794:0:6605:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.13@tcp, seq: 68 00000100:00100000:2.0:1783441514.402805:0:6605:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a8749a4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:65454767-383a-4679-a788-eba05c6e0989+53:10415:x1870073673325440:12345-192.168.201.13@tcp:53:lhsmtool_posix.0 00000004:00000080:2.0:1783441514.402838:0:6605:0:(mdt_handler.c:7960:mdt_fid2path()) path get [0x200000401:0x4:0x0] from 18446744073709551615 #0 00000100:00100000:2.0:1783441514.402943:0:6605:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a8749a4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:65454767-383a-4679-a788-eba05c6e0989+53:10415:x1870073673325440:12345-192.168.201.13@tcp:53:lhsmtool_posix.0 Request processed in 140us (353us total) trans 0 rc 0/0 00000100:00100000:2.0:1783441514.402951:0:6605:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.13@tcp, seq: 68 00000100:00100000:0.0:1783441514.409277:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.13@tcp (source: 12345-192.168.201.13@tcp) 00000100:00100000:2.0:1783441514.409364:0:5785:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073673325568 00000100:00100000:2.0:1783441514.409373:0:5785:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073673325568 00000100:00100000:2.0:1783441514.409434:0:5785:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.13@tcp, seq: 69 00000100:00100000:2.0:1783441514.409444:0:5785:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a8749a6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:65454767-383a-4679-a788-eba05c6e0989+53:10415:x1870073673325568:12345-192.168.201.13@tcp:34:lhsmtool_posix.0 00010000:00010000:2.0:1783441514.409518:0:5785:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff91a85f83c400/0xa2426164df2c7c91 lrc: 3/1,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783441514.409535:0:5785:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91a85f83c400/0xa2426164df2c7c91 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783441514.409547:0:5785:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91a85f83c400/0xa2426164df2c7c91 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783441514.409609:0:5785:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff91a85f83cc00/0xa2426164df2c7c98 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x3c15db59 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783441514.409629:0:5785:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91a85f83cc00/0xa2426164df2c7c98 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x3c15db59 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783441514.409637:0:5785:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91a85f83cc00/0xa2426164df2c7c98 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x3c15db59 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783441514.409667:0:5785:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff91a85f83d600/0xa2426164df2c7c9f lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783441514.409675:0:5785:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91a85f83d600/0xa2426164df2c7c9f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783441514.409682:0:5785:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91a85f83d600/0xa2426164df2c7c9f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1783441514.409731:0:5785:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 0 00000004:00200000:2.0:1783441514.409736:0:5785:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1783441514.409795:0:5785:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff91a85f83d600/0xa2426164df2c7c9f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783441514.409808:0:5785:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff91a85f83c400/0xa2426164df2c7c91 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783441514.409815:0:5785:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff91a85f83c400/0xa2426164df2c7c91 lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783441514.409823:0:5785:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff91a85f83c400/0xa2426164df2c7c91 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783441514.409829:0:5785:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91a85f83c400 already unused, calling callback (ffffffffc1f9b4f0) 00010000:00010000:2.0:1783441514.409833:0:5785:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91a85f83c400/0xa2426164df2c7c91 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783441514.409848:0:5785:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91a85f83c400/0xa2426164df2c7c91 lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783441514.409862:0:5785:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff91a858b90e00) 00010000:00010000:2.0:1783441514.409865:0:5785:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1783441514.409870:0:5785:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff91a85f83c400/0xa2426164df2c7c91 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783441514.409876:0:5785:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91a85f83c400/0xa2426164df2c7c91 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783441514.409888:0:5785:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff91a85f83cc00/0xa2426164df2c7c98 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x3c15db59 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783441514.409895:0:5785:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff91a85f83cc00/0xa2426164df2c7c98 lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x3c15db59 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783441514.409900:0:5785:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff91a85f83cc00/0xa2426164df2c7c98 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x3c15db59 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783441514.409905:0:5785:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91a85f83cc00 already unused, calling callback (ffffffffc1f9b4f0) 00010000:00010000:2.0:1783441514.409908:0:5785:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91a85f83cc00/0xa2426164df2c7c98 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x3c15db59 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783441514.409914:0:5785:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91a85f83cc00/0xa2426164df2c7c98 lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x3c15db59 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783441514.409922:0:5785:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x3c15db59 (ffff91a8429bd200) 00010000:00010000:2.0:1783441514.409924:0:5785:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1783441514.409927:0:5785:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff91a85f83cc00/0xa2426164df2c7c98 lrc: 2/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x3c15db59 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783441514.409943:0:5785:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91a85f83cc00/0xa2426164df2c7c98 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x3c15db59 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783441514.409970:0:5785:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff91a85f83d600/0xa2426164df2c7c9f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783441514.409984:0:5785:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff91a85f83d600/0xa2426164df2c7c9f lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783441514.409990:0:5785:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff91a85f83d600/0xa2426164df2c7c9f lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783441514.409995:0:5785:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91a85f83d600 already unused, calling callback (ffffffffc1f9b4f0) 00010000:00010000:2.0:1783441514.409998:0:5785:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91a85f83d600/0xa2426164df2c7c9f lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783441514.410003:0:5785:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91a85f83d600/0xa2426164df2c7c9f lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783441514.410012:0:5785:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff91a8429bd000) 00010000:00010000:2.0:1783441514.410014:0:5785:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1783441514.410017:0:5785:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff91a85f83d600/0xa2426164df2c7c9f lrc: 2/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783441514.410024:0:5785:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91a85f83d600/0xa2426164df2c7c9f lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783441514.410102:0:5785:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a8749a6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:65454767-383a-4679-a788-eba05c6e0989+53:10415:x1870073673325568:12345-192.168.201.13@tcp:34:lhsmtool_posix.0 Request processed in 658us (833us total) trans 0 rc 0/0 00000100:00100000:2.0:1783441514.410110:0:5785:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.13@tcp, seq: 69 00000100:00100000:2.0:1783441514.414397:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.13@tcp (source: 12345-192.168.201.13@tcp) 00000100:00100000:3.0:1783441514.414515:0:6605:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073673325824 00000100:00100000:3.0:1783441514.414526:0:6605:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073673325824 00000100:00100000:3.0:1783441514.414589:0:6605:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.13@tcp, seq: 70 00000100:00100000:3.0:1783441514.414599:0:6605:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a875366300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:65454767-383a-4679-a788-eba05c6e0989+53:10415:x1870073673325824:12345-192.168.201.13@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1783441514.414621:0:6605:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1783441514.414639:0:6605:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91a841476800/0xa2426164df2c7ca6 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x633a354aa4df4e31 expref: -99 pid: 6605 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783441514.414801:0:6605:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff91a841476e00/0xa2426164df2c7cad lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6605 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783441514.414816:0:6605:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91a841476e00/0xa2426164df2c7cad lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6605 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783441514.414827:0:6605:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91a841476e00/0xa2426164df2c7cad lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6605 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1783441514.414839:0:6605:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 0 00010000:00010000:3.0:1783441514.415164:0:6605:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff91a841476e00/0xa2426164df2c7cad lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6605 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783441514.415172:0:6605:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff91a841476e00/0xa2426164df2c7cad lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6605 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783441514.415258:0:6605:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff91a841476e00/0xa2426164df2c7cad lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6605 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783441514.415265:0:6605:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91a841476e00 already unused, calling callback (ffffffffc1f9b4f0) 00010000:00010000:3.0:1783441514.415270:0:6605:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91a841476e00/0xa2426164df2c7cad lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6605 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783441514.415277:0:6605:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91a841476e00/0xa2426164df2c7cad lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6605 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783441514.415298:0:6605:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff91a8429bd000) 00010000:00010000:3.0:1783441514.415301:0:6605:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1783441514.415306:0:6605:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff91a841476e00/0xa2426164df2c7cad lrc: 2/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6605 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783441514.415312:0:6605:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91a841476e00/0xa2426164df2c7cad lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6605 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783441514.415356:0:6605:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff91a841476800/0xa2426164df2c7ca6 lrc: 1/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.13@tcp remote: 0x633a354aa4df4e31 expref: 55 pid: 6605 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783441514.415367:0:6605:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff91a858b90e00) 00010000:00010000:3.0:1783441514.415370:0:6605:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1783441514.415374:0:6605:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91a841476800/0xa2426164df2c7ca6 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.13@tcp remote: 0x633a354aa4df4e31 expref: 55 pid: 6605 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783441514.415383:0:6605:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91a841476800, rc 0) 00000100:00100000:3.0:1783441514.415451:0:6605:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a875366300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:65454767-383a-4679-a788-eba05c6e0989+54:10415:x1870073673325824:12345-192.168.201.13@tcp:101:lhsmtool_posix.0 Request processed in 853us (1064us total) trans 4294967352 rc 301/301 00000100:00100000:3.0:1783441514.415459:0:6605:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.13@tcp, seq: 70 00000100:00100000:3.0:1783441514.418971:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.13@tcp (source: 12345-192.168.201.13@tcp) 00000100:00100000:2.0:1783441514.419417:0:5785:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073673325952 00000100:00100000:2.0:1783441514.419427:0:5785:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073673325952 00000100:00100000:2.0:1783441514.419491:0:5785:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.13@tcp, seq: 71 00000100:00100000:2.0:1783441514.419504:0:5785:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a877fac700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:65454767-383a-4679-a788-eba05c6e0989+54:10415:x1870073673325952:12345-192.168.201.13@tcp:53:lhsmtool_posix.0 00000004:00000080:2.0:1783441514.419539:0:5785:0:(mdt_handler.c:7960:mdt_fid2path()) path get [0x200000401:0x4:0x0] from 18446744073709551615 #0 00000100:00100000:2.0:1783441514.419651:0:5785:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a877fac700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:65454767-383a-4679-a788-eba05c6e0989+54:10415:x1870073673325952:12345-192.168.201.13@tcp:53:lhsmtool_posix.0 Request processed in 150us (694us total) trans 0 rc 0/0 00000100:00100000:2.0:1783441514.419660:0:5785:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.13@tcp, seq: 71 00000100:00100000:2.0:1783441514.424500:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.13@tcp (source: 12345-192.168.201.13@tcp) 00000100:00100000:1.0:1783441514.436630:0:5786:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073673326208 00000100:00100000:1.0:1783441514.436648:0:5786:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073673326208 00000100:00100000:1.0:1783441514.436895:0:5786:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.13@tcp, seq: 72 00000100:00100000:1.0:1783441514.436907:0:5786:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a875367800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:65454767-383a-4679-a788-eba05c6e0989+54:10415:x1870073673326208:12345-192.168.201.13@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1783441514.436951:0:5786:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1783441514.436956:0:5786:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:1.0:1783441514.437001:0:5786:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91a87da46200/0xa2426164df2c7c67 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.13@tcp remote: 0x633a354aa4df4e23 expref: 54 pid: 5787 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783441514.437025:0:5786:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff91a8439b0300) 00010000:00010000:1.0:1783441514.437030:0:5786:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1783441514.437045:0:5786:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91a87da47800/0xa2426164df2c7cbb lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x633a354aa4df4e38 expref: -99 pid: 5786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:1.0:1783441514.437432:0:5786:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x3:0x0], index 0: 0 00010000:00010000:1.0:1783441514.437587:0:5786:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff91a87da46600/0xa2426164df2c7cc2 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x6:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783441514.437598:0:5786:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91a87da46600/0xa2426164df2c7cc2 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783441514.437606:0:5786:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91a87da46600/0xa2426164df2c7cc2 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783441514.437646:0:5786:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91a87da47800/0xa2426164df2c7cbb lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.13@tcp remote: 0x633a354aa4df4e38 expref: 56 pid: 5786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783441514.437657:0:5786:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff91a87da46600/0xa2426164df2c7cc2 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.13@tcp remote: 0x633a354aa4df4e38 expref: 55 pid: 5786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783441514.437663:0:5786:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff91a858b90f00) 00010000:00010000:1.0:1783441514.437665:0:5786:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1783441514.437671:0:5786:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91a87da46600, rc 0) 00000100:00100000:1.0:1783441514.437729:0:5786:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a875367800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:65454767-383a-4679-a788-eba05c6e0989+55:10415:x1870073673326208:12345-192.168.201.13@tcp:101:lhsmtool_posix.0 Request processed in 823us (13238us total) trans 4294967353 rc 0/0 00000100:00100000:1.0:1783441514.437737:0:5786:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.13@tcp, seq: 72 00000100:00100000:3.0:1783441514.441401:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.13@tcp (source: 12345-192.168.201.13@tcp) 00000100:00100000:1.0:1783441514.441593:0:5787:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073673326464 00000100:00100000:1.0:1783441514.441604:0:5787:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073673326464 00000100:00100000:1.0:1783441514.441669:0:5787:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.13@tcp, seq: 73 00000100:00100000:1.0:1783441514.441679:0:5787:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a877faea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:65454767-383a-4679-a788-eba05c6e0989+55:10415:x1870073673326464:12345-192.168.201.13@tcp:36:lhsmtool_posix.0 00010000:00010000:1.0:1783441514.441733:0:5787:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1783441514.441771:0:5787:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91a87da46600/0xa2426164df2c7cc2 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x6:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.13@tcp remote: 0x633a354aa4df4e38 expref: 55 pid: 5786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783441514.441788:0:5787:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff91a858b90f00) 00010000:00010000:1.0:1783441514.441799:0:5787:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1783441514.441819:0:5787:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff91a87da47800/0xa2426164df2c7cd0 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783441514.441832:0:5787:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91a87da47800/0xa2426164df2c7cd0 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783441514.441841:0:5787:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91a87da47800/0xa2426164df2c7cd0 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783441514.441913:0:5787:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff91a87da46200/0xa2426164df2c7cd7 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x3:0x0].0x88ffe037 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783441514.441922:0:5787:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91a87da46200/0xa2426164df2c7cd7 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x88ffe037 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783441514.441929:0:5787:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91a87da46200/0xa2426164df2c7cd7 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x88ffe037 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783441514.442031:0:5787:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff91a87da47800/0xa2426164df2c7cd0 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783441514.442039:0:5787:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff91a87da47800/0xa2426164df2c7cd0 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783441514.442045:0:5787:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff91a87da47800/0xa2426164df2c7cd0 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783441514.442051:0:5787:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91a87da47800 already unused, calling callback (ffffffffc1f9b4f0) 00010000:00010000:1.0:1783441514.442056:0:5787:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91a87da47800/0xa2426164df2c7cd0 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783441514.442064:0:5787:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91a87da47800/0xa2426164df2c7cd0 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783441514.442073:0:5787:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff91a8439b0300) 00010000:00010000:1.0:1783441514.442076:0:5787:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1783441514.442081:0:5787:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff91a87da47800/0xa2426164df2c7cd0 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783441514.442086:0:5787:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91a87da47800/0xa2426164df2c7cd0 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783441514.442097:0:5787:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff91a87da46200/0xa2426164df2c7cd7 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x88ffe037 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783441514.442103:0:5787:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff91a87da46200/0xa2426164df2c7cd7 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x88ffe037 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783441514.442109:0:5787:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff91a87da46200/0xa2426164df2c7cd7 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x88ffe037 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783441514.442121:0:5787:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91a87da46200 already unused, calling callback (ffffffffc1f9b4f0) 00010000:00010000:1.0:1783441514.442123:0:5787:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91a87da46200/0xa2426164df2c7cd7 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x88ffe037 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783441514.442129:0:5787:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91a87da46200/0xa2426164df2c7cd7 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x88ffe037 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783441514.442138:0:5787:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x88ffe037 (ffff91a858b90200) 00010000:00010000:1.0:1783441514.442141:0:5787:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1783441514.442144:0:5787:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff91a87da46200/0xa2426164df2c7cd7 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x3:0x0].0x88ffe037 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783441514.442149:0:5787:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91a87da46200/0xa2426164df2c7cd7 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x3:0x0].0x88ffe037 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783441514.442235:0:5787:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a877faea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:65454767-383a-4679-a788-eba05c6e0989+54:10415:x1870073673326464:12345-192.168.201.13@tcp:36:lhsmtool_posix.0 Request processed in 556us (841us total) trans 0 rc -2/-2 00000100:00100000:1.0:1783441514.442243:0:5787:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.13@tcp, seq: 73 00000100:00100000:2.0:1783441514.451536:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.13@tcp (source: 12345-192.168.201.13@tcp) 00000100:00100000:3.0:1783441514.451603:0:6605:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073673326592 00000100:00100000:3.0:1783441514.451612:0:6605:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073673326592 00000100:00100000:3.0:1783441514.451670:0:6605:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.13@tcp, seq: 74 00000100:00100000:3.0:1783441514.451678:0:6605:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a875365500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:65454767-383a-4679-a788-eba05c6e0989+54:10415:x1870073673326592:12345-192.168.201.13@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1783441514.451699:0:6605:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1783441514.451732:0:6605:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91a841477c00/0xa2426164df2c7cde lrc: 2/0,0 mode: --/PR res: [0x200000401:0x6:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x633a354aa4df4e3f expref: -99 pid: 6605 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783441514.451794:0:6605:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff91a841476800/0xa2426164df2c7ce5 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x6:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6605 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783441514.451807:0:6605:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91a841476800/0xa2426164df2c7ce5 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6605 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783441514.451819:0:6605:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91a841476800/0xa2426164df2c7ce5 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6605 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783441514.451916:0:6605:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91a841477c00/0xa2426164df2c7cde lrc: 0/0,0 mode: --/PR res: [0x200000401:0x6:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.13@tcp remote: 0x633a354aa4df4e3f expref: 56 pid: 6605 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783441514.451933:0:6605:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff91a841476800/0xa2426164df2c7ce5 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.13@tcp remote: 0x633a354aa4df4e3f expref: 55 pid: 6605 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783441514.451941:0:6605:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff91a85faeea00) 00010000:00010000:3.0:1783441514.451945:0:6605:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:3.0:1783441514.451948:0:6605:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91a841476800, rc 0) 00000100:00100000:3.0:1783441514.452013:0:6605:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a875365500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:65454767-383a-4679-a788-eba05c6e0989+55:10415:x1870073673326592:12345-192.168.201.13@tcp:101:lhsmtool_posix.0 Request processed in 336us (487us total) trans 0 rc 0/0 00000100:00100000:3.0:1783441514.452020:0:6605:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.13@tcp, seq: 74 00000100:00100000:2.0:1783441514.467348:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.13@tcp (source: 12345-192.168.201.13@tcp) 00000100:00100000:3.0:1783441514.467792:0:5787:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073673326848 00000100:00100000:3.0:1783441514.467803:0:5787:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073673326848 00000100:00100000:3.0:1783441514.467864:0:5787:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.13@tcp, seq: 75 00000100:00100000:3.0:1783441514.467875:0:5787:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a875364000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:65454767-383a-4679-a788-eba05c6e0989+55:10415:x1870073673326848:12345-192.168.201.13@tcp:36:lhsmtool_posix.0 00010000:00010000:3.0:1783441514.468100:0:5787:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff91a841477c00/0xa2426164df2c7cec lrc: 3/0,1 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783441514.468127:0:5787:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91a841477c00/0xa2426164df2c7cec lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783441514.468139:0:5787:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91a841477c00/0xa2426164df2c7cec lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:3.0:1783441514.468409:0:5787:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].3, 88 off8408 00000004:00080000:3.0:1783441514.468419:0:5787:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 352342677419ns, next at 353342675652ns, rc = 0 00000004:00010000:3.0:1783441514.468505:0:5787:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000c4092313 reply state 00000000d191547b transno 4294967354 ns: mdt-lustre-MDT0000_UUID lock: ffff91a841477c00/0xa2426164df2c7cec lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783441514.468515:0:5787:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1783441514.468619:0:5787:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a875364000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:65454767-383a-4679-a788-eba05c6e0989+57:10415:x1870073673326848:12345-192.168.201.13@tcp:36:lhsmtool_posix.0 Request processed in 745us (1278us total) trans 4294967354 rc 0/0 00000100:00100000:3.0:1783441514.468627:0:5787:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.13@tcp, seq: 75 00010000:00010000:1.0:1783441514.475022:0:3289:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff91a841477c00/0xa2426164df2c7cec lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783441514.475041:0:3289:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff91a841477c00/0xa2426164df2c7cec lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783441514.475050:0:3289:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff91a841477c00/0xa2426164df2c7cec lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783441514.475056:0:3289:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91a841477c00 already unused, calling callback (ffffffffc1f9b4f0) 00010000:00010000:1.0:1783441514.475061:0:3289:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91a841477c00/0xa2426164df2c7cec lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783441514.475086:0:3289:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91a841477c00/0xa2426164df2c7cec lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783441514.475106:0:3289:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff91a85faeea00) 00010000:00010000:1.0:1783441514.475109:0:3289:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:1.0:1783441514.475113:0:3289:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff91a841477c00/0xa2426164df2c7cec lrc: 2/0,0 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783441514.475118:0:3289:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91a841477c00/0xa2426164df2c7cec lrc: 0/0,0 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783441514.475903:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.13@tcp (source: 12345-192.168.201.13@tcp) 00000100:00100000:3.0:1783441514.476177:0:6605:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073673326976 00000100:00100000:3.0:1783441514.476187:0:6605:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073673326976 00000100:00100000:3.0:1783441514.476247:0:6605:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.13@tcp, seq: 76 00000100:00100000:3.0:1783441514.476257:0:6605:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a875364380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:65454767-383a-4679-a788-eba05c6e0989+56:10415:x1870073673326976:12345-192.168.201.13@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1783441514.476285:0:6605:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1783441514.476306:0:6605:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91a841476e00/0xa2426164df2c7cf3 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x6:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x633a354aa4df4e46 expref: -99 pid: 6605 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783441514.476366:0:6605:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91a841476e00/0xa2426164df2c7cf3 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.201.13@tcp remote: 0x633a354aa4df4e46 expref: 57 pid: 6605 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783441514.476380:0:6605:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff91a841476e00/0xa2426164df2c7cf3 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.13@tcp remote: 0x633a354aa4df4e46 expref: 57 pid: 6605 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783441514.476427:0:6605:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff91a85faeea00) 00010000:00010000:3.0:1783441514.476431:0:6605:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1783441514.476433:0:6605:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91a841476e00, rc 0) 00000100:00100000:3.0:1783441514.476628:0:6605:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a875364380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:65454767-383a-4679-a788-eba05c6e0989+57:10415:x1870073673326976:12345-192.168.201.13@tcp:101:lhsmtool_posix.0 Request processed in 371us (730us total) trans 0 rc 0/0 00000100:00100000:3.0:1783441514.476635:0:6605:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.13@tcp, seq: 76 00000100:00100000:3.0:1783441514.480463:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.13@tcp (source: 12345-192.168.201.13@tcp) 00000100:00100000:1.0:1783441514.482249:0:6583:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073673327104 00000100:00100000:1.0:1783441514.482265:0:6583:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073673327104 00000100:00100000:1.0:1783441514.482361:0:6583:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.13@tcp, seq: 25 00000100:00100000:1.0:1783441514.482371:0:6583:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a877faed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0+-99:2351:x1870073673327104:12345-192.168.201.13@tcp:8:lhsmtool_posix.0 00010000:00080000:1.0:1783441514.482404:0:6583:0:(ldlm_lib.c:1432:target_handle_connect()) lustre-OST0000: connection from 65454767-383a-4679-a788-eba05c6e0989@192.168.201.13@tcp t0 exp 0000000000000000 cur 352 last 0 00000020:00000080:1.0:1783441514.482437:0:6583:0:(genops.c:1406:class_connect()) connect: client 65454767-383a-4679-a788-eba05c6e0989, cookie 0xa2426164df2c7cfa 00002000:00100000:1.0:1783441514.482449:0:6583:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli 65454767-383a-4679-a788-eba05c6e0989/ffff91a8433dc000 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113669 ocd_grant: 3407872 ocd_index: 0 ocd_group 0 00002000:00100000:1.0:1783441514.482461:0:6583:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0000: cli supports cksum type f7, return f7 00002000:00080000:1.0:1783441514.482683:0:6583:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:1.0:1783441514.482714:0:6583:0:(import.c:65:import_set_state_nolock()) ffff91a8433df000 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1783441514.482801:0:6583:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a877faed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:65454767-383a-4679-a788-eba05c6e0989+6:2351:x1870073673327104:12345-192.168.201.13@tcp:8:lhsmtool_posix.0 Request processed in 431us (2347us total) trans 0 rc 0/0 00000100:00100000:1.0:1783441514.482809:0:6583:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.13@tcp, seq: 25 00000100:00100000:1.0:1783441514.488546:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.13@tcp (source: 12345-192.168.201.13@tcp) 00000100:00100000:2.0:1783441514.488606:0:6582:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073673327232 00000100:00100000:2.0:1783441514.488615:0:6582:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073673327232 00000100:00080000:3.0:1783441514.488669:0:5781:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1783441514.488690:0:6582:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.13@tcp, seq: 26 00000100:00100000:2.0:1783441514.488700:0:6582:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a87d681f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:65454767-383a-4679-a788-eba05c6e0989+6:0:x1870073673327232:12345-192.168.201.13@tcp:2:lhsmtool_posix.0 00000001:00100000:3.0:1783441514.573867:0:6613:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of 65454767-383a-4679-a788-eba05c6e0989 00000001:00080000:3.0:1783441514.573886:0:6613:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967301 is committed 00000100:00100000:2.0:1783441514.574310:0:6582:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a87d681f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:65454767-383a-4679-a788-eba05c6e0989+5:0:x1870073673327232:12345-192.168.201.13@tcp:2:lhsmtool_posix.0 Request processed in 85602us (85763us total) trans 4294967301 rc 0/0 00000100:00100000:2.0:1783441514.574324:0:6582:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.13@tcp, seq: 26 00000100:00100000:3.0:1783441514.582967:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.13@tcp (source: 12345-192.168.201.13@tcp) 00000100:00100000:0.0:1783441514.583220:0:5789:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073673327488 00000100:00100000:0.0:1783441514.583231:0:5789:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073673327488 00000100:00100000:0.0:1783441514.583299:0:5789:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.13@tcp, seq: 19 00000100:00100000:0.0:1783441514.583308:0:5789:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a875426d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:65454767-383a-4679-a788-eba05c6e0989+57:10415:x1870073673327488:12345-192.168.201.13@tcp:35:lhsmtool_posix.0 00000100:00100000:0.0:1783441514.583714:0:5789:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a875426d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:65454767-383a-4679-a788-eba05c6e0989+58:10415:x1870073673327488:12345-192.168.201.13@tcp:35:lhsmtool_posix.0 Request processed in 404us (759us total) trans 4294967355 rc 0/0 00000100:00100000:0.0:1783441514.583734:0:5789:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.13@tcp, seq: 19 00000100:00100000:0.0:1783441514.591419:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.13@tcp (source: 12345-192.168.201.13@tcp) 00000100:00100000:1.0:1783441514.592313:0:5785:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073673327744 00000100:00100000:1.0:1783441514.592331:0:5785:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073673327744 00000100:00100000:1.0:1783441514.592393:0:5785:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.13@tcp, seq: 77 00000100:00100000:1.0:1783441514.592405:0:5785:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a8749a5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:65454767-383a-4679-a788-eba05c6e0989+58:10415:x1870073673327744:12345-192.168.201.13@tcp:57:lhsmtool_posix.0 00000100:00100000:1.0:1783441514.592523:0:5785:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a8749a5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:65454767-383a-4679-a788-eba05c6e0989+58:10415:x1870073673327744:12345-192.168.201.13@tcp:57:lhsmtool_posix.0 Request processed in 121us (1112us total) trans 0 rc 0/0 00000100:00100000:1.0:1783441514.592531:0:5785:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.13@tcp, seq: 77 00000100:00100000:1.0:1783441514.599258:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.13@tcp (source: 12345-192.168.201.13@tcp) 00000100:00100000:2.0:1783441514.599366:0:5786:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073673327872 00000100:00100000:2.0:1783441514.599379:0:5786:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073673327872 00000100:00100000:2.0:1783441514.599458:0:5786:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.13@tcp, seq: 78 00000100:00100000:2.0:1783441514.599468:0:5786:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a87d680700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:65454767-383a-4679-a788-eba05c6e0989+58:10415:x1870073673327872:12345-192.168.201.13@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1783441514.599489:0:5786:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1783441514.599574:0:5786:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91a85f83c400/0xa2426164df2c7d01 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x6:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x633a354aa4df4e4d expref: -99 pid: 5786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783441514.599676:0:5786:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff91a85f83c600/0xa2426164df2c7d08 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x6:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783441514.599691:0:5786:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91a85f83c600/0xa2426164df2c7d08 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783441514.599704:0:5786:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91a85f83c600/0xa2426164df2c7d08 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1783441514.599787:0:5786:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1783441514.599804:0:5786:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff91a85f83c600/0xa2426164df2c7d08 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783441514.599831:0:5786:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91a85f83c400/0xa2426164df2c7d01 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.13@tcp remote: 0x633a354aa4df4e4d expref: 60 pid: 5786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783441514.599850:0:5786:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff91a85f83c600/0xa2426164df2c7d08 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.13@tcp remote: 0x633a354aa4df4e4d expref: 59 pid: 5786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783441514.599858:0:5786:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff91a85faeea00) 00010000:00010000:2.0:1783441514.599860:0:5786:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:2.0:1783441514.599864:0:5786:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91a85f83c600, rc 0) 00000100:00100000:2.0:1783441514.600116:0:5786:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a87d680700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:65454767-383a-4679-a788-eba05c6e0989+59:10415:x1870073673327872:12345-192.168.201.13@tcp:101:lhsmtool_posix.0 Request processed in 648us (868us total) trans 0 rc 0/0 00000100:00100000:2.0:1783441514.600124:0:5786:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.13@tcp, seq: 78 00000100:00100000:0.0:1783441514.606893:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.13@tcp (source: 12345-192.168.201.13@tcp) 00010000:00010000:0.0:1783441514.606998:0:5773:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1783441514.607073:0:8557:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073673328000 00000100:00100000:2.0:1783441514.607083:0:8557:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073673328000 00000100:00100000:2.0:1783441514.607154:0:8557:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.13@tcp, seq: 27 00000100:00100000:2.0:1783441514.607191:0:8557:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a8749a4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:65454767-383a-4679-a788-eba05c6e0989+5:2353:x1870073673328000:12345-192.168.201.13@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1783441514.607210:0:8557:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1783441514.607231:0:8557:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000bee70992/0xa2426164df2c7d0f lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x633a354aa4df4e54 expref: -99 pid: 8557 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1783441514.607263:0:8557:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x3:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x6a4d286b, blocks: 0x1 00010000:00010000:2.0:1783441514.607283:0:8557:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=352s v=(0 0) 00010000:00010000:2.0:1783441514.607288:0:8557:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1783441514.607297:0:8557:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000bee70992/0xa2426164df2c7d0f lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.13@tcp remote: 0x633a354aa4df4e54 expref: 6 pid: 8557 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783441514.607316:0:8557:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000bee70992/0xa2426164df2c7d0f lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.13@tcp remote: 0x633a354aa4df4e54 expref: 6 pid: 8557 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783441514.607332:0:8557:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91a85f83d800, rc 0) 00000100:00100000:2.0:1783441514.607446:0:8557:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a8749a4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:65454767-383a-4679-a788-eba05c6e0989+6:2353:x1870073673328000:12345-192.168.201.13@tcp:101:lhsmtool_posix.0 Request processed in 268us (566us total) trans 0 rc 0/0 00000100:00100000:2.0:1783441514.607454:0:8557:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.13@tcp, seq: 27 00000100:00100000:0.0:1783441514.611844:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.13@tcp (source: 12345-192.168.201.13@tcp) 00000100:00100000:1.0:1783441514.612025:0:5785:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073673328256 00000100:00100000:1.0:1783441514.612035:0:5785:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073673328256 00000100:00100000:1.0:1783441514.612115:0:5785:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.13@tcp, seq: 79 00000100:00100000:1.0:1783441514.612124:0:5785:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a8749a5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:65454767-383a-4679-a788-eba05c6e0989+59:10415:x1870073673328256:12345-192.168.201.13@tcp:57:lhsmtool_posix.0 00000100:00100000:1.0:1783441514.612234:0:5785:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a8749a5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:65454767-383a-4679-a788-eba05c6e0989+59:10415:x1870073673328256:12345-192.168.201.13@tcp:57:lhsmtool_posix.0 Request processed in 111us (399us total) trans 0 rc 0/0 00000100:00100000:1.0:1783441514.612242:0:5785:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.13@tcp, seq: 79 00000100:00100000:2.0:1783441514.617110:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.13@tcp (source: 12345-192.168.201.13@tcp) 00000100:00100000:1.0:1783441514.617261:0:6581:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073673328384 00000100:00100000:1.0:1783441514.617273:0:6581:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073673328384 00000100:00100000:1.0:1783441514.617398:0:6581:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.13@tcp, seq: 28 00000100:00100000:1.0:1783441514.617411:0:6581:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a875367480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:65454767-383a-4679-a788-eba05c6e0989+6:10415:x1870073673328384:12345-192.168.201.13@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1783441514.617432:0:6581:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1783441514.617455:0:6581:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000725429ac/0xa2426164df2c7d16 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x633a354aa4df4e5b expref: -99 pid: 6581 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783441514.617492:0:6581:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000bee70992/0xa2426164df2c7d0f lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.13@tcp remote: 0x633a354aa4df4e54 expref: 7 pid: 8557 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783441514.617510:0:6581:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1783441514.617529:0:6581:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1783441514.617533:0:6581:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000725429ac/0xa2426164df2c7d16 lrc: 4/0,0 mode: --/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.201.13@tcp remote: 0x633a354aa4df4e5b expref: 7 pid: 6581 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783441514.617568:0:6581:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000bee70992/0xa2426164df2c7d0f lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.201.13@tcp remote: 0x633a354aa4df4e54 expref: 7 pid: 8557 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783441514.617578:0:6581:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000bee70992/0xa2426164df2c7d0f lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.201.13@tcp remote: 0x633a354aa4df4e54 expref: 7 pid: 8557 timeout: 452 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783441514.617588:0:6581:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff91a87d681c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:6581:1870073693277312:192.168.201.13@tcp:104: 00000100:00100000:1.0:1783441514.617663:0:6581:0:(client.c:2702:ptlrpc_set_wait()) set ffff91a8470663c0 going to sleep for 11 seconds 00000100:00100000:3.0:1783441514.621157:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.13@tcp (source: 12345-192.168.201.13@tcp) 00000100:00100000:0.0:1783441514.621230:0:11015:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073673328512 00000100:00100000:0.0:1783441514.621240:0:11015:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073673328512 00010000:00010000:0.0:1783441514.621289:0:11015:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000bee70992/0xa2426164df2c7d0f lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.201.13@tcp remote: 0x633a354aa4df4e54 expref: 8 pid: 8557 timeout: 452 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783441514.621324:0:11015:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.13@tcp, seq: 42 00000100:00100000:0.0:1783441514.621331:0:11015:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a84545b050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:65454767-383a-4679-a788-eba05c6e0989+8:2355:x1870073673328512:12345-192.168.201.13@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1783441514.621343:0:11015:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1783441514.621361:0:11015:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000bee70992/0xa2426164df2c7d0f lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.201.13@tcp remote: 0x633a354aa4df4e54 expref: 8 pid: 8557 timeout: 452 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783441514.621371:0:11015:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000bee70992/0xa2426164df2c7d0f lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.201.13@tcp remote: 0x633a354aa4df4e54 expref: 8 pid: 8557 timeout: 452 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783441514.621392:0:11015:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1783441514.621396:0:11015:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1783441514.621402:0:11015:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000725429ac/0xa2426164df2c7d16 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50080000000000 nid: 192.168.201.13@tcp remote: 0x633a354aa4df4e5b expref: 8 pid: 6581 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783441514.621408:0:11015:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000725429ac/0xa2426164df2c7d16 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50080000000000 nid: 192.168.201.13@tcp remote: 0x633a354aa4df4e5b expref: 8 pid: 6581 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783441514.621449:0:11015:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: 00000000725429ac/0xa2426164df2c7d16 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000000000 nid: 192.168.201.13@tcp remote: 0x633a354aa4df4e5b expref: 8 pid: 6581 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783441514.621459:0:11015:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff91a745905180 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0000_UUID:11015:1870073693277440:192.168.201.13@tcp:105: 00000100:00100000:0.0:1783441514.621528:0:11015:0:(client.c:2702:ptlrpc_set_wait()) set ffff91a87d7f9000 going to sleep for 11 seconds 00010000:00010000:1.0:1783441514.621962:0:6581:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000bee70992/0xa2426164df2c7d0f lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.201.13@tcp remote: 0x633a354aa4df4e54 expref: 8 pid: 8557 timeout: 452 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783441514.621992:0:6581:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff91a87d681c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:6581:1870073693277312:192.168.201.13@tcp:104: 00010000:00010000:1.0:1783441514.622020:0:6581:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000725429ac/0xa2426164df2c7d16 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.201.13@tcp remote: 0x633a354aa4df4e5b expref: 7 pid: 6581 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783441514.622031:0:6581:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91a87da47c00, rc 0) 00000100:00100000:1.0:1783441514.622122:0:6581:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a875367480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:65454767-383a-4679-a788-eba05c6e0989+7:10415:x1870073673328384:12345-192.168.201.13@tcp:101:lhsmtool_posix.0 Request processed in 4713us (5022us total) trans 0 rc 0/0 00000100:00100000:1.0:1783441514.622130:0:6581:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.13@tcp, seq: 28 00000100:00100000:0.0:1783441514.624828:0:11015:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff91a745905180 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0000_UUID:11015:1870073693277440:192.168.201.13@tcp:105: 00010000:00010000:0.0:1783441514.624858:0:11015:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1783441514.624905:0:11015:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a84545b050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:65454767-383a-4679-a788-eba05c6e0989+6:2355:x1870073673328512:12345-192.168.201.13@tcp:103:ldlm_bl.0 Request processed in 3572us (3753us total) trans 0 rc 0/0 00000100:00100000:0.0:1783441514.624915:0:11015:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.13@tcp, seq: 42 00000100:00100000:0.0:1783441514.626585:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.13@tcp (source: 12345-192.168.201.13@tcp) 00000100:00100000:1.0:1783441514.626697:0:6588:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073673328640 00000100:00100000:1.0:1783441514.626706:0:6588:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073673328640 00002000:00100000:1.0:1783441514.627866:0:6588:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x3:0x0] (0->8) req@ffff91a745905180 x1870073673328640/t0(0) o4->65454767-383a-4679-a788-eba05c6e0989@192.168.201.13@tcp:155/0 lens 504/0 e 0 to 0 dl 1783441525 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1783441514.627891:0:6588:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff91a745905180 with x1870073673328640 ext(0->8) 00002000:00010000:1.0:1783441514.627897:0:6588:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff91a745905180 00000100:00100000:1.0:1783441514.628101:0:6588:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.13@tcp, seq: 0 00000100:00100000:1.0:1783441514.628113:0:6588:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a745905180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:65454767-383a-4679-a788-eba05c6e0989+6:2354:x1870073673328640:12345-192.168.201.13@tcp:4:lhsmtool_posix.0 00000100:00100000:1.0:1783441514.629176:0:6588:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a745905180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:65454767-383a-4679-a788-eba05c6e0989+8:2354:x1870073673328640:12345-192.168.201.13@tcp:4:lhsmtool_posix.0 Request processed in 864us (2473us total) trans 4294967302 rc 0/0 00000100:00100000:1.0:1783441514.629188:0:6588:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.13@tcp, seq: 0 00002000:00100000:1.0:1783441514.629198:0:6588:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x3:0x0] (0->8) req@ffff91a745905180 x1870073673328640/t4294967302(0) o4->65454767-383a-4679-a788-eba05c6e0989@192.168.201.13@tcp:155/0 lens 504/448 e 0 to 0 dl 1783441525 ref 1 fl Complete:/600/0 rc 0/0 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1783441514.629208:0:6588:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff91a745905180 with x1870073673328640 ext(0->8) 00002000:00010000:1.0:1783441514.629214:0:6588:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff91a745905180 00000100:00100000:2.0:1783441514.639173:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.13@tcp (source: 12345-192.168.201.13@tcp) 00000100:00100000:3.0:1783441514.639905:0:6605:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073673328768 00000100:00100000:3.0:1783441514.639918:0:6605:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073673328768 00000100:00100000:3.0:1783441514.640026:0:6605:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.13@tcp, seq: 80 00000100:00100000:3.0:1783441514.640038:0:6605:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a875365880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:65454767-383a-4679-a788-eba05c6e0989+59:10415:x1870073673328768:12345-192.168.201.13@tcp:44:lhsmtool_posix.0 00000001:00080000:1.0:1783441514.681460:0:5807:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967355 is committed 00000020:00080000:1.0:1783441514.681496:0:5807:0:(update_trans.c:60:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff91a87d7f9480 refcount 2 committed 0 result 0 batchid 1 00000020:00080000:1.0:1783441514.681514:0:5807:0:(update_trans.c:68:top_multiple_thandle_dump()) st ffff91a8506bdd00 obd lustre-OST0001-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff91a87d7f9f00 00000020:00080000:1.0:1783441514.681518:0:5807:0:(update_trans.c:68:top_multiple_thandle_dump()) st ffff91a8506bd000 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff91a875230800 00000004:00080000:1.0:1783441514.681560:0:5807:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2 committed 00000004:00080000:1.0:1783441514.681591:0:5807:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 3 committed 00000004:00080000:1.0:1783441514.681618:0:5807:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 4 committed 00000100:00100000:1.0:1783441514.681811:0:3304:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff91a87d681c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3304:1870073693277568:0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1783441514.681878:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783441514.681984:0:8557:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073693277568 00000100:00100000:1.0:1783441514.682001:0:8557:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073693277568 00000100:00100000:1.0:1783441514.682048:0:8557:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:1.0:1783441514.682056:0:8557:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a87d683100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3304:x1870073693277568:12345-0@lo:2:osp-syn-0-0.0 00000020:00080000:0.0:1783441514.682423:0:5818:0:(update_trans.c:1581:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 1 committed batchid 0 00000020:00080000:0.0:1783441514.682547:0:5818:0:(update_trans.c:1581:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 0 00002000:00010000:1.0:1783441514.682819:0:8557:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x3:0x0] updating lvb size from disk: 0 -> 9 00002000:00010000:1.0:1783441514.682823:0:8557:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x240000400:0x3:0x0] updating lvb mtime from disk: 0 -> 1783441515 00002000:00010000:1.0:1783441514.682826:0:8557:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x240000400:0x3:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:1.0:1783441514.682828:0:8557:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x240000400:0x3:0x0] updating lvb ctime from disk: 1783441515 -> 1783441515 00002000:00010000:1.0:1783441514.682831:0:8557:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x3:0x0] updating lvb blocks from disk: 1 -> 1 00000100:00100000:1.0:1783441514.682880:0:8557:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a87d683100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+6:3304:x1870073693277568:12345-0@lo:2:osp-syn-0-0.0 Request processed in 822us (999us total) trans 4294967303 rc 0/0 00000100:00100000:1.0:1783441514.682887:0:8557:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00100000:2.0:1783441514.683078:0:3305:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff91a875366680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3305:1870073693277696:0@lo:6:osp-syn-1-0.0 00000100:00100000:2.0:1783441514.683115:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783441514.683165:0:6582:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073693277696 00000100:00100000:2.0:1783441514.683170:0:6582:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073693277696 00000100:00100000:2.0:1783441514.683340:0:6582:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:2.0:1783441514.683348:0:6582:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a867fb6450 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:3305:x1870073693277696:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:2.0:1783441514.683379:0:6582:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x280000400:2 count 1 00002000:00010000:2.0:1783441514.683406:0:6582:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x2:0x0] initial LVB size: 13, mtime: 0x6a4d2867, atime: 0x6a4d2867, ctime: 0x6a4d2867, blocks: 0x1 00010000:00010000:2.0:1783441514.683414:0:6582:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000bee70992/0xa2426164df2c7d1d lrc: 3/0,1 mode: --/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6582 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783441514.683431:0:6582:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2:0x0].0x0 since=352s v=(0 0) 00010000:00010000:2.0:1783441514.683435:0:6582:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1783441514.683441:0:6582:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000bee70992/0xa2426164df2c7d1d lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6582 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783441514.683458:0:6582:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000bee70992/0xa2426164df2c7d1d lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6582 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783441514.683469:0:6582:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000bee70992/0xa2426164df2c7d1d lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6582 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783441514.683477:0:6582:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000bee70992/0xa2426164df2c7d1d lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 6582 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783441514.683495:0:6582:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000004:00080000:0.0:1783441514.685002:0:3304:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff91a87d681c00/2, rc 0, transno 4294967303 00000100:00100000:0.0:1783441514.685014:0:3304:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff91a87d681c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3304:1870073693277568:0@lo:2:osp-syn-0-0.0 00000100:00100000:2.0:1783441514.685300:0:6582:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a867fb6450 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+7:3305:x1870073693277696:12345-0@lo:6:osp-syn-1-0.0 Request processed in 1951us (2181us total) trans 4294967301 rc 0/0 00000100:00100000:2.0:1783441514.685310:0:6582:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00010000:00010000:2.0:1783441514.685483:0:5772:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1783441514.685492:0:5772:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000bee70992/0xa2426164df2c7d1d lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6582 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783441514.685518:0:5772:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91a85f83d800 already unused, calling callback (ffffffffc155ff90) 00010000:00010000:2.0:1783441514.685522:0:5772:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000bee70992/0xa2426164df2c7d1d lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6582 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783441514.685534:0:5772:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000bee70992/0xa2426164df2c7d1d lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 6582 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783441514.685554:0:5772:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000bee70992/0xa2426164df2c7d1d lrc: 1/0,0 mode: --/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6582 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783441514.685561:0:5772:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000bee70992/0xa2426164df2c7d1d lrc: 0/0,0 mode: --/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6582 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783441514.685581:0:5772:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783441514.685583:0:5772:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783441514.685585:0:5772:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00080000:1.0:1783441514.685649:0:3305:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff91a875366680/2, rc 0, transno 4294967301 00000100:00100000:1.0:1783441514.685654:0:3305:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff91a875366680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3305:1870073693277696:0@lo:6:osp-syn-1-0.0 00000100:00100000:3.0:1783441514.687911:0:6605:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a875365880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:65454767-383a-4679-a788-eba05c6e0989+13:10415:x1870073673328768:12345-192.168.201.13@tcp:44:lhsmtool_posix.0 Request processed in 47857us (48731us total) trans 0 rc 0/0 00000100:00100000:3.0:1783441514.687924:0:6605:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.13@tcp, seq: 80 00000100:00100000:0.0:1783441514.692426:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.13@tcp (source: 12345-192.168.201.13@tcp) 00000100:00100000:1.0:1783441514.692518:0:8557:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073673328896 00000100:00100000:1.0:1783441514.692529:0:8557:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073673328896 00000100:00100000:1.0:1783441514.692593:0:8557:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.13@tcp, seq: 31 00000100:00100000:1.0:1783441514.692604:0:8557:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a745907800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:65454767-383a-4679-a788-eba05c6e0989+8:2352:x1870073673328896:12345-192.168.201.13@tcp:16:lhsmtool_posix.0 00000001:00080000:1.0:1783441514.794569:0:6613:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967303 is committed 00000001:00080000:1.0:1783441514.794587:0:6613:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967302 is committed 00000100:00100000:3.0:1783441514.794851:0:8557:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a745907800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:65454767-383a-4679-a788-eba05c6e0989+6:2352:x1870073673328896:12345-192.168.201.13@tcp:16:lhsmtool_posix.0 Request processed in 102243us (102429us total) trans 0 rc 0/0 00000100:00100000:3.0:1783441514.794864:0:8557:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.13@tcp, seq: 31 00000100:00100000:0.0:1783441514.802696:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.13@tcp (source: 12345-192.168.201.13@tcp) 00000100:00100000:3.0:1783441514.803139:0:5787:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073673329152 00000100:00100000:3.0:1783441514.803151:0:5787:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073673329152 00000100:00100000:3.0:1783441514.803221:0:5787:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.13@tcp, seq: 81 00000100:00100000:3.0:1783441514.803246:0:5787:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a87da6bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:65454767-383a-4679-a788-eba05c6e0989+13:10415:x1870073673329152:12345-192.168.201.13@tcp:36:lhsmtool_posix.0 00010000:00010000:3.0:1783441514.803307:0:5787:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1783441514.803333:0:5787:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91a85f83c600/0xa2426164df2c7d08 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x6:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.13@tcp remote: 0x633a354aa4df4e4d expref: 13 pid: 5786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783441514.803353:0:5787:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff91a85faeea00) 00010000:00010000:3.0:1783441514.803359:0:5787:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1783441514.803395:0:5787:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff91a841477200/0xa2426164df2c7d24 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783441514.803409:0:5787:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91a841477200/0xa2426164df2c7d24 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783441514.803420:0:5787:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91a841477200/0xa2426164df2c7d24 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1783441514.803692:0:5787:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000e9b882a6 reply state 000000000a2bbe22 transno 4294967356 ns: mdt-lustre-MDT0000_UUID lock: ffff91a841477200/0xa2426164df2c7d24 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783441514.803702:0:5787:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1783441514.803866:0:5787:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a87da6bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:65454767-383a-4679-a788-eba05c6e0989+14:10415:x1870073673329152:12345-192.168.201.13@tcp:36:lhsmtool_posix.0 Request processed in 621us (1185us total) trans 4294967356 rc 0/0 00000100:00100000:3.0:1783441514.803874:0:5787:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.13@tcp, seq: 81 00010000:00010000:0.0:1783441514.810770:0:3290:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff91a841477200/0xa2426164df2c7d24 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783441514.810789:0:3290:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff91a841477200/0xa2426164df2c7d24 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783441514.810797:0:3290:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff91a841477200/0xa2426164df2c7d24 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783441514.810823:0:3290:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91a841477200 already unused, calling callback (ffffffffc1f9b4f0) 00010000:00010000:0.0:1783441514.810829:0:3290:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91a841477200/0xa2426164df2c7d24 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783441514.810838:0:3290:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91a841477200/0xa2426164df2c7d24 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783441514.810856:0:3290:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff91a85faeea00) 00010000:00010000:0.0:1783441514.810860:0:3290:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1783441514.810865:0:3290:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff91a841477200/0xa2426164df2c7d24 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783441514.810871:0:3290:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91a841477200/0xa2426164df2c7d24 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783441514.819299:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.13@tcp (source: 12345-192.168.201.13@tcp) 00000100:00100000:2.0:1783441514.819782:0:6582:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073673329280 00000100:00100000:2.0:1783441514.819793:0:6582:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073673329280 00000100:00100000:2.0:1783441514.819857:0:6582:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.13@tcp, seq: 32 00000100:00100000:2.0:1783441514.819869:0:6582:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a87da6aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:65454767-383a-4679-a788-eba05c6e0989+6:2354:x1870073673329280:12345-192.168.201.13@tcp:2:lhsmtool_posix.0 00002000:00010000:2.0:1783441514.820384:0:6582:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x3:0x0] updating lvb size from disk: 9 -> 9 00002000:00010000:2.0:1783441514.820389:0:6582:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x240000400:0x3:0x0] updating lvb mtime from disk: 1783441515 -> 1783441514 00002000:00010000:2.0:1783441514.820391:0:6582:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x240000400:0x3:0x0] updating lvb atime from disk: 0 -> 1783441511 00002000:00010000:2.0:1783441514.820394:0:6582:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x240000400:0x3:0x0] updating lvb ctime from disk: 1783441515 -> 1783441514 00002000:00010000:2.0:1783441514.820397:0:6582:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x3:0x0] updating lvb blocks from disk: 1 -> 11 00000100:00100000:2.0:1783441514.820475:0:6582:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a87da6aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:65454767-383a-4679-a788-eba05c6e0989+7:2354:x1870073673329280:12345-192.168.201.13@tcp:2:lhsmtool_posix.0 Request processed in 608us (1186us total) trans 4294967304 rc 0/0 00000100:00100000:2.0:1783441514.820484:0:6582:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.13@tcp, seq: 32 00000100:00100000:1.0:1783441514.824791:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.13@tcp (source: 12345-192.168.201.13@tcp) 00000100:00100000:2.0:1783441514.824934:0:5786:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073673329536 00000100:00100000:2.0:1783441514.824945:0:5786:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073673329536 00000100:00100000:2.0:1783441514.825709:0:5786:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.13@tcp, seq: 82 00000100:00100000:2.0:1783441514.825723:0:5786:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a87d680e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:65454767-383a-4679-a788-eba05c6e0989+13:10415:x1870073673329536:12345-192.168.201.13@tcp:55:lhsmtool_posix.0 00010000:00010000:2.0:1783441514.825843:0:5786:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff91a85f83ca00/0xa2426164df2c7d2b lrc: 3/0,1 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783441514.825863:0:5786:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff91a841476800/0xa2426164df2c7ce5 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.13@tcp remote: 0x633a354aa4df4e3f expref: 13 pid: 6605 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783441514.825873:0:5786:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff91a85f83ca00/0xa2426164df2c7d2b lrc: 4/0,1 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783441514.825920:0:5786:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff91a841476800/0xa2426164df2c7ce5 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.13@tcp remote: 0x633a354aa4df4e3f expref: 13 pid: 6605 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783441514.825935:0:5786:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff91a841476800/0xa2426164df2c7ce5 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.13@tcp remote: 0x633a354aa4df4e3f expref: 13 pid: 6605 timeout: 452 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783441514.825951:0:5786:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff91a875365c00 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5786:1870073693277824:192.168.201.13@tcp:104: 00000100:00100000:2.0:1783441514.826080:0:5786:0:(client.c:2702:ptlrpc_set_wait()) set ffff91a87d4cc300 going to sleep for 11 seconds 00000100:00100000:0.0:1783441514.833888:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.13@tcp (source: 12345-192.168.201.13@tcp) 00000100:00100000:1.0:1783441514.834014:0:5771:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073673329664 00000100:00100000:1.0:1783441514.834025:0:5771:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073673329664 00010000:00010000:1.0:1783441514.834085:0:5771:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff91a841476800/0xa2426164df2c7ce5 lrc: 5/0,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.13@tcp remote: 0x633a354aa4df4e3f expref: 14 pid: 6605 timeout: 452 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783441514.834136:0:5771:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.13@tcp, seq: 43 00000100:00100000:1.0:1783441514.834148:0:5771:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a87da68380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:65454767-383a-4679-a788-eba05c6e0989+14:2354:x1870073673329664:12345-192.168.201.13@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1783441514.834163:0:5771:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1783441514.834179:0:5771:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff91a841476800/0xa2426164df2c7ce5 lrc: 5/0,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.13@tcp remote: 0x633a354aa4df4e3f expref: 14 pid: 6605 timeout: 452 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783441514.834211:0:5771:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff91a841476800/0xa2426164df2c7ce5 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.13@tcp remote: 0x633a354aa4df4e3f expref: 14 pid: 6605 timeout: 452 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783441514.834240:0:5771:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff91a85faeea00) 00010000:00010000:1.0:1783441514.834246:0:5771:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff91a85f83ca00/0xa2426164df2c7d2b lrc: 3/0,1 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783441514.834257:0:5771:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff91a85f83ca00/0xa2426164df2c7d2b lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783441514.834264:0:5771:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91a85f83ca00/0xa2426164df2c7d2b lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783441514.834289:0:5771:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1783441514.834355:0:5771:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a87da68380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:65454767-383a-4679-a788-eba05c6e0989+14:2354:x1870073673329664:12345-192.168.201.13@tcp:103:ldlm_bl.0 Request processed in 208us (476us total) trans 0 rc 0/0 00000100:00100000:1.0:1783441514.834363:0:5771:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.13@tcp, seq: 43 00010000:00010000:2.0:1783441514.835349:0:5786:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91a841476800/0xa2426164df2c7ce5 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x6:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.13@tcp remote: 0x633a354aa4df4e3f expref: 13 pid: 6605 timeout: 452 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783441514.835373:0:5786:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff91a875365c00 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5786:1870073693277824:192.168.201.13@tcp:104: 00010000:00010000:2.0:1783441514.835411:0:5786:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff91a85f83ca00/0xa2426164df2c7d2b lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783441514.835421:0:5786:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff91a85f83ca00/0xa2426164df2c7d2b lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783441514.835427:0:5786:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91a85f83ca00/0xa2426164df2c7d2b lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783441514.835458:0:5786:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff91a85f83ca00/0xa2426164df2c7d2b lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783441514.835466:0:5786:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff91a85f83ca00/0xa2426164df2c7d2b lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783441514.835472:0:5786:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff91a85f83ca00/0xa2426164df2c7d2b lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783441514.835477:0:5786:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91a85f83ca00 already unused, calling callback (ffffffffc1f9b4f0) 00010000:00010000:2.0:1783441514.835482:0:5786:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91a85f83ca00/0xa2426164df2c7d2b lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783441514.835489:0:5786:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91a85f83ca00/0xa2426164df2c7d2b lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783441514.835514:0:5786:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff91a85faeea00) 00010000:00010000:2.0:1783441514.835518:0:5786:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 21 00010000:00010000:2.0:1783441514.835522:0:5786:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff91a85f83ca00/0xa2426164df2c7d2b lrc: 2/0,0 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783441514.835528:0:5786:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91a85f83ca00/0xa2426164df2c7d2b lrc: 0/0,0 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783441514.835615:0:5786:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a87d680e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:65454767-383a-4679-a788-eba05c6e0989+12:10415:x1870073673329536:12345-192.168.201.13@tcp:55:lhsmtool_posix.0 Request processed in 9895us (10834us total) trans 0 rc -22/-22 00000100:00100000:2.0:1783441514.835623:0:5786:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.13@tcp, seq: 82 00000100:00100000:0.0:1783441514.853228:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.13@tcp (source: 12345-192.168.201.13@tcp) 00000100:00100000:1.0:1783441514.853334:0:6583:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073673329792 00000100:00100000:1.0:1783441514.853345:0:6583:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073673329792 00000100:00100000:1.0:1783441514.853403:0:6583:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.13@tcp, seq: 33 00000100:00100000:1.0:1783441514.853413:0:6583:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a87da6b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:65454767-383a-4679-a788-eba05c6e0989+7:2355:x1870073673329792:12345-192.168.201.13@tcp:1:lhsmtool_posix.0 00010000:00010000:1.0:1783441514.853468:0:6583:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000e62c61d4/0xa2426164df2c7d32 lrc: 3/1,0 mode: --/PR res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6583 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783441514.853484:0:6583:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000725429ac/0xa2426164df2c7d16 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.201.13@tcp remote: 0x633a354aa4df4e5b expref: 7 pid: 6581 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783441514.853507:0:6583:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x240000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1783441514.853512:0:6583:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1783441514.853516:0:6583:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000e62c61d4/0xa2426164df2c7d32 lrc: 4/1,0 mode: --/PR res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6583 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783441514.853554:0:6583:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000725429ac/0xa2426164df2c7d16 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.201.13@tcp remote: 0x633a354aa4df4e5b expref: 7 pid: 6581 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783441514.853568:0:6583:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000725429ac/0xa2426164df2c7d16 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.201.13@tcp remote: 0x633a354aa4df4e5b expref: 7 pid: 6581 timeout: 452 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783441514.853579:0:6583:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff91a87d682300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:6583:1870073693277952:192.168.201.13@tcp:104: 00000100:00100000:1.0:1783441514.853652:0:6583:0:(client.c:2702:ptlrpc_set_wait()) set ffff91a847066e40 going to sleep for 11 seconds 00000100:00100000:2.0:1783441514.867532:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.13@tcp (source: 12345-192.168.201.13@tcp) 00000100:00100000:0.0:1783441514.867677:0:11514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073673329920 00000100:00100000:0.0:1783441514.867693:0:11514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073673329920 00010000:00010000:0.0:1783441514.867738:0:11514:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000725429ac/0xa2426164df2c7d16 lrc: 5/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.201.13@tcp remote: 0x633a354aa4df4e5b expref: 8 pid: 6581 timeout: 452 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783441514.867800:0:11514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.13@tcp, seq: 44 00000100:00100000:0.0:1783441514.867810:0:11514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a875365c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:65454767-383a-4679-a788-eba05c6e0989+8:2355:x1870073673329920:12345-192.168.201.13@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1783441514.867835:0:11514:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1783441514.867858:0:11514:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000725429ac/0xa2426164df2c7d16 lrc: 5/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.201.13@tcp remote: 0x633a354aa4df4e5b expref: 8 pid: 6581 timeout: 452 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783441514.867891:0:11514:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000725429ac/0xa2426164df2c7d16 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.201.13@tcp remote: 0x633a354aa4df4e5b expref: 8 pid: 6581 timeout: 452 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783441514.867922:0:11514:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1783441514.867927:0:11514:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1783441514.867934:0:11514:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000e62c61d4/0xa2426164df2c7d32 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090000000000 nid: local remote: 0x0 expref: -99 pid: 6583 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783441514.867944:0:11514:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000e62c61d4/0xa2426164df2c7d32 lrc: 4/1,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090000000000 nid: local remote: 0x0 expref: -99 pid: 6583 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783441514.867974:0:11514:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1783441514.868043:0:11514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a875365c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:65454767-383a-4679-a788-eba05c6e0989+8:2355:x1870073673329920:12345-192.168.201.13@tcp:103:ldlm_bl.0 Request processed in 234us (522us total) trans 0 rc 0/0 00000100:00100000:0.0:1783441514.868052:0:11514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.13@tcp, seq: 44 00010000:00010000:1.0:1783441514.870814:0:6583:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000725429ac/0xa2426164df2c7d16 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.201.13@tcp remote: 0x633a354aa4df4e5b expref: 7 pid: 6581 timeout: 452 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783441514.870846:0:6583:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff91a87d682300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:6583:1870073693277952:192.168.201.13@tcp:104: 00010000:00010000:1.0:1783441514.870876:0:6583:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000e62c61d4/0xa2426164df2c7d32 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6583 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783441514.870889:0:6583:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000e62c61d4/0xa2426164df2c7d32 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6583 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783441514.870897:0:6583:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000e62c61d4/0xa2426164df2c7d32 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6583 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783441514.870956:0:6583:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000e62c61d4/0xa2426164df2c7d32 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6583 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783441514.871571:0:6583:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000e62c61d4/0xa2426164df2c7d32 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6583 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783441514.871586:0:6583:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000e62c61d4/0xa2426164df2c7d32 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6583 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783441514.871593:0:6583:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91a87da47200 already unused, calling callback (ffffffffc155ff90) 00010000:00010000:1.0:1783441514.871597:0:6583:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000e62c61d4/0xa2426164df2c7d32 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6583 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783441514.871606:0:6583:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000e62c61d4/0xa2426164df2c7d32 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6583 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783441514.871628:0:6583:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000e62c61d4/0xa2426164df2c7d32 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6583 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783441514.871636:0:6583:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000e62c61d4/0xa2426164df2c7d32 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6583 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783441514.871846:0:6583:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a87da6b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:65454767-383a-4679-a788-eba05c6e0989+6:2355:x1870073673329792:12345-192.168.201.13@tcp:1:lhsmtool_posix.0 Request processed in 18430us (18625us total) trans 0 rc 0/0 00000100:00100000:1.0:1783441514.871855:0:6583:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.13@tcp, seq: 33 00000100:00100000:2.0:1783441514.888910:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.13@tcp (source: 12345-192.168.201.13@tcp) 00000100:00100000:3.0:1783441514.889274:0:5787:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073673330176 00000100:00100000:3.0:1783441514.889285:0:5787:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073673330176 00000100:00100000:3.0:1783441514.889395:0:5787:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.13@tcp, seq: 83 00000100:00100000:3.0:1783441514.889406:0:5787:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a875367480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:65454767-383a-4679-a788-eba05c6e0989+12:10415:x1870073673330176:12345-192.168.201.13@tcp:57:lhsmtool_posix.0 00010000:00010000:3.0:1783441514.889487:0:5787:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff91a841477e00/0xa2426164df2c7d39 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783441514.889533:0:5787:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91a841477e00/0xa2426164df2c7d39 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783441514.889547:0:5787:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91a841477e00/0xa2426164df2c7d39 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783441514.889825:0:5787:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff91a841476800/0xa2426164df2c7d40 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x6:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783441514.889838:0:5787:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff91a841476e00/0xa2426164df2c7cf3 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.13@tcp remote: 0x633a354aa4df4e46 expref: 13 pid: 6605 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783441514.889847:0:5787:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff91a841476800/0xa2426164df2c7d40 lrc: 4/0,1 mode: --/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783441514.889883:0:5787:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff91a841476e00/0xa2426164df2c7cf3 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.201.13@tcp remote: 0x633a354aa4df4e46 expref: 13 pid: 6605 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783441514.889914:0:5787:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff91a841476e00/0xa2426164df2c7cf3 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.201.13@tcp remote: 0x633a354aa4df4e46 expref: 13 pid: 6605 timeout: 452 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783441514.889930:0:5787:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff91a875424a80 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5787:1870073693278080:192.168.201.13@tcp:104: 00000100:00100000:3.0:1783441514.890034:0:5787:0:(client.c:2702:ptlrpc_set_wait()) set ffff91a8504a3cc0 going to sleep for 11 seconds 00000100:00100000:3.0:1783441514.899311:0:5787:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff91a875424a80 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5787:1870073693278080:192.168.201.13@tcp:104: 00010000:00010000:3.0:1783441514.899343:0:5787:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff91a841476800/0xa2426164df2c7d40 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783441514.902927:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.13@tcp (source: 12345-192.168.201.13@tcp) 00000100:00100000:0.0:1783441514.903617:0:11015:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073673330304 00000100:00100000:0.0:1783441514.903628:0:11015:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073673330304 00010000:00010000:0.0:1783441514.903673:0:11015:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff91a841476e00/0xa2426164df2c7cf3 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.201.13@tcp remote: 0x633a354aa4df4e46 expref: 14 pid: 6605 timeout: 452 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783441514.903715:0:11015:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.13@tcp, seq: 45 00000100:00100000:0.0:1783441514.903724:0:11015:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a875367b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:65454767-383a-4679-a788-eba05c6e0989+14:2354:x1870073673330304:12345-192.168.201.13@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1783441514.903738:0:11015:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1783441514.903767:0:11015:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff91a841476e00/0xa2426164df2c7cf3 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.201.13@tcp remote: 0x633a354aa4df4e46 expref: 14 pid: 6605 timeout: 452 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783441514.903800:0:11015:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff91a841476e00/0xa2426164df2c7cf3 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.201.13@tcp remote: 0x633a354aa4df4e46 expref: 14 pid: 6605 timeout: 452 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783441514.903824:0:11015:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91a841476e00/0xa2426164df2c7cf3 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.201.13@tcp remote: 0x633a354aa4df4e46 expref: 14 pid: 6605 timeout: 452 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783441514.903845:0:11015:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff91a85faeea00) 00010000:00010000:0.0:1783441514.903849:0:11015:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff91a841476800/0xa2426164df2c7d40 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783441514.903859:0:11015:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff91a841476800/0xa2426164df2c7d40 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783441514.903866:0:11015:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91a841476800/0xa2426164df2c7d40 lrc: 4/0,1 mode: EX/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783441514.903906:0:11015:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1783441514.903979:0:11015:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a875367b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:65454767-383a-4679-a788-eba05c6e0989+13:2354:x1870073673330304:12345-192.168.201.13@tcp:103:ldlm_bl.0 Request processed in 244us (1050us total) trans 0 rc 0/0 00000100:00100000:0.0:1783441514.903987:0:11015:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.13@tcp, seq: 45 00010000:00010000:3.0:1783441514.904112:0:5787:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff91a841476800/0xa2426164df2c7d40 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783441514.904128:0:5787:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91a841476800/0xa2426164df2c7d40 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1783441514.904342:0:5787:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967357 00000001:00080000:3.0:1783441514.904492:0:5787:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967358 00000001:00080000:3.0:1783441514.904540:0:5787:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967359 00000100:00100000:3.0:1783441514.904622:0:5787:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff91a875424a80 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-mdtlov_UUID:5787:1870073693278208:0@lo:1000:mdt00_002.0 00000100:00100000:3.0:1783441514.904679:0:5787:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783441514.904724:0:5787:0:(client.c:2702:ptlrpc_set_wait()) set ffff91a8501ff840 going to sleep for 11 seconds 00000100:00100000:0.0:1783441514.905999:0:5790:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073693278208 00000100:00100000:0.0:1783441514.906012:0:5790:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073693278208 00000100:00100000:0.0:1783441514.906064:0:5790:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1783441514.906074:0:5790:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a875426a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:5787:x1870073693278208:12345-0@lo:1000:mdt00_002.0 00000100:00100000:0.0:1783441514.906192:0:5790:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a875426a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:5787:x1870073693278208:12345-0@lo:1000:mdt00_002.0 Request processed in 118us (1512us total) trans 0 rc 0/0 00000100:00100000:0.0:1783441514.906199:0:5790:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1783441514.907003:0:5787:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967303 gen 2 00000004:00080000:3.0:1783441514.907012:0:5787:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff91a87d681c00, transno 4294967303 00000100:00100000:3.0:1783441514.907083:0:5787:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff91a875424a80 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-mdtlov_UUID:5787:1870073693278208:0@lo:1000:mdt00_002.0 00000001:00080000:2.0:1783441514.913400:0:5787:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967360 00000100:00100000:2.0:1783441514.913519:0:5787:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff91a875365180 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-mdtlov_UUID:5787:1870073693278336:0@lo:1000:mdt00_002.0 00000100:00100000:2.0:1783441514.913586:0:5787:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783441514.913662:0:5787:0:(client.c:2702:ptlrpc_set_wait()) set ffff91a87d4cce40 going to sleep for 11 seconds 00000100:00100000:0.0:1783441514.914145:0:5790:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073693278336 00000100:00100000:0.0:1783441514.914155:0:5790:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073693278336 00000100:00100000:0.0:1783441514.914368:0:5790:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1783441514.914379:0:5790:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a875366d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:5787:x1870073693278336:12345-0@lo:1000:mdt00_002.0 00000100:00100000:0.0:1783441514.914610:0:5790:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a875366d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:5787:x1870073693278336:12345-0@lo:1000:mdt00_002.0 Request processed in 232us (1023us total) trans 4294967305 rc 0/0 00000100:00100000:0.0:1783441514.914617:0:5790:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1783441514.914705:0:5787:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff91a875365180 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-mdtlov_UUID:5787:1870073693278336:0@lo:1000:mdt00_002.0 00010000:00010000:2.0:1783441514.914777:0:5787:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff91a841476800/0xa2426164df2c7d40 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783441514.914787:0:5787:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff91a841476800/0xa2426164df2c7d40 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783441514.914794:0:5787:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff91a841476800/0xa2426164df2c7d40 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783441514.914800:0:5787:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91a841476800 already unused, calling callback (ffffffffc1f9b4f0) 00010000:00010000:2.0:1783441514.914805:0:5787:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91a841476800/0xa2426164df2c7d40 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783441514.914811:0:5787:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91a841476800/0xa2426164df2c7d40 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783441514.914827:0:5787:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff91a85faeea00) 00010000:00010000:2.0:1783441514.914844:0:5787:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1783441514.914850:0:5787:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff91a841476800/0xa2426164df2c7d40 lrc: 2/0,0 mode: --/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783441514.914856:0:5787:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91a841476800/0xa2426164df2c7d40 lrc: 0/0,0 mode: --/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783441514.914906:0:5787:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff91a85f83c000/0xa2426164df2c7c6e lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6605 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783441514.914912:0:5787:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff91a85f83c000/0xa2426164df2c7c6e lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6605 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783441514.914917:0:5787:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff91a85f83c000/0xa2426164df2c7c6e lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6605 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783441514.914922:0:5787:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91a85f83c000 already unused, calling callback (ffffffffc1f9b4f0) 00010000:00010000:2.0:1783441514.914925:0:5787:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91a85f83c000/0xa2426164df2c7c6e lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6605 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783441514.914930:0:5787:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91a85f83c000/0xa2426164df2c7c6e lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6605 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783441514.914938:0:5787:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff91a8429bd000) 00010000:00010000:2.0:1783441514.914940:0:5787:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1783441514.914944:0:5787:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff91a85f83c000/0xa2426164df2c7c6e lrc: 2/0,0 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6605 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783441514.914949:0:5787:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91a85f83c000/0xa2426164df2c7c6e lrc: 0/0,0 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6605 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783441514.914989:0:5787:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff91a85f83cc00/0xa2426164df2c7d47 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783441514.915017:0:5787:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff91a87da46000/0xa2426164df2c7c8a lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.13@tcp remote: 0x633a354aa4df4e2a expref: 16 pid: 5787 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783441514.915026:0:5787:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff91a85f83cc00/0xa2426164df2c7d47 lrc: 4/0,1 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783441514.915058:0:5787:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff91a87da46000/0xa2426164df2c7c8a lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.13@tcp remote: 0x633a354aa4df4e2a expref: 16 pid: 5787 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783441514.915072:0:5787:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff91a87da46000/0xa2426164df2c7c8a lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.13@tcp remote: 0x633a354aa4df4e2a expref: 16 pid: 5787 timeout: 452 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783441514.915085:0:5787:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff91a875366a00 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5787:1870073693278464:192.168.201.13@tcp:104: 00000100:00100000:2.0:1783441514.915156:0:5787:0:(client.c:2702:ptlrpc_set_wait()) set ffff91a87d4cce40 going to sleep for 11 seconds 00000100:00100000:3.0:1783441514.920626:0:5787:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff91a875366a00 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5787:1870073693278464:192.168.201.13@tcp:104: 00010000:00010000:3.0:1783441514.920665:0:5787:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff91a85f83cc00/0xa2426164df2c7d47 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783441514.924641:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.13@tcp (source: 12345-192.168.201.13@tcp) 00000100:00100000:3.0:1783441514.924728:0:5770:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073673330432 00000100:00100000:3.0:1783441514.924773:0:5770:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073673330432 00010000:00010000:3.0:1783441514.924816:0:5770:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff91a87da46000/0xa2426164df2c7c8a lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.13@tcp remote: 0x633a354aa4df4e2a expref: 17 pid: 5787 timeout: 452 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783441514.924848:0:5770:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.13@tcp, seq: 46 00000100:00100000:3.0:1783441514.924858:0:5770:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a875365f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:65454767-383a-4679-a788-eba05c6e0989+17:2354:x1870073673330432:12345-192.168.201.13@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1783441514.924871:0:5770:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1783441514.924877:0:5770:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff91a87da46000/0xa2426164df2c7c8a lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.13@tcp remote: 0x633a354aa4df4e2a expref: 17 pid: 5787 timeout: 452 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783441514.924910:0:5770:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff91a87da46000/0xa2426164df2c7c8a lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.13@tcp remote: 0x633a354aa4df4e2a expref: 17 pid: 5787 timeout: 452 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783441514.924933:0:5770:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91a87da46000/0xa2426164df2c7c8a lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.13@tcp remote: 0x633a354aa4df4e2a expref: 17 pid: 5787 timeout: 452 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783441514.924951:0:5770:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff91a8429bd000) 00010000:00010000:3.0:1783441514.924957:0:5770:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff91a85f83cc00/0xa2426164df2c7d47 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783441514.924975:0:5770:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff91a85f83cc00/0xa2426164df2c7d47 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783441514.924983:0:5770:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91a85f83cc00/0xa2426164df2c7d47 lrc: 4/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783441514.925014:0:5770:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1783441514.925081:0:5770:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a875365f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:65454767-383a-4679-a788-eba05c6e0989+16:2354:x1870073673330432:12345-192.168.201.13@tcp:103:ldlm_bl.0 Request processed in 223us (449us total) trans 0 rc 0/0 00000100:00100000:3.0:1783441514.925089:0:5770:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.13@tcp, seq: 46 00010000:00010000:2.0:1783441514.925715:0:5787:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff91a85f83cc00/0xa2426164df2c7d47 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783441514.925726:0:5787:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91a85f83cc00/0xa2426164df2c7d47 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783441514.925770:0:5787:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff91a85f83cc00/0xa2426164df2c7d47 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783441514.925777:0:5787:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff91a85f83cc00/0xa2426164df2c7d47 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783441514.925784:0:5787:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff91a85f83cc00/0xa2426164df2c7d47 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783441514.925803:0:5787:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91a85f83cc00 already unused, calling callback (ffffffffc1f9b4f0) 00010000:00010000:2.0:1783441514.925807:0:5787:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91a85f83cc00/0xa2426164df2c7d47 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783441514.925815:0:5787:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91a85f83cc00/0xa2426164df2c7d47 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783441514.925827:0:5787:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff91a8429bd000) 00010000:00010000:2.0:1783441514.925830:0:5787:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1783441514.925834:0:5787:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff91a85f83cc00/0xa2426164df2c7d47 lrc: 2/0,0 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783441514.925840:0:5787:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91a85f83cc00/0xa2426164df2c7d47 lrc: 0/0,0 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783441514.925854:0:5787:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff91a841477e00/0xa2426164df2c7d39 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783441514.925860:0:5787:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff91a841477e00/0xa2426164df2c7d39 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783441514.925866:0:5787:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff91a841477e00/0xa2426164df2c7d39 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783441514.925871:0:5787:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91a841477e00 already unused, calling callback (ffffffffc1f9b4f0) 00010000:00010000:2.0:1783441514.925874:0:5787:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91a841477e00/0xa2426164df2c7d39 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783441514.925880:0:5787:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91a841477e00/0xa2426164df2c7d39 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783441514.925908:0:5787:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff91a8429bd000) 00010000:00010000:2.0:1783441514.925911:0:5787:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:2.0:1783441514.925914:0:5787:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff91a841477e00/0xa2426164df2c7d39 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783441514.925920:0:5787:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91a841477e00/0xa2426164df2c7d39 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783441514.926145:0:5787:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a875367480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:65454767-383a-4679-a788-eba05c6e0989+15:10415:x1870073673330176:12345-192.168.201.13@tcp:57:lhsmtool_posix.0 Request processed in 36738us (37253us total) trans 4294967361 rc 0/0 00000100:00100000:2.0:1783441514.926154:0:5787:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.13@tcp, seq: 83 00000020:00080000:2.0:1783441514.926158:0:5787:0:(tgt_main.c:784:tgt_ses_key_exit()) total 5 transactions per RPC 00000040:00080000:3.0:1783441514.926449:0:11531:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:3.0:1783441514.926453:0:11531:0:(llog_cat.c:841:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1783441514.926476:0:11531:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 2 count 2 00000040:00080000:3.0:1783441514.926481:0:11531:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:2.0:1783441514.932659:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.13@tcp (source: 12345-192.168.201.13@tcp) 00000100:00100000:1.0:1783441514.932852:0:5788:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073673330688 00000100:00100000:1.0:1783441514.932865:0:5788:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073673330688 00000100:00100000:1.0:1783441514.932936:0:5788:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.13@tcp, seq: 20 00000100:00100000:1.0:1783441514.932948:0:5788:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a875364e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:65454767-383a-4679-a788-eba05c6e0989+15:10415:x1870073673330688:12345-192.168.201.13@tcp:35:lhsmtool_posix.0 00000004:00080000:1.0:1783441514.934068:0:5788:0:(mdd_object.c:4010:mdd_close()) Object [0x200000401:0x6:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000001:00080000:1.0:1783441514.934204:0:5788:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967362 00010000:00010000:1.0:1783441514.934502:0:5788:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff91a87da47c00/0xa2426164df2c7d4e lrc: 3/0,1 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783441514.934520:0:5788:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91a87da47c00/0xa2426164df2c7d4e lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010080000000 pid: 5788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783441514.934531:0:5788:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91a87da47c00/0xa2426164df2c7d4e lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010080000000 pid: 5788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783441514.934540:0:5788:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff91a87da47c00/0xa2426164df2c7d4e lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010080000000 pid: 5788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783441514.934546:0:5788:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff91a87da47c00/0xa2426164df2c7d4e lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010480000000 pid: 5788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783441514.934552:0:5788:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff91a87da47c00/0xa2426164df2c7d4e lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010480000000 pid: 5788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783441514.934623:0:5788:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:1.0:1783441514.934769:0:5788:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a875364e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:65454767-383a-4679-a788-eba05c6e0989+17:10415:x1870073673330688:12345-192.168.201.13@tcp:35:lhsmtool_posix.0 Request processed in 1795us (2093us total) trans 4294967363 rc 0/0 00000100:00100000:1.0:1783441514.934779:0:5788:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.13@tcp, seq: 20 00000020:00080000:1.0:1783441514.934784:0:5788:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:0.0:1783441514.940477:0:5773:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1783441514.940498:0:5773:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff91a87da47c00/0xa2426164df2c7d4e lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783441514.940510:0:5773:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91a87da47c00 already unused, calling callback (ffffffffc155ff90) 00010000:00010000:0.0:1783441514.940516:0:5773:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91a87da47c00/0xa2426164df2c7d4e lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783441514.940527:0:5773:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91a87da47c00/0xa2426164df2c7d4e lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 5788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783441514.940553:0:5773:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff91a858b90200) 00010000:00010000:0.0:1783441514.940557:0:5773:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:0.0:1783441514.940564:0:5773:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff91a87da47c00/0xa2426164df2c7d4e lrc: 1/0,0 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783441514.940570:0:5773:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91a87da47c00/0xa2426164df2c7d4e lrc: 0/0,0 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783441514.940600:0:5773:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783441514.940602:0:5773:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783441514.940604:0:5773:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783441515.654717:0:5772:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:3.0:1783441516.519264:0:7492:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967299 is committed 00000001:00080000:3.0:1783441516.519648:0:7492:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967300 is committed 00000001:00080000:3.0:1783441516.519655:0:7492:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967301 is committed 00000040:00080000:0.0:1783441516.564085:0:11900:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:0.0:1783441516.564097:0:11900:0:(llog_cat.c:841:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1783441516.564248:0:11900:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 2 count 2 00000040:00080000:0.0:1783441516.564255:0:11900:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00010000:00010000:0.0:1783441516.717394:0:5773:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1783441516.803583:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.13@tcp (source: 12345-192.168.201.13@tcp) 00000100:00100000:1.0:1783441516.804387:0:6605:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073673330944 00000100:00100000:1.0:1783441516.804397:0:6605:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073673330944 00000100:00100000:1.0:1783441516.804469:0:6605:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.13@tcp, seq: 84 00000100:00100000:1.0:1783441516.804480:0:6605:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a875366a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:65454767-383a-4679-a788-eba05c6e0989+17:10434:x1870073673330944:12345-192.168.201.13@tcp:101:lfs.0 00010000:00010000:1.0:1783441516.804505:0:6605:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1783441516.804526:0:6605:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91a87da47200/0xa2426164df2c7d55 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x633a354aa4df4e62 expref: -99 pid: 6605 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783441516.804804:0:6605:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff91a87da47e00/0xa2426164df2c7d5c lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6605 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783441516.804820:0:6605:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91a87da47e00/0xa2426164df2c7d5c lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6605 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783441516.804832:0:6605:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91a87da47e00/0xa2426164df2c7d5c lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6605 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1783441516.804845:0:6605:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x3:0x0]: returning size 7680 00010000:00010000:1.0:1783441516.805034:0:6605:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91a87da47200/0xa2426164df2c7d55 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.13@tcp remote: 0x633a354aa4df4e62 expref: 20 pid: 6605 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783441516.805055:0:6605:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff91a87da47e00/0xa2426164df2c7d5c lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.13@tcp remote: 0x633a354aa4df4e62 expref: 19 pid: 6605 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783441516.805066:0:6605:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff91a8439b0300) 00010000:00010000:1.0:1783441516.805070:0:6605:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:1.0:1783441516.805074:0:6605:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91a87da47e00, rc 0) 00000100:00100000:1.0:1783441516.805153:0:6605:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a875366a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:65454767-383a-4679-a788-eba05c6e0989+19:10434:x1870073673330944:12345-192.168.201.13@tcp:101:lfs.0 Request processed in 674us (1580us total) trans 4294967364 rc 0/0 00000100:00100000:1.0:1783441516.805160:0:6605:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.13@tcp, seq: 84 00000100:00080000:3.0:1783441516.806843:0:5781:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1783441516.818075:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.13@tcp (source: 12345-192.168.201.13@tcp) 00000100:00100000:1.0:1783441516.818182:0:5785:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073673331072 00000100:00100000:1.0:1783441516.818205:0:5785:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073673331072 00000100:00100000:1.0:1783441516.818268:0:5785:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.13@tcp, seq: 85 00000100:00100000:1.0:1783441516.818278:0:5785:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a87d6f0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:65454767-383a-4679-a788-eba05c6e0989+19:10434:x1870073673331072:12345-192.168.201.13@tcp:34:lfs.0 00010000:00010000:1.0:1783441516.818358:0:5785:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff91a87da47200/0xa2426164df2c7d6a lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783441516.818375:0:5785:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91a87da47200/0xa2426164df2c7d6a lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783441516.818388:0:5785:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91a87da47200/0xa2426164df2c7d6a lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783441516.818404:0:5785:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff91a87da46600/0xa2426164df2c7d71 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783441516.818412:0:5785:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91a87da46600/0xa2426164df2c7d71 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783441516.818419:0:5785:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91a87da46600/0xa2426164df2c7d71 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783441516.818715:0:5785:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff91a87da47800/0xa2426164df2c7d78 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783441516.818724:0:5785:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91a87da47800/0xa2426164df2c7d78 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783441516.818731:0:5785:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91a87da47800/0xa2426164df2c7d78 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1783441516.818794:0:5785:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff91a87da47800/0xa2426164df2c7d78 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783441516.818818:0:5785:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff91a87da47200/0xa2426164df2c7d6a lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783441516.818823:0:5785:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff91a87da47200/0xa2426164df2c7d6a lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783441516.818830:0:5785:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff91a87da47200/0xa2426164df2c7d6a lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783441516.818835:0:5785:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91a87da47200 already unused, calling callback (ffffffffc1f9b4f0) 00010000:00010000:1.0:1783441516.818839:0:5785:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91a87da47200/0xa2426164df2c7d6a lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783441516.818846:0:5785:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91a87da47200/0xa2426164df2c7d6a lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783441516.818858:0:5785:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff91a8439b0300) 00010000:00010000:1.0:1783441516.818861:0:5785:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1783441516.818865:0:5785:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff91a87da47200/0xa2426164df2c7d6a lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783441516.818870:0:5785:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91a87da47200/0xa2426164df2c7d6a lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783441516.818883:0:5785:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff91a87da46600/0xa2426164df2c7d71 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783441516.818888:0:5785:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff91a87da46600/0xa2426164df2c7d71 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783441516.818893:0:5785:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff91a87da46600/0xa2426164df2c7d71 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783441516.818903:0:5785:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91a87da46600 already unused, calling callback (ffffffffc1f9b4f0) 00010000:00010000:1.0:1783441516.818906:0:5785:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91a87da46600/0xa2426164df2c7d71 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783441516.818912:0:5785:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91a87da46600/0xa2426164df2c7d71 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783441516.818920:0:5785:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff91a858b90b00) 00010000:00010000:1.0:1783441516.818923:0:5785:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1783441516.818926:0:5785:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff91a87da46600/0xa2426164df2c7d71 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783441516.818932:0:5785:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91a87da46600/0xa2426164df2c7d71 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783441516.818957:0:5785:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff91a87da47800/0xa2426164df2c7d78 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783441516.818963:0:5785:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff91a87da47800/0xa2426164df2c7d78 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783441516.818969:0:5785:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff91a87da47800/0xa2426164df2c7d78 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783441516.818974:0:5785:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91a87da47800 already unused, calling callback (ffffffffc1f9b4f0) 00010000:00010000:1.0:1783441516.818977:0:5785:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91a87da47800/0xa2426164df2c7d78 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783441516.818984:0:5785:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91a87da47800/0xa2426164df2c7d78 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783441516.819001:0:5785:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff91a858b90800) 00010000:00010000:1.0:1783441516.819004:0:5785:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1783441516.819007:0:5785:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff91a87da47800/0xa2426164df2c7d78 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783441516.819012:0:5785:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91a87da47800/0xa2426164df2c7d78 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783441516.819094:0:5785:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a87d6f0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:65454767-383a-4679-a788-eba05c6e0989+19:10434:x1870073673331072:12345-192.168.201.13@tcp:34:lfs.0 Request processed in 816us (1028us total) trans 0 rc 0/0 00000100:00100000:1.0:1783441516.819107:0:5785:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.13@tcp, seq: 85 00000100:00100000:0.0:1783441516.886280:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.13@tcp (source: 12345-192.168.201.13@tcp) 00000100:00100000:1.0:1783441516.886383:0:6605:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073673331328 00000100:00100000:1.0:1783441516.886393:0:6605:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073673331328 00000100:00100000:1.0:1783441516.886462:0:6605:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.13@tcp, seq: 86 00000100:00100000:1.0:1783441516.886472:0:6605:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a867cd4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:65454767-383a-4679-a788-eba05c6e0989+19:10437:x1870073673331328:12345-192.168.201.13@tcp:101:lfs.0 00010000:00010000:1.0:1783441516.886491:0:6605:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1783441516.886512:0:6605:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91a87da47800/0xa2426164df2c7d7f lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x633a354aa4df4e69 expref: -99 pid: 6605 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783441516.886585:0:6605:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff91a87da46600/0xa2426164df2c7d86 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6605 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783441516.886598:0:6605:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91a87da46600/0xa2426164df2c7d86 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6605 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783441516.886609:0:6605:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91a87da46600/0xa2426164df2c7d86 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6605 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783441516.886624:0:6605:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff91a87da47200/0xa2426164df2c7d8d lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6605 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783441516.886647:0:6605:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91a87da47200/0xa2426164df2c7d8d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6605 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783441516.886654:0:6605:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91a87da47200/0xa2426164df2c7d8d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6605 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783441516.887044:0:6605:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff91a87da46200/0xa2426164df2c7d94 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6605 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783441516.887051:0:6605:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91a87da46200/0xa2426164df2c7d94 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6605 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783441516.887056:0:6605:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91a87da46200/0xa2426164df2c7d94 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6605 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1783441516.887063:0:6605:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 9 00010000:00010000:1.0:1783441516.887154:0:6605:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff91a87da46600/0xa2426164df2c7d86 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6605 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783441516.887161:0:6605:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff91a87da46600/0xa2426164df2c7d86 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6605 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783441516.887167:0:6605:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff91a87da46600/0xa2426164df2c7d86 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6605 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783441516.887173:0:6605:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91a87da46600 already unused, calling callback (ffffffffc1f9b4f0) 00010000:00010000:1.0:1783441516.887177:0:6605:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91a87da46600/0xa2426164df2c7d86 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6605 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783441516.887184:0:6605:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91a87da46600/0xa2426164df2c7d86 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6605 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783441516.887207:0:6605:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff91a8439b0300) 00010000:00010000:1.0:1783441516.887210:0:6605:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1783441516.887214:0:6605:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff91a87da46600/0xa2426164df2c7d86 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6605 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783441516.887220:0:6605:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91a87da46600/0xa2426164df2c7d86 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6605 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783441516.887234:0:6605:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff91a87da47200/0xa2426164df2c7d8d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6605 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783441516.887240:0:6605:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff91a87da47200/0xa2426164df2c7d8d lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6605 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783441516.887245:0:6605:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff91a87da47200/0xa2426164df2c7d8d lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6605 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783441516.887250:0:6605:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91a87da47200 already unused, calling callback (ffffffffc1f9b4f0) 00010000:00010000:1.0:1783441516.887252:0:6605:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91a87da47200/0xa2426164df2c7d8d lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6605 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783441516.887258:0:6605:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91a87da47200/0xa2426164df2c7d8d lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6605 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783441516.887265:0:6605:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff91a858b90800) 00010000:00010000:1.0:1783441516.887267:0:6605:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1783441516.887270:0:6605:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff91a87da47200/0xa2426164df2c7d8d lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6605 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783441516.887275:0:6605:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91a87da47200/0xa2426164df2c7d8d lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6605 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783441516.887318:0:6605:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91a87da47800/0xa2426164df2c7d7f lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.13@tcp remote: 0x633a354aa4df4e69 expref: 22 pid: 6605 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783441516.887326:0:6605:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff91a87da46200/0xa2426164df2c7d94 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.13@tcp remote: 0x633a354aa4df4e69 expref: 21 pid: 6605 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783441516.887331:0:6605:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff91a858b90b00) 00010000:00010000:1.0:1783441516.887333:0:6605:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1783441516.887334:0:6605:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91a87da46200, rc 0) 00000100:00100000:1.0:1783441516.887490:0:6605:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a867cd4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:65454767-383a-4679-a788-eba05c6e0989+21:10437:x1870073673331328:12345-192.168.201.13@tcp:101:lfs.0 Request processed in 1019us (1218us total) trans 4294967365 rc 0/0 00000100:00100000:1.0:1783441516.887495:0:6605:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.13@tcp, seq: 86 00000100:00100000:0.0:1783441516.896198:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.13@tcp (source: 12345-192.168.201.13@tcp) 00000100:00100000:1.0:1783441516.898886:0:5785:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073673331456 00000100:00100000:1.0:1783441516.898904:0:5785:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073673331456 00000100:00100000:1.0:1783441516.898999:0:5785:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.13@tcp, seq: 87 00000100:00100000:1.0:1783441516.899012:0:5785:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a867cd6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:65454767-383a-4679-a788-eba05c6e0989+21:10437:x1870073673331456:12345-192.168.201.13@tcp:54:lfs.0 00010000:00010000:1.0:1783441516.899087:0:5785:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff91a87da47800/0xa2426164df2c7da2 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783441516.899104:0:5785:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91a87da47800/0xa2426164df2c7da2 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783441516.899115:0:5785:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91a87da47800/0xa2426164df2c7da2 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783441516.899145:0:5785:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff91a87da47800/0xa2426164df2c7da2 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783441516.899170:0:5785:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff91a87da47800/0xa2426164df2c7da2 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783441516.899177:0:5785:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff91a87da47800/0xa2426164df2c7da2 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783441516.899182:0:5785:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91a87da47800 already unused, calling callback (ffffffffc1f9b4f0) 00010000:00010000:1.0:1783441516.899186:0:5785:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91a87da47800/0xa2426164df2c7da2 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783441516.899194:0:5785:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91a87da47800/0xa2426164df2c7da2 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783441516.899206:0:5785:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff91a858b90b00) 00010000:00010000:1.0:1783441516.899209:0:5785:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1783441516.899213:0:5785:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff91a87da47800/0xa2426164df2c7da2 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783441516.899218:0:5785:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91a87da47800/0xa2426164df2c7da2 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783441516.899309:0:5785:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a867cd6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:65454767-383a-4679-a788-eba05c6e0989+21:10437:x1870073673331456:12345-192.168.201.13@tcp:54:lfs.0 Request processed in 300us (3120us total) trans 0 rc 0/0 00000100:00100000:1.0:1783441516.899317:0:5785:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.13@tcp, seq: 87 00000100:00100000:2.0:1783441516.907206:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.13@tcp (source: 12345-192.168.201.13@tcp) 00000100:00100000:0.0:1783441516.907369:0:5789:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073673331712 00000100:00100000:0.0:1783441516.907379:0:5789:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073673331712 00000100:00100000:0.0:1783441516.907438:0:5789:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.13@tcp, seq: 21 00000100:00100000:0.0:1783441516.907448:0:5789:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a8468ab050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:65454767-383a-4679-a788-eba05c6e0989+21:10437:x1870073673331712:12345-192.168.201.13@tcp:35:lfs.0 00000100:00100000:0.0:1783441516.907710:0:5789:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a8468ab050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:65454767-383a-4679-a788-eba05c6e0989+22:10437:x1870073673331712:12345-192.168.201.13@tcp:35:lfs.0 Request processed in 263us (514us total) trans 4294967366 rc 0/0 00000100:00100000:0.0:1783441516.907718:0:5789:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.13@tcp, seq: 21 00000100:00100000:0.0:1783441516.959413:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.13@tcp (source: 12345-192.168.201.13@tcp) 00000100:00100000:3.0:1783441516.959502:0:5786:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073673331968 00000100:00100000:3.0:1783441516.959514:0:5786:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073673331968 00000100:00100000:3.0:1783441516.959577:0:5786:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.13@tcp, seq: 88 00000100:00100000:3.0:1783441516.959586:0:5786:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a867cd7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:65454767-383a-4679-a788-eba05c6e0989+22:9958:x1870073673331968:12345-192.168.201.13@tcp:101:bash.0 00010000:00010000:3.0:1783441516.959611:0:5786:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1783441516.959631:0:5786:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91a841477200/0xa2426164df2c7da9 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x633a354aa4df4e70 expref: -99 pid: 5786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783441516.959732:0:5786:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff91a841477c00/0xa2426164df2c7db0 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783441516.959781:0:5786:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff91a87da46200/0xa2426164df2c7d94 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.13@tcp remote: 0x633a354aa4df4e69 expref: 23 pid: 6605 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783441516.959791:0:5786:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff91a841477c00/0xa2426164df2c7db0 lrc: 4/0,1 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783441516.959827:0:5786:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff91a87da46200/0xa2426164df2c7d94 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.13@tcp remote: 0x633a354aa4df4e69 expref: 23 pid: 6605 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783441516.959839:0:5786:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff91a87da46200/0xa2426164df2c7d94 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.13@tcp remote: 0x633a354aa4df4e69 expref: 23 pid: 6605 timeout: 454 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783441516.959853:0:5786:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff91a875424a80 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5786:1870073693278592:192.168.201.13@tcp:104: 00000100:00100000:3.0:1783441516.960087:0:5786:0:(client.c:2702:ptlrpc_set_wait()) set ffff91a7410c8600 going to sleep for 11 seconds 00000100:00100000:3.0:1783441516.964497:0:5786:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff91a875424a80 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5786:1870073693278592:192.168.201.13@tcp:104: 00010000:00010000:3.0:1783441516.964537:0:5786:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff91a841477c00/0xa2426164df2c7db0 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783441516.966215:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.13@tcp (source: 12345-192.168.201.13@tcp) 00000100:00100000:3.0:1783441516.966496:0:5769:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073673332096 00000100:00100000:3.0:1783441516.966505:0:5769:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073673332096 00010000:00010000:3.0:1783441516.966552:0:5769:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff91a87da46200/0xa2426164df2c7d94 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.13@tcp remote: 0x633a354aa4df4e69 expref: 24 pid: 6605 timeout: 454 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783441516.966593:0:5769:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.13@tcp, seq: 47 00000100:00100000:3.0:1783441516.966602:0:5769:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a867cd6a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:65454767-383a-4679-a788-eba05c6e0989+24:2354:x1870073673332096:12345-192.168.201.13@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1783441516.966616:0:5769:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1783441516.966623:0:5769:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff91a87da46200/0xa2426164df2c7d94 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.13@tcp remote: 0x633a354aa4df4e69 expref: 24 pid: 6605 timeout: 454 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783441516.966635:0:5769:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff91a87da46200/0xa2426164df2c7d94 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.13@tcp remote: 0x633a354aa4df4e69 expref: 24 pid: 6605 timeout: 454 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783441516.966658:0:5769:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91a87da46200/0xa2426164df2c7d94 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.13@tcp remote: 0x633a354aa4df4e69 expref: 24 pid: 6605 timeout: 454 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783441516.966678:0:5769:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff91a858b90b00) 00010000:00010000:3.0:1783441516.966683:0:5769:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff91a841477c00/0xa2426164df2c7db0 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783441516.966692:0:5769:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff91a841477c00/0xa2426164df2c7db0 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783441516.966699:0:5769:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91a841477c00/0xa2426164df2c7db0 lrc: 4/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783441516.966832:0:5769:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1783441516.966914:0:5769:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a867cd6a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:65454767-383a-4679-a788-eba05c6e0989+23:2354:x1870073673332096:12345-192.168.201.13@tcp:103:ldlm_bl.0 Request processed in 311us (705us total) trans 0 rc 0/0 00000100:00100000:3.0:1783441516.966921:0:5769:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.13@tcp, seq: 47 00010000:00010000:2.0:1783441516.968804:0:5786:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff91a841477c00/0xa2426164df2c7db0 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783441516.968820:0:5786:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91a841477c00/0xa2426164df2c7db0 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1783441516.968844:0:5786:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 9 00010000:00010000:2.0:1783441516.969054:0:5786:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91a841477200/0xa2426164df2c7da9 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.13@tcp remote: 0x633a354aa4df4e70 expref: 24 pid: 5786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783441516.969076:0:5786:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff91a841477c00/0xa2426164df2c7db0 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.13@tcp remote: 0x633a354aa4df4e70 expref: 23 pid: 5786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783441516.969103:0:5786:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff91a858b90b00) 00010000:00010000:2.0:1783441516.969107:0:5786:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:2.0:1783441516.969110:0:5786:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91a841477c00, rc 0) 00000100:00100000:2.0:1783441516.969182:0:5786:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a867cd7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:65454767-383a-4679-a788-eba05c6e0989+23:9958:x1870073673331968:12345-192.168.201.13@tcp:101:bash.0 Request processed in 9596us (9778us total) trans 4294967367 rc 0/0 00000100:00100000:2.0:1783441516.969190:0:5786:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.13@tcp, seq: 88 00000100:00100000:0.0:1783441516.973585:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.13@tcp (source: 12345-192.168.201.13@tcp) 00000100:00100000:2.0:1783441516.974162:0:5785:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073673332352 00000100:00100000:2.0:1783441516.974172:0:5785:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073673332352 00000100:00100000:2.0:1783441516.974271:0:5785:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.13@tcp, seq: 89 00000100:00100000:2.0:1783441516.974284:0:5785:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a867cd5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:65454767-383a-4679-a788-eba05c6e0989+23:9958:x1870073673332352:12345-192.168.201.13@tcp:36:bash.0 00010000:00010000:2.0:1783441516.974574:0:5785:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff91a85f83c600/0xa2426164df2c7dbe lrc: 3/0,1 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783441516.974591:0:5785:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91a85f83c600/0xa2426164df2c7dbe lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783441516.974604:0:5785:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91a85f83c600/0xa2426164df2c7dbe lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1783441516.974658:0:5785:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967368 00000004:00010000:2.0:1783441516.974683:0:5785:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000830c97bc reply state 00000000b66b7b34 transno 4294967369 ns: mdt-lustre-MDT0000_UUID lock: ffff91a85f83c600/0xa2426164df2c7dbe lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783441516.974692:0:5785:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000001:00080000:2.0:1783441516.974764:0:5785:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967369 00000100:00100000:2.0:1783441516.975211:0:5785:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a867cd5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:65454767-383a-4679-a788-eba05c6e0989+27:9958:x1870073673332352:12345-192.168.201.13@tcp:36:bash.0 Request processed in 929us (1636us total) trans 4294967370 rc 0/0 00000100:00100000:2.0:1783441516.975220:0:5785:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.13@tcp, seq: 89 00000020:00080000:2.0:1783441516.975240:0:5785:0:(tgt_main.c:784:tgt_ses_key_exit()) total 3 transactions per RPC 00000100:00100000:0.0:1783441516.979031:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.13@tcp (source: 12345-192.168.201.13@tcp) 00000100:00100000:3.0:1783441516.979701:0:6605:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073673332480 00000100:00100000:3.0:1783441516.979713:0:6605:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073673332480 00000100:00100000:3.0:1783441516.979813:0:6605:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.13@tcp, seq: 90 00000100:00100000:3.0:1783441516.979825:0:6605:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a875364e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:65454767-383a-4679-a788-eba05c6e0989+27:9958:x1870073673332480:12345-192.168.201.13@tcp:101:bash.0 00010000:00010000:3.0:1783441516.979848:0:6605:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1783441516.979879:0:6605:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91a841477e00/0xa2426164df2c7dc5 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x633a354aa4df4e77 expref: -99 pid: 6605 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783441516.979955:0:6605:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91a841477e00/0xa2426164df2c7dc5 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.201.13@tcp remote: 0x633a354aa4df4e77 expref: 28 pid: 6605 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783441516.979969:0:6605:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff91a841477e00/0xa2426164df2c7dc5 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.13@tcp remote: 0x633a354aa4df4e77 expref: 28 pid: 6605 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783441516.979988:0:6605:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff91a858b90b00) 00010000:00010000:3.0:1783441516.979992:0:6605:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1783441516.979996:0:6605:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91a841477e00, rc 0) 00000100:00100000:3.0:1783441516.980046:0:6605:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a875364e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:65454767-383a-4679-a788-eba05c6e0989+28:9958:x1870073673332480:12345-192.168.201.13@tcp:101:bash.0 Request processed in 224us (1028us total) trans 0 rc 0/0 00000100:00100000:3.0:1783441516.980054:0:6605:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.13@tcp, seq: 90 00010000:00010000:1.0:1783441516.983323:0:3289:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff91a85f83c600/0xa2426164df2c7dbe lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783441516.983338:0:3289:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff91a85f83c600/0xa2426164df2c7dbe lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783441516.983345:0:3289:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff91a85f83c600/0xa2426164df2c7dbe lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783441516.983364:0:3289:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91a85f83c600 already unused, calling callback (ffffffffc1f9b4f0) 00010000:00010000:1.0:1783441516.983370:0:3289:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91a85f83c600/0xa2426164df2c7dbe lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783441516.983378:0:3289:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91a85f83c600/0xa2426164df2c7dbe lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783441516.983394:0:3289:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff91a858b90b00) 00010000:00010000:1.0:1783441516.983397:0:3289:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1783441516.983401:0:3289:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff91a85f83c600/0xa2426164df2c7dbe lrc: 2/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783441516.983408:0:3289:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91a85f83c600/0xa2426164df2c7dbe lrc: 0/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783441516.983695:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.13@tcp (source: 12345-192.168.201.13@tcp) 00000100:00100000:1.0:1783441516.984136:0:6581:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073673332608 00000100:00100000:1.0:1783441516.984148:0:6581:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073673332608 00000100:00100000:1.0:1783441516.984224:0:6581:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.13@tcp, seq: 34 00000100:00100000:1.0:1783441516.984238:0:6581:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a8756a5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:65454767-383a-4679-a788-eba05c6e0989+6:9958:x1870073673332608:12345-192.168.201.13@tcp:101:bash.0 00010000:00010000:1.0:1783441516.984259:0:6581:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1783441516.984281:0:6581:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000009aa69062/0xa2426164df2c7dcc lrc: 2/0,0 mode: --/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x633a354aa4df4e7e expref: -99 pid: 6581 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1783441516.984305:0:6581:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x3:0x0] initial LVB size: 9, mtime: 0x6a4d286a, atime: 0x6a4d2867, ctime: 0x6a4d286a, blocks: 0xb 00010000:00010000:1.0:1783441516.984327:0:6581:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=354s v=(0 0) 00010000:00010000:1.0:1783441516.984331:0:6581:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1783441516.984340:0:6581:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000009aa69062/0xa2426164df2c7dcc lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080000000 nid: 192.168.201.13@tcp remote: 0x633a354aa4df4e7e expref: 7 pid: 6581 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783441516.984373:0:6581:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000009aa69062/0xa2426164df2c7dcc lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.201.13@tcp remote: 0x633a354aa4df4e7e expref: 7 pid: 6581 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783441516.984385:0:6581:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91a87da47800, rc 0) 00000100:00100000:1.0:1783441516.984439:0:6581:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a8756a5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:65454767-383a-4679-a788-eba05c6e0989+7:9958:x1870073673332608:12345-192.168.201.13@tcp:101:bash.0 Request processed in 205us (748us total) trans 0 rc 0/0 00000100:00100000:1.0:1783441516.984446:0:6581:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.13@tcp, seq: 34 00000100:00080000:0.0:1783441516.986208:0:5781:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1783441516.990438:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.13@tcp (source: 12345-192.168.201.13@tcp) 00000100:00100000:1.0:1783441516.990518:0:6586:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073673332736 00000100:00100000:1.0:1783441516.990529:0:6586:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073673332736 00002000:00010000:1.0:1783441516.990580:0:6586:0:(ofd_dev.c:2825:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 9663677440/3 (0->18446744073709551615) 00002000:00100000:1.0:1783441516.990586:0:6586:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff91a8756a7100 with x1870073673332736 ext(0->18446744073709551615) 00002000:00010000:1.0:1783441516.990599:0:6586:0:(ofd_dev.c:2830:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff91a8756a7100. 00000100:00100000:1.0:1783441516.990636:0:6586:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.13@tcp, seq: 1 00000100:00100000:1.0:1783441516.990647:0:6586:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a8756a7100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:65454767-383a-4679-a788-eba05c6e0989+7:2354:x1870073673332736:12345-192.168.201.13@tcp:10:bash.0 00002000:00010000:1.0:1783441516.991057:0:6586:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x3:0x0] updating lvb size from disk: 9 -> 0 00002000:00010000:1.0:1783441516.991061:0:6586:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x240000400:0x3:0x0] updating lvb mtime from disk: 1783441514 -> 1783441517 00002000:00010000:1.0:1783441516.991063:0:6586:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x240000400:0x3:0x0] updating lvb atime from disk: 1783441511 -> 1783441511 00002000:00010000:1.0:1783441516.991066:0:6586:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x240000400:0x3:0x0] updating lvb ctime from disk: 1783441514 -> 1783441517 00002000:00010000:1.0:1783441516.991068:0:6586:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x3:0x0] updating lvb blocks from disk: 11 -> 11 00000100:00100000:1.0:1783441516.991131:0:6586:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a8756a7100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:65454767-383a-4679-a788-eba05c6e0989+8:2354:x1870073673332736:12345-192.168.201.13@tcp:10:bash.0 Request processed in 485us (701us total) trans 4294967306 rc 0/0 00000100:00100000:1.0:1783441516.991139:0:6586:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.13@tcp, seq: 1 00002000:00010000:1.0:1783441516.991143:0:6586:0:(ofd_dev.c:2825:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 9663677440/3 (0->18446744073709551615) 00002000:00100000:1.0:1783441516.991145:0:6586:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff91a8756a7100 with x1870073673332736 ext(0->18446744073709551615) 00002000:00010000:1.0:1783441516.991159:0:6586:0:(ofd_dev.c:2830:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff91a8756a7100. 00000100:00100000:0.0:1783441517.121504:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.13@tcp (source: 12345-192.168.201.13@tcp) 00000100:00100000:3.0:1783441517.121593:0:5787:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073673332864 00000100:00100000:3.0:1783441517.121603:0:5787:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073673332864 00000100:00100000:3.0:1783441517.121668:0:5787:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.13@tcp, seq: 91 00000100:00100000:3.0:1783441517.121679:0:5787:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a87d80ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:65454767-383a-4679-a788-eba05c6e0989+27:10451:x1870073673332864:12345-192.168.201.13@tcp:34:lfs.0 00010000:00010000:3.0:1783441517.121799:0:5787:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff91a841476800/0xa2426164df2c7dd3 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783441517.121817:0:5787:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91a841476800/0xa2426164df2c7dd3 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783441517.121829:0:5787:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91a841476800/0xa2426164df2c7dd3 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783441517.121845:0:5787:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff91a841476e00/0xa2426164df2c7dda lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783441517.121852:0:5787:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91a841476e00/0xa2426164df2c7dda lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783441517.121872:0:5787:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91a841476e00/0xa2426164df2c7dda lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783441517.122202:0:5787:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff91a841477200/0xa2426164df2c7de1 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783441517.122212:0:5787:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91a841477200/0xa2426164df2c7de1 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783441517.122219:0:5787:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91a841477200/0xa2426164df2c7de1 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1783441517.122258:0:5787:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff91a841477200/0xa2426164df2c7de1 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783441517.122270:0:5787:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff91a841476800/0xa2426164df2c7dd3 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783441517.122287:0:5787:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff91a841476800/0xa2426164df2c7dd3 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783441517.122293:0:5787:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff91a841476800/0xa2426164df2c7dd3 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783441517.122298:0:5787:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91a841476800 already unused, calling callback (ffffffffc1f9b4f0) 00010000:00010000:3.0:1783441517.122302:0:5787:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91a841476800/0xa2426164df2c7dd3 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783441517.122309:0:5787:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91a841476800/0xa2426164df2c7dd3 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783441517.122321:0:5787:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff91a8439b0300) 00010000:00010000:3.0:1783441517.122324:0:5787:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1783441517.122328:0:5787:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff91a841476800/0xa2426164df2c7dd3 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783441517.122333:0:5787:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91a841476800/0xa2426164df2c7dd3 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783441517.122347:0:5787:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff91a841476e00/0xa2426164df2c7dda lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783441517.122353:0:5787:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff91a841476e00/0xa2426164df2c7dda lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783441517.122359:0:5787:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff91a841476e00/0xa2426164df2c7dda lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783441517.122364:0:5787:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91a841476e00 already unused, calling callback (ffffffffc1f9b4f0) 00010000:00010000:3.0:1783441517.122372:0:5787:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91a841476e00/0xa2426164df2c7dda lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783441517.122378:0:5787:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91a841476e00/0xa2426164df2c7dda lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783441517.122385:0:5787:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff91a85faeea00) 00010000:00010000:3.0:1783441517.122387:0:5787:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1783441517.122390:0:5787:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff91a841476e00/0xa2426164df2c7dda lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783441517.122395:0:5787:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91a841476e00/0xa2426164df2c7dda lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783441517.122410:0:5787:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff91a841477200/0xa2426164df2c7de1 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783441517.122415:0:5787:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff91a841477200/0xa2426164df2c7de1 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783441517.122420:0:5787:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff91a841477200/0xa2426164df2c7de1 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783441517.122424:0:5787:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91a841477200 already unused, calling callback (ffffffffc1f9b4f0) 00010000:00010000:3.0:1783441517.122427:0:5787:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91a841477200/0xa2426164df2c7de1 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783441517.122432:0:5787:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91a841477200/0xa2426164df2c7de1 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783441517.122438:0:5787:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff91a858b90b00) 00010000:00010000:3.0:1783441517.122440:0:5787:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1783441517.122448:0:5787:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff91a841477200/0xa2426164df2c7de1 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783441517.122453:0:5787:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91a841477200/0xa2426164df2c7de1 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783441517.122539:0:5787:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a87d80ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:65454767-383a-4679-a788-eba05c6e0989+27:10451:x1870073673332864:12345-192.168.201.13@tcp:34:lfs.0 Request processed in 860us (1043us total) trans 0 rc 0/0 00000100:00100000:3.0:1783441517.122549:0:5787:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.13@tcp, seq: 91 00000100:00100000:3.0:1783441517.179441:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.13@tcp (source: 12345-192.168.201.13@tcp) 00000100:00100000:1.0:1783441517.179728:0:6605:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073673333120 00000100:00100000:1.0:1783441517.179783:0:6605:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073673333120 00000100:00100000:1.0:1783441517.179851:0:6605:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.13@tcp, seq: 92 00000100:00100000:1.0:1783441517.179870:0:6605:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a875424a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:65454767-383a-4679-a788-eba05c6e0989+27:10454:x1870073673333120:12345-192.168.201.13@tcp:101:lfs.0 00010000:00010000:1.0:1783441517.179893:0:6605:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1783441517.179916:0:6605:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91a87da47200/0xa2426164df2c7de8 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x633a354aa4df4e85 expref: -99 pid: 6605 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783441517.180016:0:6605:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff91a87da46600/0xa2426164df2c7def lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6605 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783441517.180030:0:6605:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91a87da46600/0xa2426164df2c7def lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6605 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783441517.180043:0:6605:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91a87da46600/0xa2426164df2c7def lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6605 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783441517.180059:0:6605:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff91a87da46200/0xa2426164df2c7df6 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6605 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783441517.180077:0:6605:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91a87da46200/0xa2426164df2c7df6 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6605 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783441517.180084:0:6605:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91a87da46200/0xa2426164df2c7df6 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6605 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783441517.180652:0:6605:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff91a87da46000/0xa2426164df2c7dfd lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6605 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783441517.180666:0:6605:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91a87da46000/0xa2426164df2c7dfd lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6605 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783441517.180685:0:6605:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91a87da46000/0xa2426164df2c7dfd lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6605 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1783441517.180696:0:6605:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 0 00010000:00010000:1.0:1783441517.180817:0:6605:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff91a87da46600/0xa2426164df2c7def lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6605 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783441517.180825:0:6605:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff91a87da46600/0xa2426164df2c7def lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6605 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783441517.180831:0:6605:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff91a87da46600/0xa2426164df2c7def lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6605 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783441517.180837:0:6605:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91a87da46600 already unused, calling callback (ffffffffc1f9b4f0) 00010000:00010000:1.0:1783441517.180841:0:6605:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91a87da46600/0xa2426164df2c7def lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6605 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783441517.180849:0:6605:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91a87da46600/0xa2426164df2c7def lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6605 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783441517.180861:0:6605:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff91a8439b0300) 00010000:00010000:1.0:1783441517.180863:0:6605:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1783441517.180868:0:6605:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff91a87da46600/0xa2426164df2c7def lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6605 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783441517.180874:0:6605:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91a87da46600/0xa2426164df2c7def lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6605 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783441517.180888:0:6605:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff91a87da46200/0xa2426164df2c7df6 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6605 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783441517.180894:0:6605:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff91a87da46200/0xa2426164df2c7df6 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6605 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783441517.180906:0:6605:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff91a87da46200/0xa2426164df2c7df6 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6605 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783441517.180911:0:6605:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91a87da46200 already unused, calling callback (ffffffffc1f9b4f0) 00010000:00010000:1.0:1783441517.180915:0:6605:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91a87da46200/0xa2426164df2c7df6 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6605 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783441517.180922:0:6605:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91a87da46200/0xa2426164df2c7df6 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6605 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783441517.180940:0:6605:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff91a858b90c00) 00010000:00010000:1.0:1783441517.180942:0:6605:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1783441517.180945:0:6605:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff91a87da46200/0xa2426164df2c7df6 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6605 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783441517.180951:0:6605:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91a87da46200/0xa2426164df2c7df6 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6605 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783441517.181319:0:6605:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91a87da47200/0xa2426164df2c7de8 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.13@tcp remote: 0x633a354aa4df4e85 expref: 30 pid: 6605 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783441517.181335:0:6605:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff91a87da46000/0xa2426164df2c7dfd lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.13@tcp remote: 0x633a354aa4df4e85 expref: 29 pid: 6605 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783441517.181343:0:6605:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff91a858b90b00) 00010000:00010000:1.0:1783441517.181345:0:6605:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:1.0:1783441517.181348:0:6605:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91a87da46000, rc 0) 00000100:00100000:1.0:1783441517.181635:0:6605:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a875424a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:65454767-383a-4679-a788-eba05c6e0989+29:10454:x1870073673333120:12345-192.168.201.13@tcp:101:lfs.0 Request processed in 1765us (2202us total) trans 4294967371 rc 0/0 00000100:00100000:1.0:1783441517.181654:0:6605:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.13@tcp, seq: 92 00000100:00100000:0.0:1783441517.186421:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.13@tcp (source: 12345-192.168.201.13@tcp) 00000100:00100000:3.0:1783441517.188819:0:5787:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073673333248 00000100:00100000:3.0:1783441517.188834:0:5787:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073673333248 00000100:00100000:3.0:1783441517.189328:0:5787:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.13@tcp, seq: 93 00000100:00100000:3.0:1783441517.189340:0:5787:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a87d80d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:65454767-383a-4679-a788-eba05c6e0989+29:10454:x1870073673333248:12345-192.168.201.13@tcp:54:lfs.0 00010000:00010000:3.0:1783441517.189427:0:5787:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff91a841477200/0xa2426164df2c7e0b lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783441517.189444:0:5787:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff91a841477c00/0xa2426164df2c7db0 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.13@tcp remote: 0x633a354aa4df4e70 expref: 29 pid: 5786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783441517.189455:0:5787:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff91a841477200/0xa2426164df2c7e0b lrc: 4/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783441517.189492:0:5787:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff91a841477c00/0xa2426164df2c7db0 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.13@tcp remote: 0x633a354aa4df4e70 expref: 29 pid: 5786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783441517.189508:0:5787:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff91a841477c00/0xa2426164df2c7db0 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.13@tcp remote: 0x633a354aa4df4e70 expref: 29 pid: 5786 timeout: 455 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783441517.189526:0:5787:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff91a875425f80 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5787:1870073693278720:192.168.201.13@tcp:104: 00000100:00100000:3.0:1783441517.189647:0:5787:0:(client.c:2702:ptlrpc_set_wait()) set ffff91a7410c8600 going to sleep for 11 seconds 00000100:00100000:2.0:1783441517.193888:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.13@tcp (source: 12345-192.168.201.13@tcp) 00000100:00100000:3.0:1783441517.194002:0:5787:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff91a875425f80 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5787:1870073693278720:192.168.201.13@tcp:104: 00010000:00010000:3.0:1783441517.194031:0:5787:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff91a841477200/0xa2426164df2c7e0b lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783441517.194146:0:5789:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073673333504 00000100:00100000:0.0:1783441517.194153:0:5789:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073673333504 00000100:00100000:0.0:1783441517.194209:0:5789:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.13@tcp, seq: 22 00000100:00100000:0.0:1783441517.194218:0:5789:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a87d6f2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:65454767-383a-4679-a788-eba05c6e0989+30:5568:x1870073673333504:12345-192.168.201.13@tcp:35:ldlm_bl.0 00000001:00080000:0.0:1783441517.194477:0:5789:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967372 00000100:00100000:0.0:1783441517.194580:0:5789:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a87d6f2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:65454767-383a-4679-a788-eba05c6e0989+32:5568:x1870073673333504:12345-192.168.201.13@tcp:35:ldlm_bl.0 Request processed in 363us (703us total) trans 4294967373 rc 0/0 00000100:00100000:0.0:1783441517.194599:0:5789:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.13@tcp, seq: 22 00000020:00080000:0.0:1783441517.194604:0:5789:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:0.0:1783441517.198286:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.13@tcp (source: 12345-192.168.201.13@tcp) 00000100:00100000:1.0:1783441517.198393:0:5771:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073673333632 00000100:00100000:1.0:1783441517.198406:0:5771:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073673333632 00010000:00010000:1.0:1783441517.198455:0:5771:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff91a841477c00/0xa2426164df2c7db0 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.13@tcp remote: 0x633a354aa4df4e70 expref: 32 pid: 5786 timeout: 455 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783441517.198507:0:5771:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.13@tcp, seq: 48 00000100:00100000:1.0:1783441517.198518:0:5771:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a87d80c380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:65454767-383a-4679-a788-eba05c6e0989+32:2354:x1870073673333632:12345-192.168.201.13@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1783441517.198533:0:5771:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1783441517.198540:0:5771:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff91a841477c00/0xa2426164df2c7db0 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.13@tcp remote: 0x633a354aa4df4e70 expref: 32 pid: 5786 timeout: 455 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783441517.198552:0:5771:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff91a841477c00/0xa2426164df2c7db0 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.13@tcp remote: 0x633a354aa4df4e70 expref: 32 pid: 5786 timeout: 455 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783441517.198575:0:5771:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91a841477c00/0xa2426164df2c7db0 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.13@tcp remote: 0x633a354aa4df4e70 expref: 32 pid: 5786 timeout: 455 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783441517.198592:0:5771:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff91a858b90b00) 00010000:00010000:1.0:1783441517.198596:0:5771:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff91a841477200/0xa2426164df2c7e0b lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783441517.198605:0:5771:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff91a841477200/0xa2426164df2c7e0b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783441517.198612:0:5771:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91a841477200/0xa2426164df2c7e0b lrc: 4/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783441517.198666:0:5771:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1783441517.198728:0:5771:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a87d80c380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:65454767-383a-4679-a788-eba05c6e0989+31:2354:x1870073673333632:12345-192.168.201.13@tcp:103:ldlm_bl.0 Request processed in 212us (453us total) trans 0 rc 0/0 00000100:00100000:1.0:1783441517.198736:0:5771:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.13@tcp, seq: 48 00010000:00010000:2.0:1783441517.200121:0:5787:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff91a841477200/0xa2426164df2c7e0b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783441517.200136:0:5787:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91a841477200/0xa2426164df2c7e0b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783441517.200170:0:5787:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff91a841477200/0xa2426164df2c7e0b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783441517.200178:0:5787:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff91a841477200/0xa2426164df2c7e0b lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783441517.200185:0:5787:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff91a841477200/0xa2426164df2c7e0b lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783441517.200191:0:5787:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91a841477200 already unused, calling callback (ffffffffc1f9b4f0) 00010000:00010000:2.0:1783441517.200196:0:5787:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91a841477200/0xa2426164df2c7e0b lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783441517.200202:0:5787:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91a841477200/0xa2426164df2c7e0b lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783441517.200216:0:5787:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff91a858b90b00) 00010000:00010000:2.0:1783441517.200219:0:5787:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1783441517.200223:0:5787:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff91a841477200/0xa2426164df2c7e0b lrc: 2/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783441517.200229:0:5787:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91a841477200/0xa2426164df2c7e0b lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783441517.200316:0:5787:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a87d80d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:65454767-383a-4679-a788-eba05c6e0989+30:10454:x1870073673333248:12345-192.168.201.13@tcp:54:lfs.0 Request processed in 10976us (13903us total) trans 0 rc 0/0 00000100:00100000:2.0:1783441517.200338:0:5787:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.13@tcp, seq: 93 00000100:00100000:0.0:1783441517.204295:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.13@tcp (source: 12345-192.168.201.13@tcp) 00000100:00100000:2.0:1783441517.204372:0:5789:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073673333888 00000100:00100000:2.0:1783441517.204381:0:5789:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073673333888 00000100:00100000:2.0:1783441517.204439:0:5789:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.13@tcp, seq: 23 00000100:00100000:2.0:1783441517.204449:0:5789:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a87d80c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:65454767-383a-4679-a788-eba05c6e0989+30:10454:x1870073673333888:12345-192.168.201.13@tcp:35:lfs.0 00000100:00100000:2.0:1783441517.204683:0:5789:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a87d80c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:65454767-383a-4679-a788-eba05c6e0989+31:10454:x1870073673333888:12345-192.168.201.13@tcp:35:lfs.0 Request processed in 235us (396us total) trans 4294967374 rc 0/0 00000100:00100000:2.0:1783441517.204691:0:5789:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.13@tcp, seq: 23 00000100:00100000:0.0:1783441517.322254:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.13@tcp (source: 12345-192.168.201.13@tcp) 00000100:00100000:2.0:1783441517.322356:0:5786:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073673334144 00000100:00100000:2.0:1783441517.322375:0:5786:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073673334144 00000100:00100000:2.0:1783441517.322436:0:5786:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.13@tcp, seq: 94 00000100:00100000:2.0:1783441517.322446:0:5786:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a87d80ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:65454767-383a-4679-a788-eba05c6e0989+31:10465:x1870073673334144:12345-192.168.201.13@tcp:101:cat.0 00010000:00010000:2.0:1783441517.322471:0:5786:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1783441517.322491:0:5786:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91a85f83c600/0xa2426164df2c7e12 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x633a354aa4df4e8c expref: -99 pid: 5786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783441517.322573:0:5786:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff91a85f83ca00/0xa2426164df2c7e19 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783441517.322588:0:5786:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91a85f83ca00/0xa2426164df2c7e19 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783441517.322598:0:5786:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91a85f83ca00/0xa2426164df2c7e19 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783441517.322614:0:5786:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff91a85f83d000/0xa2426164df2c7e20 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783441517.322641:0:5786:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91a85f83d000/0xa2426164df2c7e20 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783441517.322648:0:5786:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91a85f83d000/0xa2426164df2c7e20 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783441517.323066:0:5786:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff91a85f83c400/0xa2426164df2c7e27 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783441517.323076:0:5786:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91a85f83c400/0xa2426164df2c7e27 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783441517.323084:0:5786:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91a85f83c400/0xa2426164df2c7e27 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1783441517.323094:0:5786:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 8 00010000:00010000:2.0:1783441517.323189:0:5786:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff91a85f83ca00/0xa2426164df2c7e19 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783441517.323197:0:5786:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff91a85f83ca00/0xa2426164df2c7e19 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783441517.323203:0:5786:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff91a85f83ca00/0xa2426164df2c7e19 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783441517.323209:0:5786:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91a85f83ca00 already unused, calling callback (ffffffffc1f9b4f0) 00010000:00010000:2.0:1783441517.323213:0:5786:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91a85f83ca00/0xa2426164df2c7e19 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783441517.323221:0:5786:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91a85f83ca00/0xa2426164df2c7e19 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783441517.323243:0:5786:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff91a8439b0300) 00010000:00010000:2.0:1783441517.323246:0:5786:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1783441517.323251:0:5786:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff91a85f83ca00/0xa2426164df2c7e19 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783441517.323256:0:5786:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91a85f83ca00/0xa2426164df2c7e19 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783441517.323268:0:5786:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff91a85f83d000/0xa2426164df2c7e20 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783441517.323274:0:5786:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff91a85f83d000/0xa2426164df2c7e20 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783441517.323280:0:5786:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff91a85f83d000/0xa2426164df2c7e20 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783441517.323285:0:5786:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91a85f83d000 already unused, calling callback (ffffffffc1f9b4f0) 00010000:00010000:2.0:1783441517.323288:0:5786:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91a85f83d000/0xa2426164df2c7e20 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783441517.323294:0:5786:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91a85f83d000/0xa2426164df2c7e20 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783441517.323300:0:5786:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff91a8429bd000) 00010000:00010000:2.0:1783441517.323302:0:5786:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1783441517.323305:0:5786:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff91a85f83d000/0xa2426164df2c7e20 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783441517.323310:0:5786:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91a85f83d000/0xa2426164df2c7e20 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783441517.323359:0:5786:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91a85f83c600/0xa2426164df2c7e12 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.13@tcp remote: 0x633a354aa4df4e8c expref: 34 pid: 5786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783441517.323373:0:5786:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff91a85f83c400/0xa2426164df2c7e27 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.13@tcp remote: 0x633a354aa4df4e8c expref: 33 pid: 5786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783441517.323381:0:5786:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff91a858b90b00) 00010000:00010000:2.0:1783441517.323383:0:5786:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1783441517.323385:0:5786:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91a85f83c400, rc 0) 00000100:00100000:2.0:1783441517.323451:0:5786:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a87d80ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:65454767-383a-4679-a788-eba05c6e0989+33:10465:x1870073673334144:12345-192.168.201.13@tcp:101:cat.0 Request processed in 1007us (1207us total) trans 4294967375 rc 0/0 00000100:00100000:2.0:1783441517.323458:0:5786:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.13@tcp, seq: 94 00000100:00100000:0.0:1783441517.333729:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.13@tcp (source: 12345-192.168.201.13@tcp) 00000100:00100000:2.0:1783441517.334566:0:5789:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073673334400 00000100:00100000:2.0:1783441517.334576:0:5789:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073673334400 00000100:00100000:2.0:1783441517.334636:0:5789:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.13@tcp, seq: 24 00000100:00100000:2.0:1783441517.334646:0:5789:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a87d6a0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:65454767-383a-4679-a788-eba05c6e0989+33:10465:x1870073673334400:12345-192.168.201.13@tcp:35:cat.0 00000100:00100000:2.0:1783441517.334923:0:5789:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a87d6a0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:65454767-383a-4679-a788-eba05c6e0989+34:10465:x1870073673334400:12345-192.168.201.13@tcp:35:cat.0 Request processed in 278us (1203us total) trans 4294967376 rc 0/0 00000100:00100000:2.0:1783441517.334946:0:5789:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.13@tcp, seq: 24 00000100:00100000:0.0:1783441517.368356:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.13@tcp (source: 12345-192.168.201.13@tcp) 00000100:00100000:2.0:1783441517.368561:0:5785:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073673334656 00000100:00100000:2.0:1783441517.368573:0:5785:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073673334656 00000100:00100000:2.0:1783441517.368637:0:5785:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.13@tcp, seq: 95 00000100:00100000:2.0:1783441517.368649:0:5785:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a8476b3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:65454767-383a-4679-a788-eba05c6e0989+34:10466:x1870073673334656:12345-192.168.201.13@tcp:36:rm.0 00010000:00010000:2.0:1783441517.368715:0:5785:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 3 locks, starting at 0 00010000:00010000:2.0:1783441517.368762:0:5785:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91a85f83c400/0xa2426164df2c7e27 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.13@tcp remote: 0x633a354aa4df4e8c expref: 34 pid: 5786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783441517.368805:0:5785:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91a87da46000/0xa2426164df2c7dfd lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.13@tcp remote: 0x633a354aa4df4e85 expref: 33 pid: 6605 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783441517.368822:0:5785:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91a841477e00/0xa2426164df2c7dc5 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.13@tcp remote: 0x633a354aa4df4e77 expref: 32 pid: 6605 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783441517.368833:0:5785:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff91a858b90b00) 00010000:00010000:2.0:1783441517.369540:0:5785:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1783441517.369664:0:5785:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff91a85f83c600/0xa2426164df2c7e35 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783441517.369679:0:5785:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91a85f83c600/0xa2426164df2c7e35 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783441517.369690:0:5785:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91a85f83c600/0xa2426164df2c7e35 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783441517.369705:0:5785:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff91a85f83d000/0xa2426164df2c7e3c lrc: 3/0,1 mode: --/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783441517.369711:0:5785:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91a85f83d000/0xa2426164df2c7e3c lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783441517.369717:0:5785:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91a85f83d000/0xa2426164df2c7e3c lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783441517.370536:0:5785:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff91a85f83ca00/0xa2426164df2c7e43 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783441517.370558:0:5785:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91a85f83ca00/0xa2426164df2c7e43 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783441517.370575:0:5785:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91a85f83ca00/0xa2426164df2c7e43 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1783441517.371262:0:5785:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].4, 64 off8472 00000004:00080000:2.0:1783441517.371273:0:5785:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 355245531263ns, next at 356245528313ns, rc = 0 00010000:00010000:2.0:1783441517.371346:0:5785:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff91a85f83d600/0xa2426164df2c7e4a lrc: 3/0,1 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783441517.371356:0:5785:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91a85f83d600/0xa2426164df2c7e4a lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783441517.371364:0:5785:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91a85f83d600/0xa2426164df2c7e4a lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783441517.371370:0:5785:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff91a85f83d600/0xa2426164df2c7e4a lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783441517.371376:0:5785:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff91a85f83d600/0xa2426164df2c7e4a lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783441517.371382:0:5785:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff91a85f83d600/0xa2426164df2c7e4a lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783441517.371406:0:5785:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1783441517.371426:0:5785:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff91a85f83ca00/0xa2426164df2c7e43 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783441517.371433:0:5785:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff91a85f83ca00/0xa2426164df2c7e43 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783441517.371439:0:5785:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff91a85f83ca00/0xa2426164df2c7e43 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783441517.371452:0:5785:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91a85f83ca00 already unused, calling callback (ffffffffc1f9b4f0) 00010000:00010000:1.0:1783441517.371456:0:5772:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1783441517.371458:0:5785:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91a85f83ca00/0xa2426164df2c7e43 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783441517.371466:0:5772:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff91a85f83d600/0xa2426164df2c7e4a lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40010480000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783441517.371469:0:5785:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91a85f83ca00/0xa2426164df2c7e43 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783441517.371482:0:5772:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91a85f83d600 already unused, calling callback (ffffffffc155ff90) 00010000:00010000:2.0:1783441517.371495:0:5785:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff91a8429bd900) 00010000:00010000:1.0:1783441517.371495:0:5772:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91a85f83d600/0xa2426164df2c7e4a lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783441517.371503:0:5785:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:1.0:1783441517.371510:0:5772:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91a85f83d600/0xa2426164df2c7e4a lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40018480000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783441517.371511:0:5785:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff91a85f83ca00/0xa2426164df2c7e43 lrc: 2/0,0 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783441517.371530:0:5785:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91a85f83ca00/0xa2426164df2c7e43 lrc: 0/0,0 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783441517.371534:0:5772:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff91a8429bd900) 00010000:00010000:1.0:1783441517.371538:0:5772:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:1.0:1783441517.371542:0:5772:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff91a85f83d600/0xa2426164df2c7e4a lrc: 1/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783441517.371549:0:5772:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91a85f83d600/0xa2426164df2c7e4a lrc: 0/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783441517.371550:0:5785:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff91a85f83c600/0xa2426164df2c7e35 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783441517.371564:0:5785:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff91a85f83c600/0xa2426164df2c7e35 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783441517.371570:0:5785:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff91a85f83c600/0xa2426164df2c7e35 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783441517.371572:0:5772:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783441517.371576:0:5772:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783441517.371578:0:5785:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91a85f83c600 already unused, calling callback (ffffffffc1f9b4f0) 00010000:00010000:1.0:1783441517.371579:0:5772:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783441517.371583:0:5785:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91a85f83c600/0xa2426164df2c7e35 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783441517.371591:0:5785:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91a85f83c600/0xa2426164df2c7e35 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783441517.371611:0:5785:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff91a8439b0300) 00010000:00010000:2.0:1783441517.371613:0:5785:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1783441517.371616:0:5785:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff91a85f83c600/0xa2426164df2c7e35 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783441517.371621:0:5785:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91a85f83c600/0xa2426164df2c7e35 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1783441517.371632:0:5785:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000a67abcbe reply state 000000005724a38f transno 4294967377 ns: mdt-lustre-MDT0000_UUID lock: ffff91a85f83d000/0xa2426164df2c7e3c lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783441517.371642:0:5785:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1783441517.371764:0:5785:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a8476b3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:65454767-383a-4679-a788-eba05c6e0989+33:10466:x1870073673334656:12345-192.168.201.13@tcp:36:rm.0 Request processed in 3089us (3389us total) trans 4294967377 rc 0/0 00000100:00100000:2.0:1783441517.371774:0:5785:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.13@tcp, seq: 95 00010000:00010000:1.0:1783441517.376246:0:3290:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff91a85f83d000/0xa2426164df2c7e3c lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783441517.376265:0:3290:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff91a85f83d000/0xa2426164df2c7e3c lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783441517.376289:0:3290:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff91a85f83d000/0xa2426164df2c7e3c lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783441517.376295:0:3290:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91a85f83d000 already unused, calling callback (ffffffffc1f9b4f0) 00010000:00010000:1.0:1783441517.376299:0:3290:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91a85f83d000/0xa2426164df2c7e3c lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783441517.376308:0:3290:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91a85f83d000/0xa2426164df2c7e3c lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783441517.376324:0:3290:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff91a8429bd000) 00010000:00010000:1.0:1783441517.376327:0:3290:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1783441517.376331:0:3290:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff91a85f83d000/0xa2426164df2c7e3c lrc: 2/0,0 mode: --/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783441517.376338:0:3290:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91a85f83d000/0xa2426164df2c7e3c lrc: 0/0,0 mode: --/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783441517.438716:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.13@tcp (source: 12345-192.168.201.13@tcp) 00000100:00100000:2.0:1783441517.438784:0:5786:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073673334912 00000100:00100000:2.0:1783441517.438795:0:5786:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073673334912 00000100:00100000:2.0:1783441517.439066:0:5786:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.13@tcp, seq: 96 00000100:00100000:2.0:1783441517.439078:0:5786:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a8476b2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:65454767-383a-4679-a788-eba05c6e0989+32:10472:x1870073673334912:12345-192.168.201.13@tcp:101:bash.0 00010000:00010000:2.0:1783441517.439107:0:5786:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1783441517.439129:0:5786:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91a85f83c600/0xa2426164df2c7e51 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x633a354aa4df4e93 expref: -99 pid: 5786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783441517.439257:0:5786:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff91a85f83ca00/0xa2426164df2c7e58 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783441517.439272:0:5786:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91a85f83ca00/0xa2426164df2c7e58 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783441517.439301:0:5786:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91a85f83ca00/0xa2426164df2c7e58 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783441517.439317:0:5786:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff91a85f83c400/0xa2426164df2c7e5f lrc: 3/0,1 mode: --/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783441517.439326:0:5786:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91a85f83c400/0xa2426164df2c7e5f lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783441517.439345:0:5786:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91a85f83c400/0xa2426164df2c7e5f lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:2.0:1783441517.447552:0:5786:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x3:0x0], index 1: 0 00010000:00010000:2.0:1783441517.447788:0:5786:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff91a85f83cc00/0xa2426164df2c7e66 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783441517.447804:0:5786:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91a85f83cc00/0xa2426164df2c7e66 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783441517.447817:0:5786:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91a85f83cc00/0xa2426164df2c7e66 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783441517.447868:0:5786:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff91a85f83ca00/0xa2426164df2c7e58 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783441517.447875:0:5786:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff91a85f83ca00/0xa2426164df2c7e58 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783441517.447882:0:5786:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff91a85f83ca00/0xa2426164df2c7e58 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783441517.447887:0:5786:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91a85f83ca00 already unused, calling callback (ffffffffc1f9b4f0) 00010000:00010000:2.0:1783441517.447900:0:5786:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91a85f83ca00/0xa2426164df2c7e58 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783441517.447908:0:5786:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91a85f83ca00/0xa2426164df2c7e58 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783441517.447933:0:5786:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff91a8439b0300) 00010000:00010000:2.0:1783441517.447936:0:5786:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1783441517.447941:0:5786:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff91a85f83ca00/0xa2426164df2c7e58 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783441517.447947:0:5786:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91a85f83ca00/0xa2426164df2c7e58 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1783441517.447963:0:5786:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 000000007e01e832 reply state 00000000519ceaef transno 4294967378 ns: mdt-lustre-MDT0000_UUID lock: ffff91a85f83c400/0xa2426164df2c7e5f lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783441517.447971:0:5786:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:2.0:1783441517.448010:0:5786:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91a85f83c600/0xa2426164df2c7e51 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.13@tcp remote: 0x633a354aa4df4e93 expref: 35 pid: 5786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783441517.448024:0:5786:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff91a85f83cc00/0xa2426164df2c7e66 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.13@tcp remote: 0x633a354aa4df4e93 expref: 34 pid: 5786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783441517.448032:0:5786:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff91a8429bd400) 00010000:00010000:2.0:1783441517.448034:0:5786:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1783441517.448037:0:5786:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91a85f83cc00, rc 0) 00000100:00100000:2.0:1783441517.448118:0:5786:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a8476b2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:65454767-383a-4679-a788-eba05c6e0989+35:10472:x1870073673334912:12345-192.168.201.13@tcp:101:bash.0 Request processed in 9042us (9412us total) trans 4294967378 rc 0/0 00000100:00100000:2.0:1783441517.448129:0:5786:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.13@tcp, seq: 96 00010000:00010000:1.0:1783441517.460070:0:3289:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff91a85f83c400/0xa2426164df2c7e5f lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783441517.460090:0:3289:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff91a85f83c400/0xa2426164df2c7e5f lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783441517.460099:0:3289:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff91a85f83c400/0xa2426164df2c7e5f lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783441517.460106:0:3289:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91a85f83c400 already unused, calling callback (ffffffffc1f9b4f0) 00010000:00010000:1.0:1783441517.460112:0:3289:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91a85f83c400/0xa2426164df2c7e5f lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783441517.460139:0:3289:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91a85f83c400/0xa2426164df2c7e5f lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783441517.460157:0:3289:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff91a8429bdc00) 00010000:00010000:1.0:1783441517.460160:0:3289:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1783441517.460165:0:3289:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff91a85f83c400/0xa2426164df2c7e5f lrc: 2/0,0 mode: --/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783441517.460172:0:3289:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91a85f83c400/0xa2426164df2c7e5f lrc: 0/0,0 mode: --/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783441517.460620:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.13@tcp (source: 12345-192.168.201.13@tcp) 00000100:00100000:3.0:1783441517.460695:0:8557:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073673335040 00000100:00100000:3.0:1783441517.460706:0:8557:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073673335040 00000100:00100000:3.0:1783441517.460794:0:8557:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.13@tcp, seq: 35 00000100:00100000:3.0:1783441517.460803:0:8557:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a8476b3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:65454767-383a-4679-a788-eba05c6e0989+5:2354:x1870073673335040:12345-192.168.201.13@tcp:101:bash.0 00010000:00010000:3.0:1783441517.460822:0:8557:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1783441517.460843:0:8557:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000089a42abc/0xa2426164df2c7e74 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x633a354aa4df4e9a expref: -99 pid: 8557 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1783441517.460878:0:8557:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x3:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1783441517.460901:0:8557:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=355s v=(0 0) 00010000:00010000:3.0:1783441517.460906:0:8557:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1783441517.460916:0:8557:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000089a42abc/0xa2426164df2c7e74 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.13@tcp remote: 0x633a354aa4df4e9a expref: 6 pid: 8557 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783441517.460951:0:8557:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 0000000089a42abc/0xa2426164df2c7e74 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.13@tcp remote: 0x633a354aa4df4e9a expref: 6 pid: 8557 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783441517.460964:0:8557:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91a841476e00, rc 0) 00000100:00100000:3.0:1783441517.461033:0:8557:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a8476b3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:65454767-383a-4679-a788-eba05c6e0989+6:2354:x1870073673335040:12345-192.168.201.13@tcp:101:bash.0 Request processed in 230us (417us total) trans 0 rc 0/0 00000100:00100000:3.0:1783441517.461040:0:8557:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.13@tcp, seq: 35 00000100:00080000:0.0:1783441517.461113:0:5781:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1783441517.466115:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.13@tcp (source: 12345-192.168.201.13@tcp) 00000100:00100000:1.0:1783441517.468661:0:6581:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073673335168 00000100:00100000:1.0:1783441517.468679:0:6581:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073673335168 00000100:00100000:1.0:1783441517.468771:0:6581:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.13@tcp, seq: 36 00000100:00100000:1.0:1783441517.468783:0:6581:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a8476b2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:65454767-383a-4679-a788-eba05c6e0989+6:10472:x1870073673335168:12345-192.168.201.13@tcp:101:bash.0 00010000:00010000:1.0:1783441517.468803:0:6581:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1783441517.468823:0:6581:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000e62c61d4/0xa2426164df2c7e7b lrc: 2/0,0 mode: --/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x633a354aa4df4ea1 expref: -99 pid: 6581 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783441517.468878:0:6581:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 0000000089a42abc/0xa2426164df2c7e74 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.13@tcp remote: 0x633a354aa4df4e9a expref: 7 pid: 8557 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783441517.468887:0:6581:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1783441517.468891:0:6581:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1783441517.468896:0:6581:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000e62c61d4/0xa2426164df2c7e7b lrc: 4/0,0 mode: --/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.201.13@tcp remote: 0x633a354aa4df4ea1 expref: 7 pid: 6581 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783441517.468946:0:6581:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 0000000089a42abc/0xa2426164df2c7e74 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.201.13@tcp remote: 0x633a354aa4df4e9a expref: 7 pid: 8557 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783441517.468974:0:6581:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 0000000089a42abc/0xa2426164df2c7e74 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.201.13@tcp remote: 0x633a354aa4df4e9a expref: 7 pid: 8557 timeout: 455 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783441517.468990:0:6581:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff91a87d681c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:6581:1870073693278848:192.168.201.13@tcp:104: 00000100:00100000:1.0:1783441517.469108:0:6581:0:(client.c:2702:ptlrpc_set_wait()) set ffff91a8470660c0 going to sleep for 11 seconds 00000100:00100000:2.0:1783441517.473506:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.13@tcp (source: 12345-192.168.201.13@tcp) 00000100:00100000:1.0:1783441517.473694:0:6581:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff91a87d681c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:6581:1870073693278848:192.168.201.13@tcp:104: 00010000:00010000:1.0:1783441517.473729:0:6581:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000e62c61d4/0xa2426164df2c7e7b lrc: 3/0,0 mode: --/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.201.13@tcp remote: 0x633a354aa4df4ea1 expref: 7 pid: 6581 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783441517.473787:0:6581:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91a87da47200, rc 0) 00000100:00100000:1.0:1783441517.473849:0:6581:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a8476b2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:65454767-383a-4679-a788-eba05c6e0989+7:10472:x1870073673335168:12345-192.168.201.13@tcp:101:bash.0 Request processed in 5059us (7734us total) trans 0 rc 0/0 00000100:00100000:1.0:1783441517.473866:0:6581:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.13@tcp, seq: 36 00000100:00100000:0.0:1783441517.473957:0:11514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073673335296 00000100:00100000:0.0:1783441517.473964:0:11514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073673335296 00010000:00010000:0.0:1783441517.473995:0:11514:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 0000000089a42abc/0xa2426164df2c7e74 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.201.13@tcp remote: 0x633a354aa4df4e9a expref: 7 pid: 8557 timeout: 455 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783441517.474028:0:11514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.13@tcp, seq: 49 00000100:00100000:0.0:1783441517.474036:0:11514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a845458050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:65454767-383a-4679-a788-eba05c6e0989+7:2355:x1870073673335296:12345-192.168.201.13@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1783441517.474048:0:11514:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1783441517.474070:0:11514:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 0000000089a42abc/0xa2426164df2c7e74 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.201.13@tcp remote: 0x633a354aa4df4e9a expref: 7 pid: 8557 timeout: 455 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783441517.474082:0:11514:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 0000000089a42abc/0xa2426164df2c7e74 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.201.13@tcp remote: 0x633a354aa4df4e9a expref: 7 pid: 8557 timeout: 455 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783441517.474104:0:11514:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000089a42abc/0xa2426164df2c7e74 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.201.13@tcp remote: 0x633a354aa4df4e9a expref: 7 pid: 8557 timeout: 455 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783441517.474130:0:11514:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1783441517.474135:0:11514:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1783441517.474142:0:11514:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000e62c61d4/0xa2426164df2c7e7b lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.201.13@tcp remote: 0x633a354aa4df4ea1 expref: 6 pid: 6581 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783441517.474152:0:11514:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000e62c61d4/0xa2426164df2c7e7b lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.201.13@tcp remote: 0x633a354aa4df4ea1 expref: 6 pid: 6581 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783441517.474182:0:11514:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 00000000e62c61d4/0xa2426164df2c7e7b lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.201.13@tcp remote: 0x633a354aa4df4ea1 expref: 6 pid: 6581 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783441517.474195:0:11514:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff91a8476b1880 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0001_UUID:11514:1870073693278976:192.168.201.13@tcp:105: 00000100:00100000:0.0:1783441517.474242:0:11514:0:(client.c:2702:ptlrpc_set_wait()) set ffff91a8501c6840 going to sleep for 11 seconds 00000100:00100000:2.0:1783441517.479049:0:11514:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff91a8476b1880 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0001_UUID:11514:1870073693278976:192.168.201.13@tcp:105: 00010000:00010000:2.0:1783441517.479081:0:11514:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1783441517.479149:0:11514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a845458050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:65454767-383a-4679-a788-eba05c6e0989+6:2355:x1870073673335296:12345-192.168.201.13@tcp:103:ldlm_bl.0 Request processed in 5112us (5651us total) trans 0 rc 0/0 00000100:00100000:2.0:1783441517.479162:0:11514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.13@tcp, seq: 49 00000100:00100000:2.0:1783441517.483212:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.13@tcp (source: 12345-192.168.201.13@tcp) 00000100:00100000:0.0:1783441517.489485:0:5789:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073673335552 00000100:00100000:0.0:1783441517.489501:0:5789:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073673335552 00000100:00100000:0.0:1783441517.489761:0:5789:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.13@tcp, seq: 25 00000100:00100000:0.0:1783441517.489773:0:5789:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a87d6f0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:65454767-383a-4679-a788-eba05c6e0989+34:10472:x1870073673335552:12345-192.168.201.13@tcp:35:bash.0 00000100:00100000:0.0:1783441517.490173:0:5789:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a87d6f0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:65454767-383a-4679-a788-eba05c6e0989+35:10472:x1870073673335552:12345-192.168.201.13@tcp:35:bash.0 Request processed in 400us (6969us total) trans 4294967379 rc 0/0 00000100:00100000:0.0:1783441517.490182:0:5789:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.13@tcp, seq: 25 00000100:00100000:0.0:1783441517.722149:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.13@tcp (source: 12345-192.168.201.13@tcp) 00000100:00100000:3.0:1783441517.722312:0:5787:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073673335680 00000100:00100000:3.0:1783441517.722320:0:5787:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073673335680 00000100:00100000:3.0:1783441517.722410:0:5787:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.13@tcp, seq: 97 00000100:00100000:3.0:1783441517.722418:0:5787:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a8476b1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:65454767-383a-4679-a788-eba05c6e0989+35:10488:x1870073673335680:12345-192.168.201.13@tcp:101:lfs.0 00010000:00010000:3.0:1783441517.722440:0:5787:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1783441517.722457:0:5787:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91a841476800/0xa2426164df2c7e82 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x633a354aa4df4ea8 expref: -99 pid: 5787 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783441517.722509:0:5787:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff91a841476e00/0xa2426164df2c7e89 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783441517.722520:0:5787:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91a841476e00/0xa2426164df2c7e89 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783441517.722528:0:5787:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91a841476e00/0xa2426164df2c7e89 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1783441517.722581:0:5787:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x3:0x0]: returning size 7680 00000004:00200000:3.0:1783441517.722584:0:5787:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 1 stripe count 1 MDT count 1 00000004:00010000:3.0:1783441517.722608:0:5787:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff91a841476e00/0xa2426164df2c7e89 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783441517.722631:0:5787:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91a841476800/0xa2426164df2c7e82 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.13@tcp remote: 0x633a354aa4df4ea8 expref: 37 pid: 5787 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783441517.722650:0:5787:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff91a841476e00/0xa2426164df2c7e89 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.13@tcp remote: 0x633a354aa4df4ea8 expref: 36 pid: 5787 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783441517.722659:0:5787:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff91a8439b0300) 00010000:00010000:3.0:1783441517.722662:0:5787:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1783441517.722676:0:5787:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91a841476e00, rc 0) 00000100:00100000:3.0:1783441517.722805:0:5787:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a8476b1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:65454767-383a-4679-a788-eba05c6e0989+36:10488:x1870073673335680:12345-192.168.201.13@tcp:101:lfs.0 Request processed in 387us (666us total) trans 0 rc 0/0 00000100:00100000:3.0:1783441517.722811:0:5787:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.13@tcp, seq: 97 00000100:00100000:3.0:1783441517.729962:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.13@tcp (source: 12345-192.168.201.13@tcp) 00000100:00100000:1.0:1783441517.730084:0:6605:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073673335936 00000100:00100000:1.0:1783441517.730092:0:6605:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073673335936 00000100:00100000:1.0:1783441517.730140:0:6605:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.13@tcp, seq: 98 00000100:00100000:1.0:1783441517.730149:0:6605:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a875425f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:65454767-383a-4679-a788-eba05c6e0989+36:10488:x1870073673335936:12345-192.168.201.13@tcp:101:lfs.0 00010000:00010000:1.0:1783441517.730170:0:6605:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1783441517.730189:0:6605:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91a87da46200/0xa2426164df2c7e90 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x633a354aa4df4eaf expref: -99 pid: 6605 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783441517.730286:0:6605:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff91a87da46600/0xa2426164df2c7e97 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6605 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783441517.730312:0:6605:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91a87da46600/0xa2426164df2c7e97 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6605 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783441517.730320:0:6605:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91a87da46600/0xa2426164df2c7e97 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6605 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1783441517.730330:0:6605:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x7:0x0]: returning size 9 00010000:00010000:1.0:1783441517.730455:0:6605:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91a87da46200/0xa2426164df2c7e90 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.13@tcp remote: 0x633a354aa4df4eaf expref: 39 pid: 6605 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783441517.730471:0:6605:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff91a87da46600/0xa2426164df2c7e97 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.13@tcp remote: 0x633a354aa4df4eaf expref: 38 pid: 6605 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783441517.730477:0:6605:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff91a8429bd400) 00010000:00010000:1.0:1783441517.730479:0:6605:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1783441517.730481:0:6605:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91a87da46600, rc 0) 00000100:00100000:1.0:1783441517.730532:0:6605:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a875425f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:65454767-383a-4679-a788-eba05c6e0989+38:10488:x1870073673335936:12345-192.168.201.13@tcp:101:lfs.0 Request processed in 385us (581us total) trans 4294967380 rc 0/0 00000100:00100000:1.0:1783441517.730537:0:6605:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.13@tcp, seq: 98 00000100:00100000:0.0:1783441517.740726:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.13@tcp (source: 12345-192.168.201.13@tcp) 00000100:00100000:0.0:1783441517.740944:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.13@tcp (source: 12345-192.168.201.13@tcp) 00010000:00010000:0.0:1783441517.740995:0:5773:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1783441517.741151:0:11015:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073673336320 00000100:00100000:3.0:1783441517.741160:0:11015:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073673336320 00000100:00100000:3.0:1783441517.741225:0:11015:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.13@tcp, seq: 6 00000100:00100000:3.0:1783441517.741235:0:11015:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a87d805c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:65454767-383a-4679-a788-eba05c6e0989+38:2355:x1870073673336320:12345-192.168.201.13@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1783441517.741250:0:11015:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1783441517.741272:0:11015:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91a87da46600/0xa2426164df2c7e97 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.13@tcp remote: 0x633a354aa4df4eaf expref: 38 pid: 6605 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783441517.741294:0:11015:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff91a8429bd400) 00010000:00010000:3.0:1783441517.741298:0:11015:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1783441517.741345:0:11015:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a87d805c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:65454767-383a-4679-a788-eba05c6e0989+37:2355:x1870073673336320:12345-192.168.201.13@tcp:103:ldlm_bl.0 Request processed in 112us (401us total) trans 0 rc 0/0 00000100:00100000:3.0:1783441517.741350:0:11015:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.13@tcp, seq: 6 00000100:00100000:2.0:1783441517.743355:0:5785:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073673336192 00000100:00100000:2.0:1783441517.743368:0:5785:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073673336192 00000100:00100000:2.0:1783441517.743422:0:5785:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.13@tcp, seq: 99 00000100:00100000:2.0:1783441517.743431:0:5785:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a87d806a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:65454767-383a-4679-a788-eba05c6e0989+37:10488:x1870073673336192:12345-192.168.201.13@tcp:101:lfs.0 00010000:00010000:2.0:1783441517.743454:0:5785:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1783441517.743473:0:5785:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91a85f83c000/0xa2426164df2c7ea5 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x633a354aa4df4eb6 expref: -99 pid: 5785 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783441517.743711:0:5785:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff91a85f83da00/0xa2426164df2c7eac lrc: 3/0,1 mode: --/PW res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783441517.743725:0:5785:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91a85f83da00/0xa2426164df2c7eac lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783441517.743735:0:5785:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91a85f83da00/0xa2426164df2c7eac lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1783441517.743764:0:5785:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x7:0x0]: returning size 9 00010000:00010000:2.0:1783441517.744341:0:5785:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91a85f83c000/0xa2426164df2c7ea5 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.13@tcp remote: 0x633a354aa4df4eb6 expref: 40 pid: 5785 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783441517.744360:0:5785:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff91a85f83da00/0xa2426164df2c7eac lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.13@tcp remote: 0x633a354aa4df4eb6 expref: 39 pid: 5785 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783441517.744382:0:5785:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff91a8429bd400) 00010000:00010000:2.0:1783441517.744385:0:5785:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:2.0:1783441517.744389:0:5785:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91a85f83da00, rc 0) 00000100:00100000:2.0:1783441517.744658:0:5785:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a87d806a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:65454767-383a-4679-a788-eba05c6e0989+39:10488:x1870073673336192:12345-192.168.201.13@tcp:101:lfs.0 Request processed in 1227us (3941us total) trans 4294967381 rc 0/0 00000100:00100000:2.0:1783441517.744666:0:5785:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.13@tcp, seq: 99 00000100:00100000:0.0:1783441517.751384:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.13@tcp (source: 12345-192.168.201.13@tcp) 00000100:00100000:1.0:1783441517.751483:0:6583:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073673336448 00000100:00100000:1.0:1783441517.751492:0:6583:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073673336448 00000100:00100000:1.0:1783441517.751554:0:6583:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.13@tcp, seq: 37 00000100:00100000:1.0:1783441517.751574:0:6583:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a87d806d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:65454767-383a-4679-a788-eba05c6e0989+6:2354:x1870073673336448:12345-192.168.201.13@tcp:1:lfs.0 00010000:00010000:1.0:1783441517.751622:0:6583:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000006a8a89ea/0xa2426164df2c7eba lrc: 3/0,1 mode: --/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6583 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783441517.751638:0:6583:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000e62c61d4/0xa2426164df2c7e7b lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.201.13@tcp remote: 0x633a354aa4df4ea1 expref: 6 pid: 6581 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783441517.751656:0:6583:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1783441517.751659:0:6583:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1783441517.751663:0:6583:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000006a8a89ea/0xa2426164df2c7eba lrc: 4/0,1 mode: --/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6583 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783441517.751693:0:6583:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000e62c61d4/0xa2426164df2c7e7b lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.201.13@tcp remote: 0x633a354aa4df4ea1 expref: 6 pid: 6581 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783441517.751703:0:6583:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000e62c61d4/0xa2426164df2c7e7b lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.201.13@tcp remote: 0x633a354aa4df4ea1 expref: 6 pid: 6581 timeout: 455 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783441517.751716:0:6583:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff91a87d681c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:6583:1870073693279104:192.168.201.13@tcp:104: 00000100:00100000:1.0:1783441517.751808:0:6583:0:(client.c:2702:ptlrpc_set_wait()) set ffff91a8470660c0 going to sleep for 11 seconds 00000100:00100000:1.0:1783441517.754934:0:6583:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff91a87d681c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:6583:1870073693279104:192.168.201.13@tcp:104: 00010000:00010000:1.0:1783441517.754965:0:6583:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 000000006a8a89ea/0xa2426164df2c7eba lrc: 3/0,1 mode: --/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6583 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783441517.756337:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.13@tcp (source: 12345-192.168.201.13@tcp) 00000100:00100000:1.0:1783441517.756480:0:6588:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073673336576 00000100:00100000:1.0:1783441517.756489:0:6588:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073673336576 00002000:00100000:1.0:1783441517.756546:0:6588:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x3:0x0] (0->8) req@ffff91a87d804380 x1870073673336576/t0(0) o4->65454767-383a-4679-a788-eba05c6e0989@192.168.201.13@tcp:158/0 lens 504/0 e 0 to 0 dl 1783441528 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1783441517.756557:0:6588:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff91a87d804380 with x1870073673336576 ext(0->8) 00010000:00010000:1.0:1783441517.756575:0:6588:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 00000000e62c61d4/0xa2426164df2c7e7b lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.201.13@tcp remote: 0x633a354aa4df4ea1 expref: 7 pid: 6581 timeout: 455 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783441517.756610:0:6588:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 00000000e62c61d4/0xa2426164df2c7e7b lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.201.13@tcp remote: 0x633a354aa4df4ea1 expref: 7 pid: 6581 timeout: 455 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1783441517.756618:0:6588:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff91a87d804380 00000100:00100000:1.0:1783441517.756653:0:6588:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.13@tcp, seq: 1 00000100:00100000:1.0:1783441517.756663:0:6588:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a87d804380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:65454767-383a-4679-a788-eba05c6e0989+7:2354:x1870073673336576:12345-192.168.201.13@tcp:4:lfs.0 00000100:00100000:1.0:1783441517.757481:0:6588:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a87d804380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:65454767-383a-4679-a788-eba05c6e0989+9:2354:x1870073673336576:12345-192.168.201.13@tcp:4:lfs.0 Request processed in 814us (1147us total) trans 4294967302 rc 0/0 00000100:00100000:1.0:1783441517.757492:0:6588:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.13@tcp, seq: 1 00002000:00100000:1.0:1783441517.757501:0:6588:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x3:0x0] (0->8) req@ffff91a87d804380 x1870073673336576/t4294967302(0) o4->65454767-383a-4679-a788-eba05c6e0989@192.168.201.13@tcp:158/0 lens 504/448 e 0 to 0 dl 1783441528 ref 1 fl Complete:H/600/0 rc 0/0 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1783441517.757510:0:6588:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff91a87d804380 with x1870073673336576 ext(0->8) 00010000:00010000:1.0:1783441517.757517:0:6588:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 00000000e62c61d4/0xa2426164df2c7e7b lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.201.13@tcp remote: 0x633a354aa4df4ea1 expref: 9 pid: 6581 timeout: 455 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783441517.757531:0:6588:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 00000000e62c61d4/0xa2426164df2c7e7b lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.201.13@tcp remote: 0x633a354aa4df4ea1 expref: 9 pid: 6581 timeout: 455 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1783441517.757537:0:6588:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff91a87d804380 00000100:00100000:0.0:1783441517.761558:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.13@tcp (source: 12345-192.168.201.13@tcp) 00000100:00100000:3.0:1783441517.761909:0:5770:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073673336704 00000100:00100000:3.0:1783441517.761927:0:5770:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073673336704 00010000:00010000:3.0:1783441517.762024:0:5770:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000e62c61d4/0xa2426164df2c7e7b lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.201.13@tcp remote: 0x633a354aa4df4ea1 expref: 9 pid: 6581 timeout: 455 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783441517.762116:0:5770:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.13@tcp, seq: 50 00000100:00100000:3.0:1783441517.762135:0:5770:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a87d7c6680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:65454767-383a-4679-a788-eba05c6e0989+9:2355:x1870073673336704:12345-192.168.201.13@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1783441517.762150:0:5770:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00002000:00010000:3.0:1783441517.762170:0:5770:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0x3:0x0] updating lvb size from disk: 0 -> 9 00002000:00010000:3.0:1783441517.762186:0:5770:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000400:0x3:0x0] updating lvb mtime from disk: 0 -> 1783441518 00002000:00010000:3.0:1783441517.762188:0:5770:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000400:0x3:0x0] updating lvb atime from disk: 0 -> 1783441518 00002000:00010000:3.0:1783441517.762190:0:5770:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000400:0x3:0x0] updating lvb ctime from disk: 0 -> 1783441518 00010000:00010000:3.0:1783441517.762197:0:5770:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000e62c61d4/0xa2426164df2c7e7b lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.201.13@tcp remote: 0x633a354aa4df4ea1 expref: 9 pid: 6581 timeout: 455 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783441517.762210:0:5770:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000e62c61d4/0xa2426164df2c7e7b lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.201.13@tcp remote: 0x633a354aa4df4ea1 expref: 9 pid: 6581 timeout: 455 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783441517.762236:0:5770:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000e62c61d4/0xa2426164df2c7e7b lrc: 0/0,0 mode: --/PW res: [0x280000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.201.13@tcp remote: 0x633a354aa4df4ea1 expref: 9 pid: 6581 timeout: 455 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783441517.762257:0:5770:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1783441517.762262:0:5770:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1783441517.762268:0:5770:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 000000006a8a89ea/0xa2426164df2c7eba lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 6583 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783441517.762278:0:5770:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000006a8a89ea/0xa2426164df2c7eba lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 6583 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783441517.762314:0:5770:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1783441517.762374:0:5770:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a87d7c6680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:65454767-383a-4679-a788-eba05c6e0989+8:2355:x1870073673336704:12345-192.168.201.13@tcp:103:ldlm_bl.0 Request processed in 249us (827us total) trans 0 rc 0/0 00000100:00100000:3.0:1783441517.762387:0:5770:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.13@tcp, seq: 50 00010000:00010000:0.0:1783441517.762449:0:6583:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 000000006a8a89ea/0xa2426164df2c7eba lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6583 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783441517.762459:0:6583:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000006a8a89ea/0xa2426164df2c7eba lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6583 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783441517.762483:0:6583:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000006a8a89ea/0xa2426164df2c7eba lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6583 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783441517.762490:0:6583:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000006a8a89ea/0xa2426164df2c7eba lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6583 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783441517.762498:0:6583:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000006a8a89ea/0xa2426164df2c7eba lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6583 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783441517.762506:0:6583:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91a87da46200 already unused, calling callback (ffffffffc155ff90) 00010000:00010000:0.0:1783441517.762510:0:6583:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000006a8a89ea/0xa2426164df2c7eba lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6583 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783441517.762518:0:6583:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000006a8a89ea/0xa2426164df2c7eba lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6583 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783441517.762531:0:6583:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000006a8a89ea/0xa2426164df2c7eba lrc: 2/0,0 mode: --/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6583 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783441517.762550:0:6583:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000006a8a89ea/0xa2426164df2c7eba lrc: 0/0,0 mode: --/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6583 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783441517.762618:0:6583:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a87d806d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:65454767-383a-4679-a788-eba05c6e0989+7:2354:x1870073673336448:12345-192.168.201.13@tcp:1:lfs.0 Request processed in 11055us (11244us total) trans 0 rc 0/0 00000100:00100000:0.0:1783441517.762626:0:6583:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.13@tcp, seq: 37 00000100:00100000:0.0:1783441517.767666:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.13@tcp (source: 12345-192.168.201.13@tcp) 00000100:00100000:2.0:1783441517.768371:0:5789:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073673336960 00000100:00100000:2.0:1783441517.768386:0:5789:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073673336960 00000100:00100000:2.0:1783441517.768466:0:5789:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.13@tcp, seq: 26 00000100:00100000:2.0:1783441517.768477:0:5789:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a8468a8050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:65454767-383a-4679-a788-eba05c6e0989+39:10488:x1870073673336960:12345-192.168.201.13@tcp:35:lfs.0 00000004:00010000:2.0:1783441517.768553:0:5789:0:(mdt_open.c:1998:mdt_hsm_release()) ### [0x200000401:0x7:0x0] lease broken? 0 ns: mdt-lustre-MDT0000_UUID lock: ffff91a85f83da00/0xa2426164df2c7eac lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.13@tcp remote: 0x633a354aa4df4eb6 expref: 39 pid: 5785 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1783441517.769429:0:5789:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967382 00000001:00080000:2.0:1783441517.769487:0:5789:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967383 00000001:00080000:2.0:1783441517.769835:0:5789:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967384 00010000:00010000:2.0:1783441517.770547:0:5789:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff91a85f83c400/0xa2426164df2c7ec1 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5789 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783441517.770568:0:5789:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff91a85f83cc00/0xa2426164df2c7e66 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.13@tcp remote: 0x633a354aa4df4e93 expref: 43 pid: 5786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783441517.770578:0:5789:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff91a85f83c400/0xa2426164df2c7ec1 lrc: 4/0,1 mode: --/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5789 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783441517.770615:0:5789:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff91a85f83cc00/0xa2426164df2c7e66 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.13@tcp remote: 0x633a354aa4df4e93 expref: 43 pid: 5786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783441517.770642:0:5789:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff91a85f83cc00/0xa2426164df2c7e66 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.13@tcp remote: 0x633a354aa4df4e93 expref: 43 pid: 5786 timeout: 455 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783441517.770654:0:5789:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff91a87da68380 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000_UUID:5789:1870073693279232:192.168.201.13@tcp:104: 00000100:00100000:2.0:1783441517.770733:0:5789:0:(client.c:2702:ptlrpc_set_wait()) set ffff91a87d7f9180 going to sleep for 11 seconds 00000100:00100000:2.0:1783441517.775302:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.13@tcp (source: 12345-192.168.201.13@tcp) 00000100:00100000:3.0:1783441517.775376:0:11514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073673337088 00000100:00100000:3.0:1783441517.775385:0:11514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073673337088 00010000:00010000:3.0:1783441517.775424:0:11514:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff91a85f83cc00/0xa2426164df2c7e66 lrc: 5/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.13@tcp remote: 0x633a354aa4df4e93 expref: 44 pid: 5786 timeout: 455 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783441517.775525:0:11514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.13@tcp, seq: 51 00000100:00100000:3.0:1783441517.775535:0:11514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a875365c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:65454767-383a-4679-a788-eba05c6e0989+44:2354:x1870073673337088:12345-192.168.201.13@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1783441517.775551:0:11514:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1783441517.775559:0:11514:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff91a85f83cc00/0xa2426164df2c7e66 lrc: 5/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.13@tcp remote: 0x633a354aa4df4e93 expref: 44 pid: 5786 timeout: 455 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783441517.775572:0:11514:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff91a85f83cc00/0xa2426164df2c7e66 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.13@tcp remote: 0x633a354aa4df4e93 expref: 44 pid: 5786 timeout: 455 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783441517.775595:0:11514:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff91a8429bd400) 00010000:00010000:3.0:1783441517.775601:0:11514:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff91a85f83c400/0xa2426164df2c7ec1 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5789 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783441517.775609:0:11514:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff91a85f83c400/0xa2426164df2c7ec1 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 5789 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783441517.775617:0:11514:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91a85f83c400/0xa2426164df2c7ec1 lrc: 4/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 5789 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783441517.775640:0:11514:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1783441517.775702:0:11514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a875365c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:65454767-383a-4679-a788-eba05c6e0989+44:2354:x1870073673337088:12345-192.168.201.13@tcp:103:ldlm_bl.0 Request processed in 168us (409us total) trans 0 rc 0/0 00000100:00100000:3.0:1783441517.775709:0:11514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.13@tcp, seq: 51 00010000:00010000:0.0:1783441517.775962:0:5789:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91a85f83cc00/0xa2426164df2c7e66 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.13@tcp remote: 0x633a354aa4df4e93 expref: 43 pid: 5786 timeout: 455 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783441517.775981:0:5789:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff91a87da68380 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000_UUID:5789:1870073693279232:192.168.201.13@tcp:104: 00010000:00010000:0.0:1783441517.776005:0:5789:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff91a85f83c400/0xa2426164df2c7ec1 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5789 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783441517.776014:0:5789:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff91a85f83c400/0xa2426164df2c7ec1 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5789 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783441517.776020:0:5789:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91a85f83c400/0xa2426164df2c7ec1 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5789 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1783441517.776184:0:5789:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967385 00000001:00080000:0.0:1783441517.776390:0:5789:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967386 00000100:00100000:0.0:1783441517.776494:0:5789:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff91a87d7c7b80 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:5789:1870073693279360:0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:0.0:1783441517.776541:0:5789:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783441517.776561:0:5789:0:(client.c:2702:ptlrpc_set_wait()) set ffff91a8501c6240 going to sleep for 11 seconds 00000100:00100000:1.0:1783441517.776620:0:5791:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073693279360 00000100:00100000:1.0:1783441517.776625:0:5791:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073693279360 00000100:00100000:1.0:1783441517.776672:0:5791:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:1.0:1783441517.776680:0:5791:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a87d7c7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:5789:x1870073693279360:12345-0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:1.0:1783441517.776766:0:5791:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a87d7c7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:5789:x1870073693279360:12345-0@lo:1000:mdt_rdpg00_001.0 Request processed in 61us (198us total) trans 0 rc 0/0 00000100:00100000:1.0:1783441517.776783:0:5791:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00080000:1.0:1783441517.778771:0:5781:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1783441517.779042:0:5789:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967301 gen 2 00000004:00080000:0.0:1783441517.779065:0:5789:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967300 committed transno 4294967301 00000004:00080000:0.0:1783441517.779103:0:5789:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff91a875366680, transno 4294967301 00000100:00100000:0.0:1783441517.779125:0:5789:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff91a87d7c7b80 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:5789:1870073693279360:0@lo:1000:mdt_rdpg00_001.0 00000001:00080000:0.0:1783441517.779599:0:5789:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967387 00000100:00100000:0.0:1783441517.779674:0:5789:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff91a87d7c7b80 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:5789:1870073693279488:0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:0.0:1783441517.779726:0:5789:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783441517.779777:0:5789:0:(client.c:2702:ptlrpc_set_wait()) set ffff91a8501c6f00 going to sleep for 11 seconds 00000100:00100000:3.0:1783441517.780554:0:5791:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073693279488 00000100:00100000:3.0:1783441517.780563:0:5791:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073693279488 00000100:00100000:3.0:1783441517.780613:0:5791:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:3.0:1783441517.780623:0:5791:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a87d7c4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:5789:x1870073693279488:12345-0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:3.0:1783441517.780830:0:5791:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a87d7c4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:5789:x1870073693279488:12345-0@lo:1000:mdt_rdpg00_001.0 Request processed in 207us (1102us total) trans 4294967303 rc 0/0 00000100:00100000:3.0:1783441517.780838:0:5791:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:0.0:1783441517.781222:0:5789:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff91a87d7c7b80 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:5789:1870073693279488:0@lo:1000:mdt_rdpg00_001.0 00000001:00080000:0.0:1783441517.781286:0:5789:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967388 00010000:00010000:0.0:1783441517.781331:0:5789:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff91a85f83c400/0xa2426164df2c7ec1 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5789 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783441517.781341:0:5789:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff91a85f83c400/0xa2426164df2c7ec1 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5789 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783441517.781349:0:5789:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff91a85f83c400/0xa2426164df2c7ec1 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5789 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783441517.781355:0:5789:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91a85f83c400 already unused, calling callback (ffffffffc1f9b4f0) 00010000:00010000:0.0:1783441517.781360:0:5789:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91a85f83c400/0xa2426164df2c7ec1 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5789 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783441517.781368:0:5789:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91a85f83c400/0xa2426164df2c7ec1 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5789 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783441517.781385:0:5789:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff91a8429bd400) 00010000:00010000:0.0:1783441517.781387:0:5789:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 28 00010000:00010000:0.0:1783441517.781392:0:5789:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff91a85f83c400/0xa2426164df2c7ec1 lrc: 2/0,0 mode: --/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5789 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783441517.781410:0:5789:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91a85f83c400/0xa2426164df2c7ec1 lrc: 0/0,0 mode: --/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5789 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:0.0:1783441517.781582:0:5789:0:(mdd_object.c:4010:mdd_close()) Object [0x200000401:0x8:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000040:00080000:0.0:1783441517.781665:0:5789:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].3, 64 off8384 00000004:00080000:0.0:1783441517.781677:0:5789:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 355655934867ns, next at 356655932900ns, rc = 0 00000001:00080000:0.0:1783441517.781683:0:5789:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967389 00010000:00010000:0.0:1783441517.781717:0:5789:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff91a8429bd400) 00010000:00010000:0.0:1783441517.781721:0:5789:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:0.0:1783441517.781727:0:5789:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91a85f83da00/0xa2426164df2c7eac lrc: 0/0,0 mode: --/PW res: [0x200000401:0x7:0x0].0x0 bits 0x4/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.13@tcp remote: 0x633a354aa4df4eb6 expref: 47 pid: 5785 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783441517.782554:0:5789:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a8468a8050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:65454767-383a-4679-a788-eba05c6e0989+46:10488:x1870073673336960:12345-192.168.201.13@tcp:35:lfs.0 Request processed in 14073us (14893us total) trans 4294967390 rc 0/0 00000100:00100000:0.0:1783441517.782564:0:5789:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.13@tcp, seq: 26 00000020:00080000:0.0:1783441517.782569:0:5789:0:(tgt_main.c:784:tgt_ses_key_exit()) total 9 transactions per RPC 00000100:00100000:2.0:1783441517.787344:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.13@tcp (source: 12345-192.168.201.13@tcp) 00000100:00100000:3.0:1783441517.787447:0:5786:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073673337216 00000100:00100000:3.0:1783441517.787459:0:5786:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073673337216 00000100:00100000:3.0:1783441517.787568:0:5786:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.13@tcp, seq: 100 00000100:00100000:3.0:1783441517.787579:0:5786:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a875366680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:65454767-383a-4679-a788-eba05c6e0989+46:10488:x1870073673337216:12345-192.168.201.13@tcp:101:lfs.0 00010000:00010000:3.0:1783441517.787603:0:5786:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1783441517.787626:0:5786:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91a841476800/0xa2426164df2c7ec8 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x633a354aa4df4ebd expref: -99 pid: 5786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783441517.787690:0:5786:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91a841476800/0xa2426164df2c7ec8 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.201.13@tcp remote: 0x633a354aa4df4ebd expref: 47 pid: 5786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783441517.787707:0:5786:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff91a841476800/0xa2426164df2c7ec8 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.13@tcp remote: 0x633a354aa4df4ebd expref: 47 pid: 5786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783441517.787729:0:5786:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff91a85faeeb00) 00010000:00010000:3.0:1783441517.787733:0:5786:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1783441517.787737:0:5786:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91a841476800, rc 0) 00000100:00100000:3.0:1783441517.787993:0:5786:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a875366680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:65454767-383a-4679-a788-eba05c6e0989+47:10488:x1870073673337216:12345-192.168.201.13@tcp:101:lfs.0 Request processed in 275us (520us total) trans 0 rc 0/0 00000100:00100000:3.0:1783441517.788001:0:5786:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.13@tcp, seq: 100 00000100:00100000:2.0:1783441517.793239:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.13@tcp (source: 12345-192.168.201.13@tcp) 00000100:00100000:1.0:1783441517.793650:0:5788:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073673337472 00000100:00100000:1.0:1783441517.793661:0:5788:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073673337472 00000100:00100000:1.0:1783441517.793720:0:5788:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.13@tcp, seq: 27 00000100:00100000:1.0:1783441517.793731:0:5788:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a875367b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:65454767-383a-4679-a788-eba05c6e0989+47:10488:x1870073673337472:12345-192.168.201.13@tcp:35:lfs.0 00000100:00100000:1.0:1783441517.794244:0:5788:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a875367b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:65454767-383a-4679-a788-eba05c6e0989+48:10488:x1870073673337472:12345-192.168.201.13@tcp:35:lfs.0 Request processed in 514us (1015us total) trans 4294967391 rc 0/0 00000100:00100000:1.0:1783441517.794252:0:5788:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.13@tcp, seq: 27 00000100:00100000:2.0:1783441517.905534:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.13@tcp (source: 12345-192.168.201.13@tcp) 00000100:00100000:3.0:1783441517.905628:0:5787:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073673337600 00000100:00100000:3.0:1783441517.905638:0:5787:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073673337600 00000100:00100000:3.0:1783441517.905698:0:5787:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.13@tcp, seq: 101 00000100:00100000:3.0:1783441517.905707:0:5787:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a875365f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:65454767-383a-4679-a788-eba05c6e0989+48:10498:x1870073673337600:12345-192.168.201.13@tcp:34:lfs.0 00010000:00010000:3.0:1783441517.905830:0:5787:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff91a841477e00/0xa2426164df2c7ecf lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783441517.905856:0:5787:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91a841477e00/0xa2426164df2c7ecf lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783441517.905868:0:5787:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91a841477e00/0xa2426164df2c7ecf lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783441517.905884:0:5787:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff91a841477200/0xa2426164df2c7ed6 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783441517.905892:0:5787:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91a841477200/0xa2426164df2c7ed6 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783441517.905898:0:5787:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91a841477200/0xa2426164df2c7ed6 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783441517.906018:0:5787:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff91a841477c00/0xa2426164df2c7edd lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783441517.906027:0:5787:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91a841477c00/0xa2426164df2c7edd lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783441517.906034:0:5787:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91a841477c00/0xa2426164df2c7edd lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1783441517.906077:0:5787:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff91a841477c00/0xa2426164df2c7edd lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783441517.906090:0:5787:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff91a841477e00/0xa2426164df2c7ecf lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783441517.906105:0:5787:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff91a841477e00/0xa2426164df2c7ecf lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783441517.906112:0:5787:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff91a841477e00/0xa2426164df2c7ecf lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783441517.906118:0:5787:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91a841477e00 already unused, calling callback (ffffffffc1f9b4f0) 00010000:00010000:3.0:1783441517.906122:0:5787:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91a841477e00/0xa2426164df2c7ecf lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783441517.906130:0:5787:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91a841477e00/0xa2426164df2c7ecf lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783441517.906143:0:5787:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff91a8439b0300) 00010000:00010000:3.0:1783441517.906145:0:5787:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1783441517.906151:0:5787:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff91a841477e00/0xa2426164df2c7ecf lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783441517.906157:0:5787:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91a841477e00/0xa2426164df2c7ecf lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783441517.906171:0:5787:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff91a841477200/0xa2426164df2c7ed6 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783441517.906177:0:5787:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff91a841477200/0xa2426164df2c7ed6 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783441517.906182:0:5787:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff91a841477200/0xa2426164df2c7ed6 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783441517.906188:0:5787:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91a841477200 already unused, calling callback (ffffffffc1f9b4f0) 00010000:00010000:3.0:1783441517.906195:0:5787:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91a841477200/0xa2426164df2c7ed6 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783441517.906202:0:5787:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91a841477200/0xa2426164df2c7ed6 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783441517.906208:0:5787:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff91a85faee500) 00010000:00010000:3.0:1783441517.906211:0:5787:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1783441517.906213:0:5787:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff91a841477200/0xa2426164df2c7ed6 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783441517.906218:0:5787:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91a841477200/0xa2426164df2c7ed6 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783441517.906231:0:5787:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff91a841477c00/0xa2426164df2c7edd lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783441517.906236:0:5787:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff91a841477c00/0xa2426164df2c7edd lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783441517.906242:0:5787:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff91a841477c00/0xa2426164df2c7edd lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783441517.906247:0:5787:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91a841477c00 already unused, calling callback (ffffffffc1f9b4f0) 00010000:00010000:3.0:1783441517.906249:0:5787:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91a841477c00/0xa2426164df2c7edd lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783441517.906255:0:5787:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91a841477c00/0xa2426164df2c7edd lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783441517.906262:0:5787:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff91a85faeeb00) 00010000:00010000:3.0:1783441517.906264:0:5787:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1783441517.906270:0:5787:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff91a841477c00/0xa2426164df2c7edd lrc: 2/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783441517.906276:0:5787:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91a841477c00/0xa2426164df2c7edd lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783441517.906340:0:5787:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a875365f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:65454767-383a-4679-a788-eba05c6e0989+48:10498:x1870073673337600:12345-192.168.201.13@tcp:34:lfs.0 Request processed in 633us (817us total) trans 0 rc 0/0 00000100:00100000:3.0:1783441517.906348:0:5787:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.13@tcp, seq: 101 00000100:00100000:3.0:1783441517.933572:0:3304:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff91a875427100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3304:1870073693279872:0@lo:400:kworker.0 00000100:00100000:3.0:1783441517.933648:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783441517.933714:0:3304:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1783441517.933720:0:3304:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff91a875425c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3304:1870073693279744:0@lo:400:kworker.0 00000100:00100000:3.0:1783441517.933767:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783441517.933891:0:6605:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073693279872 00000100:00100000:3.0:1783441517.933899:0:6605:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073693279872 00000100:00080000:3.0:1783441517.933943:0:5781:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1783441517.933994:0:6605:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073693279744 00000100:00100000:3.0:1783441517.933997:0:6605:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073693279744 00000100:00100000:3.0:1783441517.934021:0:6605:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 150 00000100:00100000:3.0:1783441517.934030:0:6605:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a875427800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3304:x1870073693279872:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1783441517.934096:0:6605:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a875427800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3304:x1870073693279872:12345-0@lo:400:kworker.0 Request processed in 66us (448us total) trans 0 rc 0/0 00000100:00100000:3.0:1783441517.934104:0:6605:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 150 00000100:00100000:3.0:1783441517.934145:0:3304:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff91a875427100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3304:1870073693279872:0@lo:400:kworker.0 00000100:00100000:3.0:1783441517.934173:0:5787:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 151 00000100:00100000:3.0:1783441517.934181:0:5787:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a875425500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3304:x1870073693279744:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1783441517.934214:0:5787:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a875425500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3304:x1870073693279744:12345-0@lo:400:kworker.0 Request processed in 34us (447us total) trans 0 rc 0/0 00000100:00100000:3.0:1783441517.934234:0:5787:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 151 00000100:00100000:3.0:1783441517.934260:0:3304:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff91a875425c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3304:1870073693279744:0@lo:400:kworker.0 00000100:00100000:1.0:1783441517.934352:0:3305:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff91a875424e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3305:1870073693280000:0@lo:400:kworker.0 00000100:00100000:1.0:1783441517.934386:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783441517.934419:0:3305:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:1.0:1783441517.934425:0:3305:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff91a875424700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:6c1ddb50-5795-40c6-a2b6-8f58add9da62:3305:1870073693279616:0@lo:400:kworker.0 00000100:00100000:1.0:1783441517.934447:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783441517.934460:0:3305:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff91a875426300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3305:1870073693280128:0@lo:400:kworker.0 00000100:00100000:1.0:1783441517.934473:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783441517.934855:0:5785:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073693280128 00000100:00100000:2.0:1783441517.934860:0:5785:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073693280128 00000100:00100000:2.0:1783441517.934899:0:5785:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 152 00000100:00100000:2.0:1783441517.934906:0:5785:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a87d682300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3305:x1870073693280128:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1783441517.934978:0:5785:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a87d682300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3305:x1870073693280128:12345-0@lo:400:kworker.0 Request processed in 73us (503us total) trans 0 rc 0/0 00000100:00100000:2.0:1783441517.934983:0:5785:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 152 00000100:00100000:2.0:1783441517.935002:0:3305:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff91a875426300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3305:1870073693280128:0@lo:400:kworker.0 00000100:00080000:1.0:1783441517.935247:0:5781:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1783441517.935865:0:5779:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073693279616 00000100:00100000:3.0:1783441517.935869:0:5779:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073693279616 00000100:00100000:3.0:1783441517.935903:0:5779:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 290 00000100:00100000:3.0:1783441517.935910:0:5779:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a848f72850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6c1ddb50-5795-40c6-a2b6-8f58add9da62+19:3305:x1870073693279616:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1783441517.936058:0:5779:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a848f72850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6c1ddb50-5795-40c6-a2b6-8f58add9da62+19:3305:x1870073693279616:12345-0@lo:400:kworker.0 Request processed in 149us (1610us total) trans 0 rc 0/0 00000100:00100000:3.0:1783441517.936063:0:5779:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 290 00000100:00100000:3.0:1783441517.936323:0:6582:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073693280000 00000100:00100000:3.0:1783441517.936328:0:6582:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073693280000 00000100:00100000:3.0:1783441517.936510:0:6582:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 82 00000100:00100000:3.0:1783441517.936517:0:6582:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a87d681c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:3305:x1870073693280000:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1783441517.936557:0:6582:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a87d681c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:3305:x1870073693280000:12345-0@lo:400:kworker.0 Request processed in 41us (2170us total) trans 0 rc 0/0 00000100:00100000:3.0:1783441517.936563:0:6582:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 82 00000100:00080000:0.0:1783441517.936638:0:5781:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1783441517.936879:0:3305:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff91a875424700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:6c1ddb50-5795-40c6-a2b6-8f58add9da62:3305:1870073693279616:0@lo:400:kworker.0 00000100:00100000:2.0:1783441517.936896:0:3305:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff91a875424e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3305:1870073693280000:0@lo:400:kworker.0 00000100:00100000:2.0:1783441517.957572:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.13@tcp (source: 12345-192.168.201.13@tcp) 00000100:00100000:3.0:1783441517.957664:0:5786:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073673337856 00000100:00100000:3.0:1783441517.957673:0:5786:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073673337856 00000100:00100000:3.0:1783441517.957732:0:5786:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.13@tcp, seq: 102 00000100:00100000:3.0:1783441517.957777:0:5786:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a867cd6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:65454767-383a-4679-a788-eba05c6e0989+48:10501:x1870073673337856:12345-192.168.201.13@tcp:101:lfs.0 00010000:00010000:3.0:1783441517.957799:0:5786:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1783441517.957820:0:5786:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91a841477c00/0xa2426164df2c7ee4 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x633a354aa4df4ec4 expref: -99 pid: 5786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783441517.957905:0:5786:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff91a841477200/0xa2426164df2c7eeb lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783441517.958098:0:5786:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91a841477200/0xa2426164df2c7eeb lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783441517.958110:0:5786:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91a841477200/0xa2426164df2c7eeb lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783441517.958128:0:5786:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff91a841477e00/0xa2426164df2c7ef2 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783441517.958135:0:5786:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91a841477e00/0xa2426164df2c7ef2 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783441517.958142:0:5786:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91a841477e00/0xa2426164df2c7ef2 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783441517.958272:0:5786:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff91a85eb3c200/0xa2426164df2c7ef9 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783441517.958281:0:5786:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91a85eb3c200/0xa2426164df2c7ef9 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783441517.958287:0:5786:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91a85eb3c200/0xa2426164df2c7ef9 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1783441517.958297:0:5786:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x7:0x0]: returning size 9 00010000:00010000:3.0:1783441517.958398:0:5786:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff91a841477200/0xa2426164df2c7eeb lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783441517.958405:0:5786:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff91a841477200/0xa2426164df2c7eeb lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783441517.958411:0:5786:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff91a841477200/0xa2426164df2c7eeb lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783441517.958423:0:5786:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91a841477200 already unused, calling callback (ffffffffc1f9b4f0) 00010000:00010000:3.0:1783441517.958428:0:5786:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91a841477200/0xa2426164df2c7eeb lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783441517.958435:0:5786:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91a841477200/0xa2426164df2c7eeb lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783441517.958448:0:5786:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff91a8439b0300) 00010000:00010000:3.0:1783441517.958452:0:5786:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1783441517.958457:0:5786:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff91a841477200/0xa2426164df2c7eeb lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783441517.958463:0:5786:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91a841477200/0xa2426164df2c7eeb lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783441517.958479:0:5786:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff91a841477e00/0xa2426164df2c7ef2 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783441517.958485:0:5786:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff91a841477e00/0xa2426164df2c7ef2 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783441517.958491:0:5786:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff91a841477e00/0xa2426164df2c7ef2 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783441517.958496:0:5786:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91a841477e00 already unused, calling callback (ffffffffc1f9b4f0) 00010000:00010000:3.0:1783441517.958498:0:5786:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91a841477e00/0xa2426164df2c7ef2 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783441517.958505:0:5786:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91a841477e00/0xa2426164df2c7ef2 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783441517.958523:0:5786:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff91a85faee500) 00010000:00010000:3.0:1783441517.958525:0:5786:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1783441517.958528:0:5786:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff91a841477e00/0xa2426164df2c7ef2 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783441517.958534:0:5786:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91a841477e00/0xa2426164df2c7ef2 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783441517.958575:0:5786:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91a841477c00/0xa2426164df2c7ee4 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.13@tcp remote: 0x633a354aa4df4ec4 expref: 51 pid: 5786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783441517.958589:0:5786:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff91a85eb3c200/0xa2426164df2c7ef9 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.13@tcp remote: 0x633a354aa4df4ec4 expref: 50 pid: 5786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783441517.958596:0:5786:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff91a85faeeb00) 00010000:00010000:3.0:1783441517.958598:0:5786:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1783441517.958601:0:5786:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91a85eb3c200, rc 0) 00000100:00100000:3.0:1783441517.958886:0:5786:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a867cd6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:65454767-383a-4679-a788-eba05c6e0989+50:10501:x1870073673337856:12345-192.168.201.13@tcp:101:lfs.0 Request processed in 1143us (1323us total) trans 4294967392 rc 0/0 00000100:00100000:3.0:1783441517.958893:0:5786:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.13@tcp, seq: 102 00000100:00100000:0.0:1783441517.966197:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.13@tcp (source: 12345-192.168.201.13@tcp) 00000100:00100000:3.0:1783441517.966418:0:6605:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073673337984 00000100:00100000:3.0:1783441517.966429:0:6605:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073673337984 00000100:00100000:3.0:1783441517.966526:0:6605:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.13@tcp, seq: 103 00000100:00100000:3.0:1783441517.966537:0:6605:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a87d7c4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:65454767-383a-4679-a788-eba05c6e0989+50:10501:x1870073673337984:12345-192.168.201.13@tcp:54:lfs.0 00010000:00010000:3.0:1783441517.966608:0:6605:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff91a85eb3da00/0xa2426164df2c7f07 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6605 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783441517.966626:0:6605:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91a85eb3da00/0xa2426164df2c7f07 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6605 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783441517.966652:0:6605:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91a85eb3da00/0xa2426164df2c7f07 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6605 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783441517.966679:0:6605:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff91a85eb3da00/0xa2426164df2c7f07 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6605 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783441517.966686:0:6605:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff91a85eb3da00/0xa2426164df2c7f07 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6605 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783441517.966692:0:6605:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff91a85eb3da00/0xa2426164df2c7f07 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6605 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783441517.966698:0:6605:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91a85eb3da00 already unused, calling callback (ffffffffc1f9b4f0) 00010000:00010000:3.0:1783441517.966703:0:6605:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91a85eb3da00/0xa2426164df2c7f07 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6605 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783441517.966710:0:6605:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91a85eb3da00/0xa2426164df2c7f07 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6605 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783441517.966723:0:6605:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff91a85faeeb00) 00010000:00010000:3.0:1783441517.966725:0:6605:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1783441517.966730:0:6605:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff91a85eb3da00/0xa2426164df2c7f07 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6605 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783441517.966735:0:6605:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91a85eb3da00/0xa2426164df2c7f07 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6605 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783441517.966829:0:6605:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a87d7c4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:65454767-383a-4679-a788-eba05c6e0989+50:10501:x1870073673337984:12345-192.168.201.13@tcp:54:lfs.0 Request processed in 294us (643us total) trans 0 rc 0/0 00000100:00100000:3.0:1783441517.966837:0:6605:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.13@tcp, seq: 103 00000100:00100000:2.0:1783441517.969710:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.13@tcp (source: 12345-192.168.201.13@tcp) 00000100:00100000:0.0:1783441517.969830:0:5789:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073673338240 00000100:00100000:0.0:1783441517.969898:0:5789:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073673338240 00000100:00100000:0.0:1783441517.970062:0:5789:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.13@tcp, seq: 28 00000100:00100000:0.0:1783441517.970073:0:5789:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a87d80c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:65454767-383a-4679-a788-eba05c6e0989+50:10501:x1870073673338240:12345-192.168.201.13@tcp:35:lfs.0 00000100:00100000:0.0:1783441517.970324:0:5789:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a87d80c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:65454767-383a-4679-a788-eba05c6e0989+51:10501:x1870073673338240:12345-192.168.201.13@tcp:35:lfs.0 Request processed in 253us (623us total) trans 4294967393 rc 0/0 00000100:00100000:0.0:1783441517.970331:0:5789:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.13@tcp, seq: 28 00000100:00100000:2.0:1783441518.065380:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.13@tcp (source: 12345-192.168.201.13@tcp) 00000100:00100000:0.0:1783441518.065533:0:5785:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073673338496 00000100:00100000:0.0:1783441518.065543:0:5785:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073673338496 00000100:00100000:0.0:1783441518.065645:0:5785:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.13@tcp, seq: 104 00000100:00100000:0.0:1783441518.065656:0:5785:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a87d80c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:65454767-383a-4679-a788-eba05c6e0989+51:10511:x1870073673338496:12345-192.168.201.13@tcp:101:bash.0 00010000:00010000:0.0:1783441518.065681:0:5785:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1783441518.065684:0:5785:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:0.0:1783441518.065710:0:5785:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91a841476e00/0xa2426164df2c7e89 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.13@tcp remote: 0x633a354aa4df4ea8 expref: 51 pid: 5787 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783441518.065732:0:5785:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff91a8439b0300) 00010000:00010000:0.0:1783441518.065737:0:5785:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1783441518.065797:0:5785:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91a85fe59200/0xa2426164df2c7f0e lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x633a354aa4df4ecb expref: -99 pid: 5785 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783441518.065904:0:5785:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff91a85fe59600/0xa2426164df2c7f15 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783441518.065943:0:5785:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff91a85eb3c200/0xa2426164df2c7ef9 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.13@tcp remote: 0x633a354aa4df4ec4 expref: 51 pid: 5786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783441518.065951:0:5785:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff91a85fe59600/0xa2426164df2c7f15 lrc: 4/0,1 mode: --/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783441518.066268:0:5785:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff91a85eb3c200/0xa2426164df2c7ef9 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.13@tcp remote: 0x633a354aa4df4ec4 expref: 51 pid: 5786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783441518.066283:0:5785:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff91a85eb3c200/0xa2426164df2c7ef9 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.13@tcp remote: 0x633a354aa4df4ec4 expref: 51 pid: 5786 timeout: 455 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783441518.066299:0:5785:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff91a87d7c5880 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5785:1870073693280256:192.168.201.13@tcp:104: 00000100:00100000:0.0:1783441518.066412:0:5785:0:(client.c:2702:ptlrpc_set_wait()) set ffff91a8501c6000 going to sleep for 11 seconds 00000100:00080000:1.0:1783441518.067151:0:5781:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1783441518.070867:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.13@tcp (source: 12345-192.168.201.13@tcp) 00000100:00100000:1.0:1783441518.070967:0:5771:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073673338624 00000100:00100000:1.0:1783441518.070978:0:5771:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073673338624 00010000:00010000:1.0:1783441518.071028:0:5771:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff91a85eb3c200/0xa2426164df2c7ef9 lrc: 5/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.13@tcp remote: 0x633a354aa4df4ec4 expref: 52 pid: 5786 timeout: 455 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783441518.071078:0:5771:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.13@tcp, seq: 52 00000100:00100000:1.0:1783441518.071090:0:5771:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a844b7d500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:65454767-383a-4679-a788-eba05c6e0989+52:2355:x1870073673338624:12345-192.168.201.13@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1783441518.071107:0:5771:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1783441518.071131:0:5771:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff91a85eb3c200/0xa2426164df2c7ef9 lrc: 5/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.13@tcp remote: 0x633a354aa4df4ec4 expref: 52 pid: 5786 timeout: 455 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783441518.071144:0:5771:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff91a85eb3c200/0xa2426164df2c7ef9 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.13@tcp remote: 0x633a354aa4df4ec4 expref: 52 pid: 5786 timeout: 455 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783441518.071167:0:5771:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff91a85faeeb00) 00010000:00010000:1.0:1783441518.071172:0:5771:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff91a85fe59600/0xa2426164df2c7f15 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783441518.071182:0:5771:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff91a85fe59600/0xa2426164df2c7f15 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783441518.071189:0:5771:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91a85fe59600/0xa2426164df2c7f15 lrc: 4/0,1 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783441518.071210:0:5771:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1783441518.071266:0:5771:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a844b7d500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:65454767-383a-4679-a788-eba05c6e0989+52:2355:x1870073673338624:12345-192.168.201.13@tcp:103:ldlm_bl.0 Request processed in 178us (410us total) trans 0 rc 0/0 00000100:00100000:1.0:1783441518.071273:0:5771:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.13@tcp, seq: 52 00010000:00010000:0.0:1783441518.071651:0:5785:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91a85eb3c200/0xa2426164df2c7ef9 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.13@tcp remote: 0x633a354aa4df4ec4 expref: 51 pid: 5786 timeout: 455 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783441518.071669:0:5785:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff91a87d7c5880 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5785:1870073693280256:192.168.201.13@tcp:104: 00010000:00010000:0.0:1783441518.071693:0:5785:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff91a85fe59600/0xa2426164df2c7f15 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783441518.071702:0:5785:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff91a85fe59600/0xa2426164df2c7f15 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783441518.071707:0:5785:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91a85fe59600/0xa2426164df2c7f15 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1783441518.071727:0:5785:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x7:0x0]: returning size 9 00010000:00010000:0.0:1783441518.071908:0:5785:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91a85fe59200/0xa2426164df2c7f0e lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.13@tcp remote: 0x633a354aa4df4ecb expref: 52 pid: 5785 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783441518.071933:0:5785:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff91a85fe59600/0xa2426164df2c7f15 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.13@tcp remote: 0x633a354aa4df4ecb expref: 51 pid: 5785 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783441518.071941:0:5785:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff91a85faeeb00) 00010000:00010000:0.0:1783441518.071944:0:5785:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:0.0:1783441518.071946:0:5785:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91a85fe59600, rc 0) 00000100:00100000:0.0:1783441518.071975:0:5785:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a87d80c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:65454767-383a-4679-a788-eba05c6e0989+51:10511:x1870073673338496:12345-192.168.201.13@tcp:101:bash.0 Request processed in 6322us (6608us total) trans 4294967394 rc 0/0 00000100:00100000:0.0:1783441518.071982:0:5785:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.13@tcp, seq: 104 00000100:00100000:2.0:1783441518.076269:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.13@tcp (source: 12345-192.168.201.13@tcp) 00000100:00100000:0.0:1783441518.076364:0:5787:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073673338880 00000100:00100000:0.0:1783441518.076380:0:5787:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073673338880 00000100:00100000:0.0:1783441518.076442:0:5787:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.13@tcp, seq: 105 00000100:00100000:0.0:1783441518.076451:0:5787:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a844b7f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:65454767-383a-4679-a788-eba05c6e0989+51:10511:x1870073673338880:12345-192.168.201.13@tcp:36:bash.0 00010000:00010000:0.0:1783441518.076716:0:5787:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff91a85fe58c00/0xa2426164df2c7f23 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783441518.076733:0:5787:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91a85fe58c00/0xa2426164df2c7f23 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783441518.076787:0:5787:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91a85fe58c00/0xa2426164df2c7f23 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1783441518.076905:0:5787:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967395 00000004:00010000:0.0:1783441518.077008:0:5787:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000ca3e4c69 reply state 00000000fddb00b9 transno 4294967396 ns: mdt-lustre-MDT0000_UUID lock: ffff91a85fe58c00/0xa2426164df2c7f23 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783441518.077019:0:5787:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1783441518.077169:0:5787:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a844b7f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:65454767-383a-4679-a788-eba05c6e0989+54:10511:x1870073673338880:12345-192.168.201.13@tcp:36:bash.0 Request processed in 718us (909us total) trans 4294967396 rc 0/0 00000100:00100000:0.0:1783441518.077177:0:5787:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.13@tcp, seq: 105 00000020:00080000:0.0:1783441518.077182:0:5787:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:2.0:1783441518.081489:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.13@tcp (source: 12345-192.168.201.13@tcp) 00010000:00010000:1.0:1783441518.081580:0:3290:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff91a85fe58c00/0xa2426164df2c7f23 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783441518.081594:0:3290:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff91a85fe58c00/0xa2426164df2c7f23 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783441518.081602:0:3290:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff91a85fe58c00/0xa2426164df2c7f23 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783441518.081608:0:3290:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91a85fe58c00 already unused, calling callback (ffffffffc1f9b4f0) 00010000:00010000:1.0:1783441518.081613:0:3290:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91a85fe58c00/0xa2426164df2c7f23 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783441518.081638:0:3290:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91a85fe58c00/0xa2426164df2c7f23 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783441518.081655:0:3290:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff91a85faeeb00) 00010000:00010000:1.0:1783441518.081658:0:3290:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1783441518.081664:0:3290:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff91a85fe58c00/0xa2426164df2c7f23 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783441518.081669:0:3290:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91a85fe58c00/0xa2426164df2c7f23 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783441518.081719:0:5786:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073673339008 00000100:00100000:3.0:1783441518.081734:0:5786:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073673339008 00000100:00100000:3.0:1783441518.082116:0:5786:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.13@tcp, seq: 106 00000100:00100000:3.0:1783441518.082126:0:5786:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a87531d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:65454767-383a-4679-a788-eba05c6e0989+53:10511:x1870073673339008:12345-192.168.201.13@tcp:101:bash.0 00010000:00010000:3.0:1783441518.082150:0:5786:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1783441518.082168:0:5786:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91a85eb3da00/0xa2426164df2c7f2a lrc: 2/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x633a354aa4df4ed2 expref: -99 pid: 5786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783441518.082245:0:5786:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff91a85eb3d000/0xa2426164df2c7f31 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783441518.082258:0:5786:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff91a85fe59600/0xa2426164df2c7f15 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.13@tcp remote: 0x633a354aa4df4ecb expref: 54 pid: 5785 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783441518.082266:0:5786:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff91a85eb3d000/0xa2426164df2c7f31 lrc: 4/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x13/0x8 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783441518.082298:0:5786:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff91a85fe59600/0xa2426164df2c7f15 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.13@tcp remote: 0x633a354aa4df4ecb expref: 54 pid: 5785 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783441518.082311:0:5786:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff91a85fe59600/0xa2426164df2c7f15 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.13@tcp remote: 0x633a354aa4df4ecb expref: 54 pid: 5785 timeout: 455 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783441518.082324:0:5786:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff91a875425c00 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5786:1870073693280384:192.168.201.13@tcp:104: 00000100:00100000:3.0:1783441518.082408:0:5786:0:(client.c:2702:ptlrpc_set_wait()) set ffff91a7410c8240 going to sleep for 11 seconds 00000100:00100000:2.0:1783441518.086130:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.13@tcp (source: 12345-192.168.201.13@tcp) 00000100:00100000:1.0:1783441518.086213:0:5770:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073673339136 00000100:00100000:1.0:1783441518.086223:0:5770:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073673339136 00010000:00010000:1.0:1783441518.086266:0:5770:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff91a85fe59600/0xa2426164df2c7f15 lrc: 5/0,0 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.13@tcp remote: 0x633a354aa4df4ecb expref: 55 pid: 5785 timeout: 455 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783441518.086306:0:5770:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.13@tcp, seq: 53 00000100:00100000:1.0:1783441518.086316:0:5770:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a87531f800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:65454767-383a-4679-a788-eba05c6e0989+55:2354:x1870073673339136:12345-192.168.201.13@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1783441518.086331:0:5770:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1783441518.086338:0:5770:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff91a85fe59600/0xa2426164df2c7f15 lrc: 5/0,0 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.13@tcp remote: 0x633a354aa4df4ecb expref: 55 pid: 5785 timeout: 455 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783441518.086352:0:5770:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff91a85fe59600/0xa2426164df2c7f15 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.13@tcp remote: 0x633a354aa4df4ecb expref: 55 pid: 5785 timeout: 455 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783441518.086374:0:5770:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff91a85faeeb00) 00010000:00010000:1.0:1783441518.086379:0:5770:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff91a85eb3d000/0xa2426164df2c7f31 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x13/0x8 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783441518.086406:0:5770:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff91a85eb3d000/0xa2426164df2c7f31 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x50290000000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783441518.086414:0:5770:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91a85eb3d000/0xa2426164df2c7f31 lrc: 4/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x50290000000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783441518.086434:0:5770:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1783441518.086497:0:5770:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a87531f800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:65454767-383a-4679-a788-eba05c6e0989+55:2354:x1870073673339136:12345-192.168.201.13@tcp:103:ldlm_bl.0 Request processed in 182us (375us total) trans 0 rc 0/0 00000100:00100000:1.0:1783441518.086504:0:5770:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.13@tcp, seq: 53 00010000:00010000:3.0:1783441518.086998:0:5786:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91a85fe59600/0xa2426164df2c7f15 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.13@tcp remote: 0x633a354aa4df4ecb expref: 54 pid: 5785 timeout: 455 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783441518.087016:0:5786:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff91a875425c00 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5786:1870073693280384:192.168.201.13@tcp:104: 00010000:00010000:3.0:1783441518.087048:0:5786:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff91a85eb3d000/0xa2426164df2c7f31 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783441518.087059:0:5786:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff91a85eb3d000/0xa2426164df2c7f31 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783441518.087065:0:5786:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91a85eb3d000/0xa2426164df2c7f31 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1783441518.087117:0:5786:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x7:0x0]: returning size 0 00000004:00200000:3.0:1783441518.087122:0:5786:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:3.0:1783441518.087146:0:5786:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff91a85eb3d000/0xa2426164df2c7f31 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783441518.087178:0:5786:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91a85eb3da00/0xa2426164df2c7f2a lrc: 0/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.13@tcp remote: 0x633a354aa4df4ed2 expref: 54 pid: 5786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783441518.087193:0:5786:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff91a85eb3d000/0xa2426164df2c7f31 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.13@tcp remote: 0x633a354aa4df4ed2 expref: 53 pid: 5786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783441518.087200:0:5786:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff91a85faeeb00) 00010000:00010000:3.0:1783441518.087203:0:5786:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1783441518.087205:0:5786:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91a85eb3d000, rc 0) 00000100:00100000:3.0:1783441518.087246:0:5786:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a87531d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:65454767-383a-4679-a788-eba05c6e0989+53:10511:x1870073673339008:12345-192.168.201.13@tcp:101:bash.0 Request processed in 5122us (5767us total) trans 0 rc 0/0 00000100:00100000:3.0:1783441518.087253:0:5786:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.13@tcp, seq: 106 00000100:00100000:2.0:1783441518.092138:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.13@tcp (source: 12345-192.168.201.13@tcp) 00000100:00100000:1.0:1783441518.092221:0:5788:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073673339392 00000100:00100000:1.0:1783441518.092233:0:5788:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073673339392 00000100:00100000:1.0:1783441518.092297:0:5788:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.13@tcp, seq: 29 00000100:00100000:1.0:1783441518.092306:0:5788:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a87531ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:65454767-383a-4679-a788-eba05c6e0989+53:10511:x1870073673339392:12345-192.168.201.13@tcp:35:bash.0 00000100:00100000:1.0:1783441518.092566:0:5788:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a87531ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:65454767-383a-4679-a788-eba05c6e0989+54:10511:x1870073673339392:12345-192.168.201.13@tcp:35:bash.0 Request processed in 260us (438us total) trans 4294967397 rc 0/0 00000100:00100000:1.0:1783441518.092574:0:5788:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.13@tcp, seq: 29 00000100:00100000:1.0:1783441518.180173:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.13@tcp (source: 12345-192.168.201.13@tcp) 00000100:00100000:0.0:1783441518.180274:0:5787:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073673339520 00000100:00100000:0.0:1783441518.180284:0:5787:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073673339520 00000100:00100000:0.0:1783441518.180351:0:5787:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.13@tcp, seq: 107 00000100:00100000:0.0:1783441518.180362:0:5787:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a87d683800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:65454767-383a-4679-a788-eba05c6e0989+54:10517:x1870073673339520:12345-192.168.201.13@tcp:101:lfs.0 00010000:00010000:0.0:1783441518.180389:0:5787:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1783441518.180410:0:5787:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91a85fe58400/0xa2426164df2c7f38 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x633a354aa4df4ed9 expref: -99 pid: 5787 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783441518.180475:0:5787:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff91a85fe59800/0xa2426164df2c7f3f lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783441518.180506:0:5787:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91a85fe59800/0xa2426164df2c7f3f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783441518.180520:0:5787:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91a85fe59800/0xa2426164df2c7f3f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1783441518.180583:0:5787:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x3:0x0]: returning size 7680 00000004:00200000:0.0:1783441518.180587:0:5787:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 1 stripe count 1 MDT count 1 00000004:00010000:0.0:1783441518.180608:0:5787:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff91a85fe59800/0xa2426164df2c7f3f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783441518.180632:0:5787:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91a85fe58400/0xa2426164df2c7f38 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.13@tcp remote: 0x633a354aa4df4ed9 expref: 56 pid: 5787 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783441518.180650:0:5787:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff91a85fe59800/0xa2426164df2c7f3f lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.13@tcp remote: 0x633a354aa4df4ed9 expref: 55 pid: 5787 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783441518.180658:0:5787:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff91a8439b0300) 00010000:00010000:0.0:1783441518.180661:0:5787:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1783441518.180665:0:5787:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91a85fe59800, rc 0) 00000100:00100000:0.0:1783441518.180729:0:5787:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a87d683800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:65454767-383a-4679-a788-eba05c6e0989+55:10517:x1870073673339520:12345-192.168.201.13@tcp:101:lfs.0 Request processed in 369us (566us total) trans 0 rc 0/0 00000100:00100000:0.0:1783441518.180738:0:5787:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.13@tcp, seq: 107 00000100:00100000:2.0:1783441518.185040:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.13@tcp (source: 12345-192.168.201.13@tcp) 00000100:00100000:0.0:1783441518.185186:0:5785:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073673339648 00000100:00100000:0.0:1783441518.185195:0:5785:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073673339648 00000100:00100000:0.0:1783441518.185255:0:5785:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.13@tcp, seq: 108 00000100:00100000:0.0:1783441518.185265:0:5785:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a87531ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:65454767-383a-4679-a788-eba05c6e0989+55:10517:x1870073673339648:12345-192.168.201.13@tcp:101:lfs.0 00010000:00010000:0.0:1783441518.185289:0:5785:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1783441518.185326:0:5785:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91a85fe58200/0xa2426164df2c7f46 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x633a354aa4df4ee0 expref: -99 pid: 5785 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783441518.185389:0:5785:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff91a85fe59000/0xa2426164df2c7f4d lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783441518.185403:0:5785:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91a85fe59000/0xa2426164df2c7f4d lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783441518.185414:0:5785:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91a85fe59000/0xa2426164df2c7f4d lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783441518.185429:0:5785:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff91a85fe58000/0xa2426164df2c7f54 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783441518.185435:0:5785:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91a85fe58000/0xa2426164df2c7f54 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783441518.185441:0:5785:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91a85fe58000/0xa2426164df2c7f54 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783441518.185541:0:5785:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff91a85fe58600/0xa2426164df2c7f5b lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783441518.185550:0:5785:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91a85fe58600/0xa2426164df2c7f5b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783441518.185557:0:5785:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91a85fe58600/0xa2426164df2c7f5b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1783441518.185592:0:5785:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x7:0x0]: returning size 0 00000004:00200000:0.0:1783441518.185597:0:5785:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:0.0:1783441518.185615:0:5785:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff91a85fe58600/0xa2426164df2c7f5b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783441518.185636:0:5785:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91a85fe58600/0xa2426164df2c7f5b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783441518.185645:0:5785:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff91a85fe59000/0xa2426164df2c7f4d lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783441518.185651:0:5785:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff91a85fe59000/0xa2426164df2c7f4d lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783441518.185657:0:5785:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff91a85fe59000/0xa2426164df2c7f4d lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783441518.185663:0:5785:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91a85fe59000 already unused, calling callback (ffffffffc1f9b4f0) 00010000:00010000:0.0:1783441518.185667:0:5785:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91a85fe59000/0xa2426164df2c7f4d lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783441518.185674:0:5785:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91a85fe59000/0xa2426164df2c7f4d lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783441518.185686:0:5785:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff91a8439b0300) 00010000:00010000:0.0:1783441518.185689:0:5785:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1783441518.185694:0:5785:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff91a85fe59000/0xa2426164df2c7f4d lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783441518.185700:0:5785:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91a85fe59000/0xa2426164df2c7f4d lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783441518.185714:0:5785:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff91a85fe58000/0xa2426164df2c7f54 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783441518.185720:0:5785:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff91a85fe58000/0xa2426164df2c7f54 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783441518.185733:0:5785:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff91a85fe58000/0xa2426164df2c7f54 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783441518.185763:0:5785:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91a85fe58000 already unused, calling callback (ffffffffc1f9b4f0) 00010000:00010000:0.0:1783441518.185768:0:5785:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91a85fe58000/0xa2426164df2c7f54 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783441518.185775:0:5785:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91a85fe58000/0xa2426164df2c7f54 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783441518.185783:0:5785:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff91a8439b0b00) 00010000:00010000:0.0:1783441518.185785:0:5785:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1783441518.185788:0:5785:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff91a85fe58000/0xa2426164df2c7f54 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783441518.185793:0:5785:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91a85fe58000/0xa2426164df2c7f54 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783441518.185824:0:5785:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91a85fe58200/0xa2426164df2c7f46 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.13@tcp remote: 0x633a354aa4df4ee0 expref: 57 pid: 5785 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783441518.185836:0:5785:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff91a85fe58600/0xa2426164df2c7f5b lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.13@tcp remote: 0x633a354aa4df4ee0 expref: 56 pid: 5785 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783441518.185856:0:5785:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff91a85faeeb00) 00010000:00010000:0.0:1783441518.185858:0:5785:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1783441518.185860:0:5785:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91a85fe58600, rc 0) 00000100:00100000:0.0:1783441518.185925:0:5785:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a87531ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:65454767-383a-4679-a788-eba05c6e0989+56:10517:x1870073673339648:12345-192.168.201.13@tcp:101:lfs.0 Request processed in 661us (896us total) trans 0 rc 0/0 00000100:00100000:0.0:1783441518.185940:0:5785:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.13@tcp, seq: 108 00000100:00100000:2.0:1783441518.197571:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.13@tcp (source: 12345-192.168.201.13@tcp) 00000100:00100000:2.0:1783441518.197618:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.13@tcp (source: 12345-192.168.201.13@tcp) 00000100:00100000:0.0:1783441518.197691:0:5787:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073673339904 00000100:00100000:0.0:1783441518.197701:0:5787:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073673339904 00000100:00100000:0.0:1783441518.197794:0:5787:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.13@tcp, seq: 109 00000100:00100000:0.0:1783441518.197807:0:5787:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a87531c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:65454767-383a-4679-a788-eba05c6e0989+56:10517:x1870073673339904:12345-192.168.201.13@tcp:101:lfs.0 00010000:00010000:0.0:1783441518.197827:0:5787:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1783441518.197858:0:5787:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91a85fe58400/0xa2426164df2c7f62 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x633a354aa4df4ee7 expref: -99 pid: 5787 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783441518.198143:0:5787:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff91a85fe58800/0xa2426164df2c7f69 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783441518.198159:0:5787:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff91a85eb3d000/0xa2426164df2c7f31 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.13@tcp remote: 0x633a354aa4df4ed2 expref: 57 pid: 5786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783441518.198168:0:5787:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff91a85fe58600/0xa2426164df2c7f5b lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.13@tcp remote: 0x633a354aa4df4ee0 expref: 57 pid: 5785 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783441518.198176:0:5787:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff91a85fe58800/0xa2426164df2c7f69 lrc: 5/0,1 mode: --/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783441518.198210:0:5787:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff91a85fe58600/0xa2426164df2c7f5b lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.13@tcp remote: 0x633a354aa4df4ee0 expref: 57 pid: 5785 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783441518.198224:0:5787:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff91a85fe58600/0xa2426164df2c7f5b lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.13@tcp remote: 0x633a354aa4df4ee0 expref: 57 pid: 5785 timeout: 456 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783441518.198238:0:5787:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff91a87d7c5880 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5787:1870073693280512:192.168.201.13@tcp:104: 00010000:00010000:0.0:1783441518.198350:0:5787:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff91a85eb3d000/0xa2426164df2c7f31 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.13@tcp remote: 0x633a354aa4df4ed2 expref: 57 pid: 5786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783441518.198359:0:5787:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff91a85eb3d000/0xa2426164df2c7f31 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.13@tcp remote: 0x633a354aa4df4ed2 expref: 57 pid: 5786 timeout: 456 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783441518.198368:0:5787:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff91a87d6a0a80 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5787:1870073693280640:192.168.201.13@tcp:104: 00000100:00100000:0.0:1783441518.198391:0:5787:0:(client.c:2702:ptlrpc_set_wait()) set ffff91a8501c6d80 going to sleep for 11 seconds 00000100:00100000:3.0:1783441518.198780:0:11514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073673340032 00000100:00100000:3.0:1783441518.198785:0:11514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073673340032 00010000:00010000:3.0:1783441518.198805:0:11514:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff91a85fe58600/0xa2426164df2c7f5b lrc: 5/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.13@tcp remote: 0x633a354aa4df4ee0 expref: 58 pid: 5785 timeout: 456 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783441518.198849:0:11514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.13@tcp, seq: 54 00000100:00100000:3.0:1783441518.198856:0:11514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a875692a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:65454767-383a-4679-a788-eba05c6e0989+58:2354:x1870073673340032:12345-192.168.201.13@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1783441518.198865:0:11514:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1783441518.198871:0:11514:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff91a85fe58600/0xa2426164df2c7f5b lrc: 5/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.13@tcp remote: 0x633a354aa4df4ee0 expref: 58 pid: 5785 timeout: 456 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783441518.198882:0:11514:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff91a85fe58600/0xa2426164df2c7f5b lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.13@tcp remote: 0x633a354aa4df4ee0 expref: 58 pid: 5785 timeout: 456 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783441518.198900:0:11514:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff91a85faeeb00) 00010000:00010000:3.0:1783441518.198904:0:11514:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff91a85fe58800/0xa2426164df2c7f69 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783441518.198918:0:11514:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 2 ns: mdt-lustre-MDT0000_UUID lock: ffff91a85fe58800/0xa2426164df2c7f69 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783441518.198924:0:11514:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1783441518.198970:0:11514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a875692a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:65454767-383a-4679-a788-eba05c6e0989+58:2354:x1870073673340032:12345-192.168.201.13@tcp:103:ldlm_bl.0 Request processed in 113us (1349us total) trans 0 rc 0/0 00000100:00100000:3.0:1783441518.198977:0:11514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.13@tcp, seq: 54 00010000:00010000:0.0:1783441518.202722:0:5787:0:(ldlm_lockd.c:741:ldlm_handle_ast_error()) ### client (nid 192.168.201.13@tcp) returned -22 from blocking AST (req@00000000ae6f9afd x1870073693280512) - normal race ns: mdt-lustre-MDT0000_UUID lock: ffff91a85fe58600/0xa2426164df2c7f5b lrc: 1/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.13@tcp remote: 0x633a354aa4df4ee0 expref: 57 pid: 5785 timeout: 456 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783441518.202785:0:5787:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91a85fe58600/0xa2426164df2c7f5b lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.13@tcp remote: 0x633a354aa4df4ee0 expref: 57 pid: 5785 timeout: 456 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783441518.202803:0:5787:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff91a87d7c5880 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5787:1870073693280512:192.168.201.13@tcp:104: 00000100:00100000:0.0:1783441518.202819:0:5787:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff91a87d6a0a80 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5787:1870073693280640:192.168.201.13@tcp:104: 00010000:00010000:0.0:1783441518.202854:0:5787:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff91a85faeeb00) 00010000:00010000:0.0:1783441518.202859:0:5787:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff91a85fe58800/0xa2426164df2c7f69 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783441518.202867:0:5787:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 2 ns: mdt-lustre-MDT0000_UUID lock: ffff91a85fe58800/0xa2426164df2c7f69 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783441518.202876:0:5787:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff91a85fe58800/0xa2426164df2c7f69 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783441518.204365:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.13@tcp (source: 12345-192.168.201.13@tcp) 00000100:00100000:3.0:1783441518.204553:0:5769:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073673340160 00000100:00100000:3.0:1783441518.204561:0:5769:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073673340160 00010000:00010000:3.0:1783441518.204601:0:5769:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff91a85eb3d000/0xa2426164df2c7f31 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.13@tcp remote: 0x633a354aa4df4ed2 expref: 57 pid: 5786 timeout: 456 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783441518.204641:0:5769:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.13@tcp, seq: 55 00000100:00100000:3.0:1783441518.204650:0:5769:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a845458450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:65454767-383a-4679-a788-eba05c6e0989+57:2355:x1870073673340160:12345-192.168.201.13@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1783441518.204676:0:5769:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1783441518.204682:0:5769:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff91a85eb3d000/0xa2426164df2c7f31 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.13@tcp remote: 0x633a354aa4df4ed2 expref: 57 pid: 5786 timeout: 456 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783441518.204693:0:5769:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff91a85eb3d000/0xa2426164df2c7f31 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.13@tcp remote: 0x633a354aa4df4ed2 expref: 57 pid: 5786 timeout: 456 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783441518.204714:0:5769:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91a85eb3d000/0xa2426164df2c7f31 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.13@tcp remote: 0x633a354aa4df4ed2 expref: 57 pid: 5786 timeout: 456 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783441518.204728:0:5769:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff91a85faeeb00) 00010000:00010000:3.0:1783441518.204732:0:5769:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff91a85fe58800/0xa2426164df2c7f69 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783441518.204771:0:5769:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff91a85fe58800/0xa2426164df2c7f69 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783441518.204779:0:5769:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91a85fe58800/0xa2426164df2c7f69 lrc: 4/0,1 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783441518.204807:0:5769:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1783441518.204857:0:5769:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a845458450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:65454767-383a-4679-a788-eba05c6e0989+56:2355:x1870073673340160:12345-192.168.201.13@tcp:103:ldlm_bl.0 Request processed in 209us (500us total) trans 0 rc 0/0 00000100:00100000:3.0:1783441518.204864:0:5769:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.13@tcp, seq: 55 00010000:00010000:2.0:1783441518.205214:0:5787:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff91a85fe58800/0xa2426164df2c7f69 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783441518.205222:0:5787:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91a85fe58800/0xa2426164df2c7f69 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1783441518.205241:0:5787:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x7:0x0]: returning size 0 00010000:00010000:2.0:1783441518.205386:0:5787:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91a85fe58400/0xa2426164df2c7f62 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.13@tcp remote: 0x633a354aa4df4ee7 expref: 57 pid: 5787 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783441518.205401:0:5787:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff91a85fe58800/0xa2426164df2c7f69 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.13@tcp remote: 0x633a354aa4df4ee7 expref: 56 pid: 5787 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783441518.205409:0:5787:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff91a85faeeb00) 00010000:00010000:2.0:1783441518.205412:0:5787:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:2.0:1783441518.205414:0:5787:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91a85fe58800, rc 0) 00000100:00100000:2.0:1783441518.205451:0:5787:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a87531c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:65454767-383a-4679-a788-eba05c6e0989+56:10517:x1870073673339904:12345-192.168.201.13@tcp:101:lfs.0 Request processed in 7648us (7890us total) trans 4294967398 rc 0/0 00000100:00100000:2.0:1783441518.205457:0:5787:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.13@tcp, seq: 109 00000100:00100000:2.0:1783441518.209666:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.13@tcp (source: 12345-192.168.201.13@tcp) 00000100:00100000:3.0:1783441518.209734:0:11015:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073673340416 00000100:00100000:3.0:1783441518.209785:0:11015:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073673340416 00000100:00100000:3.0:1783441518.209854:0:11015:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.13@tcp, seq: 7 00000100:00100000:3.0:1783441518.209865:0:11015:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a875691f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:65454767-383a-4679-a788-eba05c6e0989+56:10517:x1870073673340416:12345-192.168.201.13@tcp:103:lfs.0 00010000:00010000:3.0:1783441518.209892:0:11015:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1783441518.209924:0:11015:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91a841476800/0xa2426164df2c7ec8 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.13@tcp remote: 0x633a354aa4df4ebd expref: 56 pid: 5786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783441518.209950:0:11015:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff91a85faeeb00) 00010000:00010000:3.0:1783441518.209956:0:11015:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1783441518.210010:0:11015:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a875691f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:65454767-383a-4679-a788-eba05c6e0989+55:10517:x1870073673340416:12345-192.168.201.13@tcp:103:lfs.0 Request processed in 147us (354us total) trans 0 rc 0/0 00000100:00100000:3.0:1783441518.210017:0:11015:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.13@tcp, seq: 7 00000100:00100000:3.0:1783441518.212925:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.13@tcp (source: 12345-192.168.201.13@tcp) 00000100:00100000:0.0:1783441518.213112:0:5786:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073673340544 00000100:00100000:0.0:1783441518.213129:0:5786:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073673340544 00000100:00100000:0.0:1783441518.213185:0:5786:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.13@tcp, seq: 110 00000100:00100000:0.0:1783441518.213195:0:5786:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a875425c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:65454767-383a-4679-a788-eba05c6e0989+55:10517:x1870073673340544:12345-192.168.201.13@tcp:58:lfs.0 00010000:00010000:0.0:1783441518.213308:0:5786:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff91a85fe58200/0xa2426164df2c7f77 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783441518.213323:0:5786:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91a85fe58200/0xa2426164df2c7f77 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783441518.213335:0:5786:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91a85fe58200/0xa2426164df2c7f77 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:0.0:1783441518.213578:0:5786:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].2, 136 off8464 00000100:00100000:0.0:1783441518.213663:0:5786:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a875425c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:65454767-383a-4679-a788-eba05c6e0989+55:10517:x1870073673340544:12345-192.168.201.13@tcp:58:lfs.0 Request processed in 469us (758us total) trans 0 rc 0/0 00000100:00100000:0.0:1783441518.213672:0:5786:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.13@tcp, seq: 110 00000100:00100000:0.0:1783441518.216563:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.13@tcp (source: 12345-192.168.201.13@tcp) 00000100:00100000:1.0:1783441518.216655:0:6605:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073673340672 00000100:00100000:1.0:1783441518.216664:0:6605:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073673340672 00000100:00100000:1.0:1783441518.216723:0:6605:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.13@tcp, seq: 111 00000100:00100000:1.0:1783441518.216733:0:6605:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a87d6a0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:65454767-383a-4679-a788-eba05c6e0989+55:10517:x1870073673340672:12345-192.168.201.13@tcp:101:lfs.0 00010000:00010000:1.0:1783441518.216876:0:6605:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1783441518.216898:0:6605:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91a87da46200/0xa2426164df2c7f7e lrc: 2/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x633a354aa4df4eee expref: -99 pid: 6605 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783441518.216971:0:6605:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff91a85fe58200/0xa2426164df2c7f77 lrc: 2/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783441518.216996:0:6605:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff91a87da46200/0xa2426164df2c7f7e lrc: 4/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.201.13@tcp remote: 0x633a354aa4df4eee expref: 56 pid: 6605 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783441518.217014:0:6605:0:(ldlm_request.c:385:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: mdt-lustre-MDT0000_UUID lock: ffff91a85fe58200/0xa2426164df2c7f77 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000020 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783441518.217027:0:6605:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff91a87da46200/0xa2426164df2c7f7e lrc: 3/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.13@tcp remote: 0x633a354aa4df4eee expref: 56 pid: 6605 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783441518.217039:0:6605:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff91a85faeeb00) 00010000:00010000:1.0:1783441518.217042:0:6605:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1783441518.217045:0:6605:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff91a87da46200/0xa2426164df2c7f7e lrc: 3/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.13@tcp remote: 0x633a354aa4df4eee expref: 56 pid: 6605 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783441518.217052:0:6605:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91a87da46200, rc 0) 00000100:00100000:1.0:1783441518.217222:0:6605:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a87d6a0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:65454767-383a-4679-a788-eba05c6e0989+56:10517:x1870073673340672:12345-192.168.201.13@tcp:101:lfs.0 Request processed in 489us (667us total) trans 0 rc 0/0 00000100:00100000:1.0:1783441518.217229:0:6605:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.13@tcp, seq: 111 00000100:00100000:0.0:1783441518.445326:0:3303:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff91a875693b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3303:1870073693280768:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1783441518.445399:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783441518.445580:0:6584:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073693280768 00000100:00100000:1.0:1783441518.445589:0:6584:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073693280768 00000100:00100000:1.0:1783441518.445636:0:6584:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 66 00000100:00100000:1.0:1783441518.445646:0:6584:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a87d7c6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3303:x1870073693280768:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1783441518.445669:0:6584:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 49348608 pending 1703936 free 3859808256 avail 3857711104 00000100:00100000:1.0:1783441518.445720:0:6584:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a87d7c6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3303:x1870073693280768:12345-0@lo:13:osp-pre-1-0.0 Request processed in 76us (321us total) trans 0 rc 0/0 00000100:00100000:1.0:1783441518.445727:0:6584:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 66 00000100:00100000:0.0:1783441518.445854:0:3303:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff91a875693b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3303:1870073693280768:0@lo:13:osp-pre-1-0.0 00010000:00010000:1.0:1783441518.767409:0:5772:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:3.0:1783441519.021602:0:11531:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:3.0:1783441519.021614:0:11531:0:(llog_cat.c:841:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1783441519.021693:0:11531:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 3 count 3 00000040:00080000:3.0:1783441519.021702:0:11531:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:3.0:1783441519.021843:0:11531:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff91a875427100 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:11531:1870073693280896:192.168.201.13@tcp:107:hsm_cdtr.0 00000100:00100000:3.0:1783441519.021972:0:11531:0:(client.c:2702:ptlrpc_set_wait()) set ffff91a7410c8f00 going to sleep for 11 seconds 00000100:00100000:3.0:1783441519.027653:0:11531:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff91a875427100 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:11531:1870073693280896:192.168.201.13@tcp:107:hsm_cdtr.0 00000100:00100000:3.0:1783441519.032051:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.13@tcp (source: 12345-192.168.201.13@tcp) 00000100:00100000:0.0:1783441519.034363:0:5786:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073673340800 00000100:00100000:0.0:1783441519.034382:0:5786:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073673340800 00000100:00100000:0.0:1783441519.034482:0:5786:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.13@tcp, seq: 112 00000100:00100000:0.0:1783441519.034495:0:5786:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a875427100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:65454767-383a-4679-a788-eba05c6e0989+56:10518:x1870073673340800:12345-192.168.201.13@tcp:53:lhsmtool_posix.0 00000004:00000080:0.0:1783441519.034533:0:5786:0:(mdt_handler.c:7960:mdt_fid2path()) path get [0x200000401:0x7:0x0] from 18446744073709551615 #0 00000100:00100000:0.0:1783441519.034789:0:5786:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a875427100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:65454767-383a-4679-a788-eba05c6e0989+56:10518:x1870073673340800:12345-192.168.201.13@tcp:53:lhsmtool_posix.0 Request processed in 296us (2750us total) trans 0 rc 0/0 00000100:00100000:0.0:1783441519.034796:0:5786:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.13@tcp, seq: 112 00000100:00100000:3.0:1783441519.043870:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.13@tcp (source: 12345-192.168.201.13@tcp) 00000100:00100000:2.0:1783441519.044316:0:5787:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073673340928 00000100:00100000:2.0:1783441519.044326:0:5787:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073673340928 00000100:00100000:2.0:1783441519.044412:0:5787:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.13@tcp, seq: 113 00000100:00100000:2.0:1783441519.044422:0:5787:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a875424000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:65454767-383a-4679-a788-eba05c6e0989+56:10518:x1870073673340928:12345-192.168.201.13@tcp:34:lhsmtool_posix.0 00010000:00010000:2.0:1783441519.044506:0:5787:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff91a85f83c000/0xa2426164df2c7f85 lrc: 3/1,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783441519.044525:0:5787:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91a85f83c000/0xa2426164df2c7f85 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783441519.044539:0:5787:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91a85f83c000/0xa2426164df2c7f85 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783441519.044610:0:5787:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff91a85f83ca00/0xa2426164df2c7f8c lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x77a79f1b bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783441519.044619:0:5787:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91a85f83ca00/0xa2426164df2c7f8c lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x77a79f1b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783441519.044625:0:5787:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91a85f83ca00/0xa2426164df2c7f8c lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x77a79f1b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783441519.044652:0:5787:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff91a85f83c600/0xa2426164df2c7f93 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783441519.044661:0:5787:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91a85f83c600/0xa2426164df2c7f93 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783441519.044668:0:5787:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91a85f83c600/0xa2426164df2c7f93 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1783441519.044708:0:5787:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x7:0x0]: returning size 0 00000004:00200000:2.0:1783441519.044713:0:5787:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1783441519.044726:0:5787:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff91a85f83c600/0xa2426164df2c7f93 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783441519.044786:0:5787:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff91a85f83c000/0xa2426164df2c7f85 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783441519.044793:0:5787:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff91a85f83c000/0xa2426164df2c7f85 lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783441519.044799:0:5787:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff91a85f83c000/0xa2426164df2c7f85 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783441519.044804:0:5787:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91a85f83c000 already unused, calling callback (ffffffffc1f9b4f0) 00010000:00010000:2.0:1783441519.044814:0:5787:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91a85f83c000/0xa2426164df2c7f85 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783441519.044821:0:5787:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91a85f83c000/0xa2426164df2c7f85 lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783441519.044833:0:5787:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff91a858b90e00) 00010000:00010000:2.0:1783441519.044836:0:5787:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1783441519.044840:0:5787:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff91a85f83c000/0xa2426164df2c7f85 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783441519.044846:0:5787:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91a85f83c000/0xa2426164df2c7f85 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783441519.044859:0:5787:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff91a85f83ca00/0xa2426164df2c7f8c lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x77a79f1b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783441519.044865:0:5787:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff91a85f83ca00/0xa2426164df2c7f8c lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x77a79f1b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783441519.044871:0:5787:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff91a85f83ca00/0xa2426164df2c7f8c lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x77a79f1b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783441519.044882:0:5787:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91a85f83ca00 already unused, calling callback (ffffffffc1f9b4f0) 00010000:00010000:2.0:1783441519.044886:0:5787:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91a85f83ca00/0xa2426164df2c7f8c lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x77a79f1b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783441519.044891:0:5787:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91a85f83ca00/0xa2426164df2c7f8c lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x77a79f1b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783441519.044909:0:5787:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x77a79f1b (ffff91a8429bd700) 00010000:00010000:2.0:1783441519.044912:0:5787:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1783441519.044923:0:5787:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff91a85f83ca00/0xa2426164df2c7f8c lrc: 2/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x77a79f1b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783441519.044929:0:5787:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91a85f83ca00/0xa2426164df2c7f8c lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x77a79f1b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783441519.044944:0:5787:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff91a85f83c600/0xa2426164df2c7f93 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783441519.044949:0:5787:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff91a85f83c600/0xa2426164df2c7f93 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783441519.044954:0:5787:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff91a85f83c600/0xa2426164df2c7f93 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783441519.044958:0:5787:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91a85f83c600 already unused, calling callback (ffffffffc1f9b4f0) 00010000:00010000:2.0:1783441519.044961:0:5787:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91a85f83c600/0xa2426164df2c7f93 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783441519.044966:0:5787:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91a85f83c600/0xa2426164df2c7f93 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783441519.044982:0:5787:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff91a85faeeb00) 00010000:00010000:2.0:1783441519.044985:0:5787:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1783441519.044988:0:5787:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff91a85f83c600/0xa2426164df2c7f93 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783441519.044993:0:5787:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91a85f83c600/0xa2426164df2c7f93 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783441519.045076:0:5787:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a875424000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:65454767-383a-4679-a788-eba05c6e0989+56:10518:x1870073673340928:12345-192.168.201.13@tcp:34:lhsmtool_posix.0 Request processed in 654us (1217us total) trans 0 rc 0/0 00000100:00100000:2.0:1783441519.045085:0:5787:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.13@tcp, seq: 113 00000100:00100000:1.0:1783441519.050982:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.13@tcp (source: 12345-192.168.201.13@tcp) 00000100:00100000:2.0:1783441519.051452:0:5785:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073673341184 00000100:00100000:2.0:1783441519.051463:0:5785:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073673341184 00000100:00100000:2.0:1783441519.051521:0:5785:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.13@tcp, seq: 114 00000100:00100000:2.0:1783441519.051530:0:5785:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a87d681500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:65454767-383a-4679-a788-eba05c6e0989+56:10518:x1870073673341184:12345-192.168.201.13@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1783441519.051551:0:5785:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1783441519.051572:0:5785:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91a85f83cc00/0xa2426164df2c7f9a lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x633a354aa4df4ef5 expref: -99 pid: 5785 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783441519.051695:0:5785:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff91a85f83c400/0xa2426164df2c7fa1 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783441519.051710:0:5785:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91a85f83c400/0xa2426164df2c7fa1 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783441519.051720:0:5785:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91a85f83c400/0xa2426164df2c7fa1 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1783441519.051732:0:5785:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x7:0x0]: returning size 0 00010000:00010000:2.0:1783441519.052250:0:5785:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff91a85f83c400/0xa2426164df2c7fa1 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783441519.052259:0:5785:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff91a85f83c400/0xa2426164df2c7fa1 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783441519.052267:0:5785:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff91a85f83c400/0xa2426164df2c7fa1 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783441519.052273:0:5785:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91a85f83c400 already unused, calling callback (ffffffffc1f9b4f0) 00010000:00010000:2.0:1783441519.052277:0:5785:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91a85f83c400/0xa2426164df2c7fa1 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783441519.052284:0:5785:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91a85f83c400/0xa2426164df2c7fa1 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783441519.052297:0:5785:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff91a85faeeb00) 00010000:00010000:2.0:1783441519.052300:0:5785:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:2.0:1783441519.052305:0:5785:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff91a85f83c400/0xa2426164df2c7fa1 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783441519.052310:0:5785:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91a85f83c400/0xa2426164df2c7fa1 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783441519.052359:0:5785:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff91a85f83cc00/0xa2426164df2c7f9a lrc: 1/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.13@tcp remote: 0x633a354aa4df4ef5 expref: 58 pid: 5785 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783441519.052369:0:5785:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff91a858b90e00) 00010000:00010000:2.0:1783441519.052372:0:5785:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1783441519.052375:0:5785:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91a85f83cc00/0xa2426164df2c7f9a lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.13@tcp remote: 0x633a354aa4df4ef5 expref: 58 pid: 5785 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783441519.052396:0:5785:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91a85f83cc00, rc 0) 00000100:00100000:2.0:1783441519.052506:0:5785:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a87d681500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:65454767-383a-4679-a788-eba05c6e0989+57:10518:x1870073673341184:12345-192.168.201.13@tcp:101:lhsmtool_posix.0 Request processed in 976us (1535us total) trans 4294967399 rc 301/301 00000100:00100000:2.0:1783441519.052513:0:5785:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.13@tcp, seq: 114 00000100:00100000:3.0:1783441519.060645:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.13@tcp (source: 12345-192.168.201.13@tcp) 00000100:00100000:0.0:1783441519.060712:0:5787:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073673341312 00000100:00100000:0.0:1783441519.060724:0:5787:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073673341312 00000100:00100000:0.0:1783441519.060801:0:5787:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.13@tcp, seq: 115 00000100:00100000:0.0:1783441519.060812:0:5787:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a875424380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:65454767-383a-4679-a788-eba05c6e0989+57:10518:x1870073673341312:12345-192.168.201.13@tcp:53:lhsmtool_posix.0 00000004:00000080:0.0:1783441519.060884:0:5787:0:(mdt_handler.c:7960:mdt_fid2path()) path get [0x200000401:0x7:0x0] from 18446744073709551615 #0 00000100:00100000:0.0:1783441519.066944:0:5787:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a875424380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:65454767-383a-4679-a788-eba05c6e0989+57:10518:x1870073673341312:12345-192.168.201.13@tcp:53:lhsmtool_posix.0 Request processed in 6116us (6292us total) trans 0 rc 0/0 00000100:00100000:0.0:1783441519.066962:0:5787:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.13@tcp, seq: 115 00000100:00100000:3.0:1783441519.074153:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.13@tcp (source: 12345-192.168.201.13@tcp) 00000100:00100000:0.0:1783441519.074579:0:5786:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073673341568 00000100:00100000:0.0:1783441519.074590:0:5786:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073673341568 00000100:00100000:0.0:1783441519.074658:0:5786:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.13@tcp, seq: 116 00000100:00100000:0.0:1783441519.074668:0:5786:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a875427480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:65454767-383a-4679-a788-eba05c6e0989+57:10518:x1870073673341568:12345-192.168.201.13@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1783441519.074689:0:5786:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1783441519.074692:0:5786:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:0.0:1783441519.074718:0:5786:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91a85fe59800/0xa2426164df2c7f3f lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.13@tcp remote: 0x633a354aa4df4ed9 expref: 57 pid: 5787 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783441519.074737:0:5786:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff91a8439b0300) 00010000:00010000:0.0:1783441519.074766:0:5786:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1783441519.074780:0:5786:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91a85fe58000/0xa2426164df2c7faf lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x633a354aa4df4efc expref: -99 pid: 5786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:0.0:1783441519.075263:0:5786:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x4:0x0], index 0: 0 00010000:00010000:0.0:1783441519.075477:0:5786:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff91a85fe59000/0xa2426164df2c7fb6 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x9:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783441519.075492:0:5786:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91a85fe59000/0xa2426164df2c7fb6 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783441519.075519:0:5786:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91a85fe59000/0xa2426164df2c7fb6 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783441519.075588:0:5786:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91a85fe58000/0xa2426164df2c7faf lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.13@tcp remote: 0x633a354aa4df4efc expref: 59 pid: 5786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783441519.075604:0:5786:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff91a85fe59000/0xa2426164df2c7fb6 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.13@tcp remote: 0x633a354aa4df4efc expref: 58 pid: 5786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783441519.075612:0:5786:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff91a8439b0b00) 00010000:00010000:0.0:1783441519.075615:0:5786:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1783441519.075617:0:5786:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91a85fe59000, rc 0) 00000100:00100000:0.0:1783441519.075681:0:5786:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a875427480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:65454767-383a-4679-a788-eba05c6e0989+58:10518:x1870073673341568:12345-192.168.201.13@tcp:101:lhsmtool_posix.0 Request processed in 1014us (1537us total) trans 4294967400 rc 0/0 00000100:00100000:0.0:1783441519.075688:0:5786:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.13@tcp, seq: 116 00000100:00100000:2.0:1783441519.087593:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.13@tcp (source: 12345-192.168.201.13@tcp) 00000100:00100000:1.0:1783441519.087683:0:6605:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073673341824 00000100:00100000:1.0:1783441519.087693:0:6605:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073673341824 00000100:00100000:1.0:1783441519.088071:0:6605:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.13@tcp, seq: 117 00000100:00100000:1.0:1783441519.088082:0:6605:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a875693b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:65454767-383a-4679-a788-eba05c6e0989+58:10518:x1870073673341824:12345-192.168.201.13@tcp:36:lhsmtool_posix.0 00010000:00010000:1.0:1783441519.088156:0:6605:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1783441519.088189:0:6605:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91a85fe59000/0xa2426164df2c7fb6 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.13@tcp remote: 0x633a354aa4df4efc expref: 58 pid: 5786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783441519.088209:0:6605:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff91a8439b0b00) 00010000:00010000:1.0:1783441519.088221:0:6605:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1783441519.088243:0:6605:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff91a87da46600/0xa2426164df2c7fc4 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6605 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783441519.088257:0:6605:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91a87da46600/0xa2426164df2c7fc4 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6605 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783441519.088267:0:6605:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91a87da46600/0xa2426164df2c7fc4 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6605 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783441519.088281:0:6605:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff91a87da47200/0xa2426164df2c7fcb lrc: 3/0,1 mode: --/PW res: [0x200000401:0x3:0x0].0xee48492f bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6605 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783441519.088289:0:6605:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91a87da47200/0xa2426164df2c7fcb lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0xee48492f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6605 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783441519.088295:0:6605:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91a87da47200/0xa2426164df2c7fcb lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0xee48492f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6605 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783441519.088378:0:6605:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff91a87da46600/0xa2426164df2c7fc4 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6605 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783441519.088400:0:6605:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff91a87da46600/0xa2426164df2c7fc4 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6605 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783441519.088406:0:6605:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff91a87da46600/0xa2426164df2c7fc4 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6605 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783441519.088413:0:6605:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91a87da46600 already unused, calling callback (ffffffffc1f9b4f0) 00010000:00010000:1.0:1783441519.088417:0:6605:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91a87da46600/0xa2426164df2c7fc4 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6605 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783441519.088425:0:6605:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91a87da46600/0xa2426164df2c7fc4 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6605 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783441519.088434:0:6605:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff91a8439b0300) 00010000:00010000:1.0:1783441519.088437:0:6605:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1783441519.088440:0:6605:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff91a87da46600/0xa2426164df2c7fc4 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6605 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783441519.088445:0:6605:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91a87da46600/0xa2426164df2c7fc4 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6605 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783441519.088456:0:6605:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff91a87da47200/0xa2426164df2c7fcb lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0xee48492f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6605 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783441519.088461:0:6605:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff91a87da47200/0xa2426164df2c7fcb lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0xee48492f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6605 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783441519.088466:0:6605:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff91a87da47200/0xa2426164df2c7fcb lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0xee48492f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6605 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783441519.088470:0:6605:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91a87da47200 already unused, calling callback (ffffffffc1f9b4f0) 00010000:00010000:1.0:1783441519.088479:0:6605:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91a87da47200/0xa2426164df2c7fcb lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0xee48492f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6605 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783441519.088485:0:6605:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91a87da47200/0xa2426164df2c7fcb lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0xee48492f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6605 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783441519.088493:0:6605:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0xee48492f (ffff91a858b90c00) 00010000:00010000:1.0:1783441519.088495:0:6605:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1783441519.088498:0:6605:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff91a87da47200/0xa2426164df2c7fcb lrc: 2/0,0 mode: --/PW res: [0x200000401:0x3:0x0].0xee48492f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6605 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783441519.088503:0:6605:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91a87da47200/0xa2426164df2c7fcb lrc: 0/0,0 mode: --/PW res: [0x200000401:0x3:0x0].0xee48492f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6605 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783441519.088649:0:6605:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a875693b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:65454767-383a-4679-a788-eba05c6e0989+57:10518:x1870073673341824:12345-192.168.201.13@tcp:36:lhsmtool_posix.0 Request processed in 568us (1064us total) trans 0 rc -2/-2 00000100:00100000:1.0:1783441519.088656:0:6605:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.13@tcp, seq: 117 00000100:00100000:1.0:1783441519.096651:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.13@tcp (source: 12345-192.168.201.13@tcp) 00000100:00100000:0.0:1783441519.097185:0:5786:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073673341952 00000100:00100000:0.0:1783441519.097195:0:5786:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073673341952 00000100:00100000:0.0:1783441519.097259:0:5786:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.13@tcp, seq: 118 00000100:00100000:0.0:1783441519.097269:0:5786:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a87d680000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:65454767-383a-4679-a788-eba05c6e0989+57:10518:x1870073673341952:12345-192.168.201.13@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1783441519.097288:0:5786:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1783441519.097311:0:5786:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91a85fe59800/0xa2426164df2c7fd2 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x9:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x633a354aa4df4f03 expref: -99 pid: 5786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783441519.097349:0:5786:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff91a85fe59a00/0xa2426164df2c7fd9 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x9:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783441519.097362:0:5786:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91a85fe59a00/0xa2426164df2c7fd9 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783441519.097387:0:5786:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91a85fe59a00/0xa2426164df2c7fd9 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783441519.097483:0:5786:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91a85fe59800/0xa2426164df2c7fd2 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x9:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.13@tcp remote: 0x633a354aa4df4f03 expref: 59 pid: 5786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783441519.097501:0:5786:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff91a85fe59a00/0xa2426164df2c7fd9 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.13@tcp remote: 0x633a354aa4df4f03 expref: 58 pid: 5786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783441519.097508:0:5786:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff91a8439b0000) 00010000:00010000:0.0:1783441519.097513:0:5786:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:0.0:1783441519.097517:0:5786:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91a85fe59a00, rc 0) 00000100:00100000:0.0:1783441519.097596:0:5786:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a87d680000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:65454767-383a-4679-a788-eba05c6e0989+58:10518:x1870073673341952:12345-192.168.201.13@tcp:101:lhsmtool_posix.0 Request processed in 328us (954us total) trans 0 rc 0/0 00000100:00100000:0.0:1783441519.097603:0:5786:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.13@tcp, seq: 118 00000100:00100000:3.0:1783441519.100688:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.13@tcp (source: 12345-192.168.201.13@tcp) 00000100:00100000:1.0:1783441519.101277:0:6605:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073673342208 00000100:00100000:1.0:1783441519.101288:0:6605:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073673342208 00000100:00100000:1.0:1783441519.101343:0:6605:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.13@tcp, seq: 119 00000100:00100000:1.0:1783441519.101353:0:6605:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a875425880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:65454767-383a-4679-a788-eba05c6e0989+58:10518:x1870073673342208:12345-192.168.201.13@tcp:36:lhsmtool_posix.0 00010000:00010000:1.0:1783441519.101438:0:6605:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff91a87da47200/0xa2426164df2c7fe0 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6605 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783441519.101454:0:6605:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91a87da47200/0xa2426164df2c7fe0 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6605 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783441519.101873:0:6605:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91a87da47200/0xa2426164df2c7fe0 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6605 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:1.0:1783441519.102171:0:6605:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].5, 88 off8560 00000004:00080000:1.0:1783441519.102183:0:6605:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 356976440567ns, next at 357976437990ns, rc = 0 00000004:00010000:1.0:1783441519.102276:0:6605:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000c8511abc reply state 00000000050d510f transno 4294967401 ns: mdt-lustre-MDT0000_UUID lock: ffff91a87da47200/0xa2426164df2c7fe0 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6605 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783441519.102287:0:6605:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1783441519.102393:0:6605:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a875425880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:65454767-383a-4679-a788-eba05c6e0989+60:10518:x1870073673342208:12345-192.168.201.13@tcp:36:lhsmtool_posix.0 Request processed in 1039us (1712us total) trans 4294967401 rc 0/0 00000100:00100000:1.0:1783441519.102400:0:6605:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.13@tcp, seq: 119 00000100:00100000:3.0:1783441519.109142:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.13@tcp (source: 12345-192.168.201.13@tcp) 00000100:00100000:0.0:1783441519.109277:0:5786:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073673342336 00000100:00100000:0.0:1783441519.109286:0:5786:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073673342336 00000100:00100000:0.0:1783441519.109356:0:5786:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.13@tcp, seq: 120 00000100:00100000:0.0:1783441519.109366:0:5786:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a875426680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:65454767-383a-4679-a788-eba05c6e0989+60:10518:x1870073673342336:12345-192.168.201.13@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1783441519.109388:0:5786:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1783441519.109412:0:5786:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91a85fe59000/0xa2426164df2c7fe7 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x9:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x633a354aa4df4f0a expref: -99 pid: 5786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783441519.109469:0:5786:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91a85fe59000/0xa2426164df2c7fe7 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.201.13@tcp remote: 0x633a354aa4df4f0a expref: 61 pid: 5786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783441519.109485:0:5786:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff91a85fe59000/0xa2426164df2c7fe7 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.13@tcp remote: 0x633a354aa4df4f0a expref: 61 pid: 5786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783441519.109521:0:5786:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff91a8439b0000) 00010000:00010000:0.0:1783441519.109524:0:5786:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1783441519.109527:0:5786:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91a85fe59000, rc 0) 00000100:00100000:0.0:1783441519.109597:0:5786:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a875426680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:65454767-383a-4679-a788-eba05c6e0989+61:10518:x1870073673342336:12345-192.168.201.13@tcp:101:lhsmtool_posix.0 Request processed in 233us (467us total) trans 0 rc 0/0 00000100:00100000:0.0:1783441519.109603:0:5786:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.13@tcp, seq: 120 00010000:00010000:2.0:1783441519.113684:0:3289:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff91a87da47200/0xa2426164df2c7fe0 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6605 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783441519.113700:0:3289:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff91a87da47200/0xa2426164df2c7fe0 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6605 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783441519.113708:0:3289:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff91a87da47200/0xa2426164df2c7fe0 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6605 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783441519.113714:0:3289:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91a87da47200 already unused, calling callback (ffffffffc1f9b4f0) 00010000:00010000:2.0:1783441519.113719:0:3289:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91a87da47200/0xa2426164df2c7fe0 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6605 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783441519.113727:0:3289:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91a87da47200/0xa2426164df2c7fe0 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6605 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783441519.113775:0:3289:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff91a8439b0000) 00010000:00010000:2.0:1783441519.113779:0:3289:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:2.0:1783441519.113784:0:3289:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff91a87da47200/0xa2426164df2c7fe0 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6605 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783441519.113790:0:3289:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91a87da47200/0xa2426164df2c7fe0 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6605 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783441519.114245:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.13@tcp (source: 12345-192.168.201.13@tcp) 00000100:00100000:1.0:1783441519.114472:0:8557:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073673342464 00000100:00100000:1.0:1783441519.114482:0:8557:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073673342464 00000100:00100000:1.0:1783441519.114561:0:8557:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.13@tcp, seq: 38 00000100:00100000:1.0:1783441519.114582:0:8557:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a875427b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:65454767-383a-4679-a788-eba05c6e0989+8:2354:x1870073673342464:12345-192.168.201.13@tcp:2:lhsmtool_posix.0 00000100:00080000:0.0:1783441519.114856:0:5781:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1783441519.115245:0:8557:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a875427b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:65454767-383a-4679-a788-eba05c6e0989+9:2354:x1870073673342464:12345-192.168.201.13@tcp:2:lhsmtool_posix.0 Request processed in 663us (1004us total) trans 4294967307 rc 0/0 00000100:00100000:1.0:1783441519.115254:0:8557:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.13@tcp, seq: 38 00000100:00100000:1.0:1783441519.125729:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.13@tcp (source: 12345-192.168.201.13@tcp) 00000100:00100000:2.0:1783441519.129200:0:5788:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073673342720 00000100:00100000:2.0:1783441519.129215:0:5788:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073673342720 00000100:00100000:1.0:1783441519.129422:0:5788:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.13@tcp, seq: 30 00000100:00100000:1.0:1783441519.129434:0:5788:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a87d680380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:65454767-383a-4679-a788-eba05c6e0989+60:10518:x1870073673342720:12345-192.168.201.13@tcp:35:lhsmtool_posix.0 00000100:00100000:1.0:1783441519.129671:0:5788:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a87d680380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:65454767-383a-4679-a788-eba05c6e0989+61:10518:x1870073673342720:12345-192.168.201.13@tcp:35:lhsmtool_posix.0 Request processed in 238us (3953us total) trans 4294967402 rc 0/0 00000100:00100000:1.0:1783441519.129679:0:5788:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.13@tcp, seq: 30 00000100:00100000:0.0:1783441519.136552:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.13@tcp (source: 12345-192.168.201.13@tcp) 00000100:00100000:1.0:1783441519.137384:0:6605:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073673342976 00000100:00100000:1.0:1783441519.137394:0:6605:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073673342976 00000100:00100000:1.0:1783441519.137458:0:6605:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.13@tcp, seq: 121 00000100:00100000:1.0:1783441519.137484:0:6605:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a87d7c5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:65454767-383a-4679-a788-eba05c6e0989+61:10518:x1870073673342976:12345-192.168.201.13@tcp:57:lhsmtool_posix.0 00000100:00100000:1.0:1783441519.137609:0:6605:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a87d7c5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:65454767-383a-4679-a788-eba05c6e0989+61:10518:x1870073673342976:12345-192.168.201.13@tcp:57:lhsmtool_posix.0 Request processed in 127us (1068us total) trans 0 rc 0/0 00000100:00100000:1.0:1783441519.137617:0:6605:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.13@tcp, seq: 121 00000100:00100000:2.0:1783441519.143423:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.13@tcp (source: 12345-192.168.201.13@tcp) 00000100:00100000:0.0:1783441519.143512:0:5786:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073673343104 00000100:00100000:0.0:1783441519.143522:0:5786:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073673343104 00000100:00100000:0.0:1783441519.143625:0:5786:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.13@tcp, seq: 122 00000100:00100000:0.0:1783441519.143636:0:5786:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a875692a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:65454767-383a-4679-a788-eba05c6e0989+61:10518:x1870073673343104:12345-192.168.201.13@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1783441519.143659:0:5786:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1783441519.143682:0:5786:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91a85fe58400/0xa2426164df2c7fee lrc: 2/0,0 mode: --/CR res: [0x200000401:0x9:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x633a354aa4df4f11 expref: -99 pid: 5786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783441519.143786:0:5786:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff91a85fe58600/0xa2426164df2c7ff5 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x9:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783441519.143800:0:5786:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91a85fe58600/0xa2426164df2c7ff5 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783441519.143813:0:5786:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91a85fe58600/0xa2426164df2c7ff5 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1783441519.143856:0:5786:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:0.0:1783441519.143874:0:5786:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff91a85fe58600/0xa2426164df2c7ff5 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783441519.143934:0:5786:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91a85fe58400/0xa2426164df2c7fee lrc: 0/0,0 mode: --/CR res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.13@tcp remote: 0x633a354aa4df4f11 expref: 63 pid: 5786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783441519.143967:0:5786:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff91a85fe58600/0xa2426164df2c7ff5 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.13@tcp remote: 0x633a354aa4df4f11 expref: 62 pid: 5786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783441519.143976:0:5786:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff91a8439b0000) 00010000:00010000:0.0:1783441519.143979:0:5786:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:0.0:1783441519.143983:0:5786:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91a85fe58600, rc 0) 00000100:00100000:0.0:1783441519.144040:0:5786:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a875692a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:65454767-383a-4679-a788-eba05c6e0989+62:10518:x1870073673343104:12345-192.168.201.13@tcp:101:lhsmtool_posix.0 Request processed in 407us (628us total) trans 0 rc 0/0 00000100:00100000:0.0:1783441519.144048:0:5786:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.13@tcp, seq: 122 00000100:00100000:1.0:1783441519.147577:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.13@tcp (source: 12345-192.168.201.13@tcp) 00000100:00100000:3.0:1783441519.147676:0:6582:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073673343232 00000100:00100000:3.0:1783441519.147686:0:6582:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073673343232 00000100:00100000:0.0:1783441519.148074:0:6582:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.13@tcp, seq: 39 00000100:00100000:0.0:1783441519.148086:0:6582:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a87d683480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:65454767-383a-4679-a788-eba05c6e0989+9:2354:x1870073673343232:12345-192.168.201.13@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1783441519.148105:0:6582:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1783441519.148129:0:6582:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000cc470fc7/0xa2426164df2c7ffc lrc: 2/0,0 mode: --/PR res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x633a354aa4df4f18 expref: -99 pid: 6582 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1783441519.148154:0:6582:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x4:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x6a4d2870, blocks: 0x1 00010000:00010000:0.0:1783441519.148173:0:6582:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=357s v=(0 0) 00010000:00010000:0.0:1783441519.148178:0:6582:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1783441519.148188:0:6582:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000cc470fc7/0xa2426164df2c7ffc lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.13@tcp remote: 0x633a354aa4df4f18 expref: 10 pid: 6582 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783441519.148207:0:6582:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000cc470fc7/0xa2426164df2c7ffc lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.13@tcp remote: 0x633a354aa4df4f18 expref: 10 pid: 6582 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783441519.148227:0:6582:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91a85fe59600, rc 0) 00000100:00100000:0.0:1783441519.148289:0:6582:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a87d683480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:65454767-383a-4679-a788-eba05c6e0989+10:2354:x1870073673343232:12345-192.168.201.13@tcp:101:lhsmtool_posix.0 Request processed in 206us (721us total) trans 0 rc 0/0 00000100:00100000:0.0:1783441519.148296:0:6582:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.13@tcp, seq: 39 00000100:00100000:2.0:1783441519.151084:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.13@tcp (source: 12345-192.168.201.13@tcp) 00000100:00100000:3.0:1783441519.151221:0:6605:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073673343488 00000100:00100000:3.0:1783441519.151230:0:6605:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073673343488 00000100:00100000:3.0:1783441519.151289:0:6605:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.13@tcp, seq: 123 00000100:00100000:3.0:1783441519.151300:0:6605:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a87d4ebb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:65454767-383a-4679-a788-eba05c6e0989+62:10518:x1870073673343488:12345-192.168.201.13@tcp:57:lhsmtool_posix.0 00000100:00100000:3.0:1783441519.151407:0:6605:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a87d4ebb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:65454767-383a-4679-a788-eba05c6e0989+62:10518:x1870073673343488:12345-192.168.201.13@tcp:57:lhsmtool_posix.0 Request processed in 108us (333us total) trans 0 rc 0/0 00000100:00100000:3.0:1783441519.151414:0:6605:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.13@tcp, seq: 123 00000100:00100000:2.0:1783441519.157594:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.13@tcp (source: 12345-192.168.201.13@tcp) 00000100:00100000:0.0:1783441519.158042:0:6583:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073673343616 00000100:00100000:0.0:1783441519.158052:0:6583:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073673343616 00000100:00100000:0.0:1783441519.158111:0:6583:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.13@tcp, seq: 40 00000100:00100000:0.0:1783441519.158120:0:6583:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a877fafb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:65454767-383a-4679-a788-eba05c6e0989+10:10518:x1870073673343616:12345-192.168.201.13@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1783441519.158139:0:6583:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1783441519.158158:0:6583:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000006bec2146/0xa2426164df2c8003 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x633a354aa4df4f1f expref: -99 pid: 6583 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783441519.158188:0:6583:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000cc470fc7/0xa2426164df2c7ffc lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.13@tcp remote: 0x633a354aa4df4f18 expref: 11 pid: 6582 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783441519.158197:0:6583:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1783441519.158201:0:6583:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1783441519.158206:0:6583:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000006bec2146/0xa2426164df2c8003 lrc: 4/0,0 mode: --/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.201.13@tcp remote: 0x633a354aa4df4f1f expref: 11 pid: 6583 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783441519.158240:0:6583:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000cc470fc7/0xa2426164df2c7ffc lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.201.13@tcp remote: 0x633a354aa4df4f18 expref: 11 pid: 6582 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783441519.158253:0:6583:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000cc470fc7/0xa2426164df2c7ffc lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.201.13@tcp remote: 0x633a354aa4df4f18 expref: 11 pid: 6582 timeout: 457 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783441519.158281:0:6583:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff91a87d6f2300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:6583:1870073693281024:192.168.201.13@tcp:104: 00000100:00100000:0.0:1783441519.158448:0:6583:0:(client.c:2702:ptlrpc_set_wait()) set ffff91a8501c6d80 going to sleep for 11 seconds 00000100:00100000:0.0:1783441519.161483:0:6583:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff91a87d6f2300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:6583:1870073693281024:192.168.201.13@tcp:104: 00010000:00010000:0.0:1783441519.161519:0:6583:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000006bec2146/0xa2426164df2c8003 lrc: 3/0,0 mode: --/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.201.13@tcp remote: 0x633a354aa4df4f1f expref: 11 pid: 6583 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783441519.161540:0:6583:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91a85fe58400, rc 0) 00000100:00100000:0.0:1783441519.161602:0:6583:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a877fafb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:65454767-383a-4679-a788-eba05c6e0989+11:10518:x1870073673343616:12345-192.168.201.13@tcp:101:lhsmtool_posix.0 Request processed in 3482us (4017us total) trans 0 rc 0/0 00000100:00100000:0.0:1783441519.161611:0:6583:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.13@tcp, seq: 40 00000100:00100000:2.0:1783441519.163905:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.13@tcp (source: 12345-192.168.201.13@tcp) 00000100:00100000:1.0:1783441519.164614:0:5771:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073673343744 00000100:00100000:1.0:1783441519.164625:0:5771:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073673343744 00010000:00010000:1.0:1783441519.164668:0:5771:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000cc470fc7/0xa2426164df2c7ffc lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.201.13@tcp remote: 0x633a354aa4df4f18 expref: 11 pid: 6582 timeout: 457 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783441519.164788:0:5771:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.13@tcp, seq: 56 00000100:00100000:1.0:1783441519.164798:0:5771:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a877face00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:65454767-383a-4679-a788-eba05c6e0989+11:2355:x1870073673343744:12345-192.168.201.13@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1783441519.164815:0:5771:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1783441519.164850:0:5771:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000cc470fc7/0xa2426164df2c7ffc lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.201.13@tcp remote: 0x633a354aa4df4f18 expref: 11 pid: 6582 timeout: 457 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783441519.164864:0:5771:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000cc470fc7/0xa2426164df2c7ffc lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.201.13@tcp remote: 0x633a354aa4df4f18 expref: 11 pid: 6582 timeout: 457 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783441519.164886:0:5771:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000cc470fc7/0xa2426164df2c7ffc lrc: 0/0,0 mode: --/PR res: [0x240000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.201.13@tcp remote: 0x633a354aa4df4f18 expref: 11 pid: 6582 timeout: 457 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783441519.164918:0:5771:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1783441519.164923:0:5771:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1783441519.164931:0:5771:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000006bec2146/0xa2426164df2c8003 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.201.13@tcp remote: 0x633a354aa4df4f1f expref: 10 pid: 6583 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783441519.164970:0:5771:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000006bec2146/0xa2426164df2c8003 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.201.13@tcp remote: 0x633a354aa4df4f1f expref: 10 pid: 6583 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783441519.165013:0:5771:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: 000000006bec2146/0xa2426164df2c8003 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.201.13@tcp remote: 0x633a354aa4df4f1f expref: 10 pid: 6583 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783441519.165027:0:5771:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff91a87d681880 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0000_UUID:5771:1870073693281152:192.168.201.13@tcp:105: 00000100:00100000:1.0:1783441519.165105:0:5771:0:(client.c:2702:ptlrpc_set_wait()) set ffff91a847066780 going to sleep for 11 seconds 00000100:00100000:2.0:1783441519.171593:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.13@tcp (source: 12345-192.168.201.13@tcp) 00000100:00100000:1.0:1783441519.171706:0:5771:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff91a87d681880 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0000_UUID:5771:1870073693281152:192.168.201.13@tcp:105: 00010000:00010000:1.0:1783441519.171733:0:5771:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1783441519.171813:0:5771:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a877face00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:65454767-383a-4679-a788-eba05c6e0989+10:2355:x1870073673343744:12345-192.168.201.13@tcp:103:ldlm_bl.0 Request processed in 7016us (7928us total) trans 0 rc 0/0 00000100:00100000:1.0:1783441519.171833:0:5771:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.13@tcp, seq: 56 00000100:00100000:0.0:1783441519.172489:0:6587:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073673343872 00000100:00100000:0.0:1783441519.172498:0:6587:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073673343872 00002000:00100000:0.0:1783441519.172545:0:6587:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0x4:0x0] (0->12) req@ffff91a877fad180 x1870073673343872/t0(0) o4->65454767-383a-4679-a788-eba05c6e0989@192.168.201.13@tcp:160/0 lens 504/0 e 0 to 0 dl 1783441530 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1783441519.172555:0:6587:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff91a877fad180 with x1870073673343872 ext(0->12) 00002000:00010000:0.0:1783441519.172561:0:6587:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff91a877fad180 00000100:00100000:0.0:1783441519.172595:0:6587:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.13@tcp, seq: 2 00000100:00100000:0.0:1783441519.172604:0:6587:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a877fad180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:65454767-383a-4679-a788-eba05c6e0989+10:2355:x1870073673343872:12345-192.168.201.13@tcp:4:lhsmtool_posix.0 00000100:00100000:0.0:1783441519.173212:0:6587:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a877fad180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:65454767-383a-4679-a788-eba05c6e0989+12:2355:x1870073673343872:12345-192.168.201.13@tcp:4:lhsmtool_posix.0 Request processed in 606us (1627us total) trans 4294967308 rc 0/0 00000100:00100000:0.0:1783441519.173219:0:6587:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.13@tcp, seq: 2 00002000:00100000:0.0:1783441519.173226:0:6587:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0x4:0x0] (0->12) req@ffff91a877fad180 x1870073673343872/t4294967308(0) o4->65454767-383a-4679-a788-eba05c6e0989@192.168.201.13@tcp:160/0 lens 504/448 e 0 to 0 dl 1783441530 ref 1 fl Complete:/600/0 rc 0/0 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1783441519.173238:0:6587:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff91a877fad180 with x1870073673343872 ext(0->12) 00002000:00010000:0.0:1783441519.173242:0:6587:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff91a877fad180 00000100:00100000:0.0:1783441519.186159:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.13@tcp (source: 12345-192.168.201.13@tcp) 00000100:00100000:3.0:1783441519.186247:0:5785:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073673344000 00000100:00100000:3.0:1783441519.186258:0:5785:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073673344000 00000100:00100000:3.0:1783441519.186320:0:5785:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.13@tcp, seq: 124 00000100:00100000:3.0:1783441519.186329:0:5785:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a87d6f2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:65454767-383a-4679-a788-eba05c6e0989+62:10518:x1870073673344000:12345-192.168.201.13@tcp:44:lhsmtool_posix.0 00000001:00080000:0.0:1783441519.226052:0:5807:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967400 is committed 00000004:00080000:0.0:1783441519.226080:0:5807:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 4 committed 00000020:00080000:0.0:1783441519.226109:0:5807:0:(update_trans.c:60:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff91a8501c6240 refcount 2 committed 0 result 0 batchid 3 00000020:00080000:0.0:1783441519.226114:0:5807:0:(update_trans.c:68:top_multiple_thandle_dump()) st ffff91a867cda300 obd lustre-OST0001-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff91a8501c6180 00000020:00080000:0.0:1783441519.226117:0:5807:0:(update_trans.c:68:top_multiple_thandle_dump()) st ffff91a867cdaa00 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff91a87da3f400 00000020:00080000:0.0:1783441519.226139:0:5807:0:(update_trans.c:1341:distribute_txn_batchid_cb()) lustre-MDT0000: 1 batchid updated 00000001:00080000:0.0:1783441519.226145:0:5807:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967402 is committed 00000004:00080000:0.0:1783441519.226150:0:5807:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 6 committed 00000004:00080000:0.0:1783441519.226199:0:5807:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 5 committed 00000020:00080000:0.0:1783441519.226220:0:5807:0:(update_trans.c:60:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff91a8411ca9c0 refcount 2 committed 0 result 0 batchid 2 00000020:00080000:0.0:1783441519.226223:0:5807:0:(update_trans.c:68:top_multiple_thandle_dump()) st ffff91a8506e4400 obd lustre-OST0000-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff91a8411ca180 00000020:00080000:0.0:1783441519.226226:0:5807:0:(update_trans.c:68:top_multiple_thandle_dump()) st ffff91a8506e4a00 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff91a875235800 00000020:00080000:0.0:1783441519.226251:0:5818:0:(update_trans.c:1581:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 3 committed batchid 1 00000020:00080000:0.0:1783441519.226451:0:5818:0:(update_trans.c:1581:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 1 00000100:00100000:0.0:1783441519.226576:0:3304:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff91a87d6f0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3304:1870073693281280:0@lo:6:osp-syn-0-0.0 00000100:00100000:0.0:1783441519.226644:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783441519.226710:0:3305:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff91a87da68380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3305:1870073693281408:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1783441519.226734:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783441519.226792:0:6581:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073693281280 00000100:00100000:0.0:1783441519.226799:0:6581:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073693281280 00000100:00100000:2.0:1783441519.227549:0:5785:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a87d6f2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:65454767-383a-4679-a788-eba05c6e0989+15:10518:x1870073673344000:12345-192.168.201.13@tcp:44:lhsmtool_posix.0 Request processed in 41216us (41394us total) trans 0 rc 0/0 00000100:00100000:2.0:1783441519.227560:0:5785:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.13@tcp, seq: 124 00000100:00100000:0.0:1783441519.227651:0:6581:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073693281408 00000100:00100000:0.0:1783441519.227669:0:6581:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073693281408 00000100:00100000:0.0:1783441519.227702:0:6581:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:0.0:1783441519.227710:0:6581:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a859086680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+7:3304:x1870073693281280:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:0.0:1783441519.227735:0:6581:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x240000400:3 count 1 00010000:00010000:0.0:1783441519.227778:0:6581:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000ddebac60/0xa2426164df2c800a lrc: 3/0,1 mode: --/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6581 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783441519.227796:0:6581:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000009aa69062/0xa2426164df2c7dcc lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.201.13@tcp remote: 0x633a354aa4df4e7e expref: 11 pid: 6581 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783441519.227804:0:6581:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x240000400:0x3:0x0].0x0 since=3s v=(0 0) 00010000:00010000:0.0:1783441519.227807:0:6581:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1783441519.227812:0:6581:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000ddebac60/0xa2426164df2c800a lrc: 4/0,1 mode: --/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6581 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783441519.227854:0:6581:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 000000009aa69062/0xa2426164df2c7dcc lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080010020 nid: 192.168.201.13@tcp remote: 0x633a354aa4df4e7e expref: 11 pid: 6581 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783441519.227866:0:6581:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 000000009aa69062/0xa2426164df2c7dcc lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000480010020 nid: 192.168.201.13@tcp remote: 0x633a354aa4df4e7e expref: 11 pid: 6581 timeout: 457 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783441519.227878:0:6581:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff91a87d647100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:6581:1870073693281664:192.168.201.13@tcp:104: 00000100:00100000:0.0:1783441519.227942:0:6581:0:(client.c:2702:ptlrpc_set_wait()) set ffff91a841681900 going to sleep for 11 seconds 00000100:00100000:0.0:1783441519.227961:0:6582:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:0.0:1783441519.227969:0:6582:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a859085500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+7:3305:x1870073693281408:12345-0@lo:2:osp-syn-0-0.0 00002000:00010000:0.0:1783441519.228105:0:6582:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x4:0x0] updating lvb size from disk: 0 -> 13 00002000:00010000:0.0:1783441519.228116:0:6582:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x240000400:0x4:0x0] updating lvb mtime from disk: 0 -> 1783441520 00002000:00010000:0.0:1783441519.228118:0:6582:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x240000400:0x4:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:0.0:1783441519.228120:0:6582:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x240000400:0x4:0x0] updating lvb ctime from disk: 1783441520 -> 1783441520 00002000:00010000:0.0:1783441519.228123:0:6582:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x4:0x0] updating lvb blocks from disk: 1 -> 1 00000100:00100000:0.0:1783441519.228161:0:6582:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a859085500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+8:3305:x1870073693281408:12345-0@lo:2:osp-syn-0-0.0 Request processed in 192us (1425us total) trans 4294967309 rc 0/0 00000100:00100000:0.0:1783441519.228167:0:6582:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00000100:00080000:0.0:1783441519.228187:0:5781:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1783441519.228201:0:3306:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff91a875425180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3306:1870073693281536:0@lo:6:osp-syn-1-0.0 00000100:00100000:0.0:1783441519.228229:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000004:00080000:0.0:1783441519.228277:0:3305:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff91a87da68380/2, rc 0, transno 4294967309 00000100:00100000:0.0:1783441519.228283:0:3305:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff91a87da68380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3305:1870073693281408:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1783441519.228296:0:6582:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073693281536 00000100:00100000:0.0:1783441519.228300:0:6582:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073693281536 00000100:00100000:0.0:1783441519.228323:0:6582:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 43 00000100:00100000:0.0:1783441519.228328:0:6582:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a87d647b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:3306:x1870073693281536:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:0.0:1783441519.228341:0:6582:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x280000400:3 count 1 00002000:00010000:0.0:1783441519.228362:0:6582:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x3:0x0] initial LVB size: 9, mtime: 0x6a4d286e, atime: 0x6a4d286e, ctime: 0x6a4d286e, blocks: 0x1 00010000:00010000:0.0:1783441519.228368:0:6582:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000d1868bb8/0xa2426164df2c8011 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6582 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783441519.228377:0:6582:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=357s v=(0 0) 00010000:00010000:0.0:1783441519.228380:0:6582:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1783441519.228386:0:6582:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000d1868bb8/0xa2426164df2c8011 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6582 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783441519.228399:0:6582:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000d1868bb8/0xa2426164df2c8011 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6582 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783441519.228415:0:6582:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000d1868bb8/0xa2426164df2c8011 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6582 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783441519.228423:0:6582:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000d1868bb8/0xa2426164df2c8011 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 6582 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783441519.228439:0:6582:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:0.0:1783441519.228924:0:6582:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a87d647b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+7:3306:x1870073693281536:12345-0@lo:6:osp-syn-1-0.0 Request processed in 594us (693us total) trans 4294967304 rc 0/0 00000100:00100000:0.0:1783441519.228931:0:6582:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 43 00010000:00010000:0.0:1783441519.228953:0:5773:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1783441519.228960:0:5773:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000d1868bb8/0xa2426164df2c8011 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6582 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783441519.228968:0:5773:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91a85fe59c00 already unused, calling callback (ffffffffc155ff90) 00010000:00010000:0.0:1783441519.228973:0:5773:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000d1868bb8/0xa2426164df2c8011 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6582 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783441519.228983:0:5773:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000d1868bb8/0xa2426164df2c8011 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 6582 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783441519.228999:0:5773:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000d1868bb8/0xa2426164df2c8011 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6582 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783441519.229005:0:5773:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000d1868bb8/0xa2426164df2c8011 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6582 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783441519.229030:0:5773:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783441519.229032:0:5773:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783441519.229033:0:5773:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:0.0:1783441519.229041:0:5781:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000004:00080000:0.0:1783441519.229063:0:3306:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff91a875425180/2, rc 0, transno 4294967304 00000100:00100000:0.0:1783441519.229069:0:3306:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff91a875425180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3306:1870073693281536:0@lo:6:osp-syn-1-0.0 00000100:00100000:3.0:1783441519.232766:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.13@tcp (source: 12345-192.168.201.13@tcp) 00000100:00100000:3.0:1783441519.232809:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.13@tcp (source: 12345-192.168.201.13@tcp) 00000100:00100000:1.0:1783441519.232877:0:6582:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073673344128 00000100:00100000:1.0:1783441519.232887:0:6582:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073673344128 00000100:00100000:1.0:1783441519.233017:0:6582:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.13@tcp, seq: 44 00000100:00100000:1.0:1783441519.233028:0:6582:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a875424e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:65454767-383a-4679-a788-eba05c6e0989+12:2354:x1870073673344128:12345-192.168.201.13@tcp:16:lhsmtool_posix.0 00000100:00100000:0.0:1783441519.233786:0:6581:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff91a87d647100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:6581:1870073693281664:192.168.201.13@tcp:104: 00010000:00010000:0.0:1783441519.233813:0:6581:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000ddebac60/0xa2426164df2c800a lrc: 3/0,1 mode: --/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6581 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783441519.237111:0:5770:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073673344256 00000100:00100000:3.0:1783441519.237125:0:5770:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073673344256 00010000:00010000:3.0:1783441519.237167:0:5770:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 000000009aa69062/0xa2426164df2c7dcc lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.201.13@tcp remote: 0x633a354aa4df4e7e expref: 13 pid: 6581 timeout: 457 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783441519.237207:0:5770:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.13@tcp, seq: 57 00000100:00100000:3.0:1783441519.237217:0:5770:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a875424700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:65454767-383a-4679-a788-eba05c6e0989+13:2354:x1870073673344256:12345-192.168.201.13@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1783441519.237229:0:5770:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1783441519.237235:0:5770:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 000000009aa69062/0xa2426164df2c7dcc lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.201.13@tcp remote: 0x633a354aa4df4e7e expref: 13 pid: 6581 timeout: 457 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783441519.237248:0:5770:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 000000009aa69062/0xa2426164df2c7dcc lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000480010020 nid: 192.168.201.13@tcp remote: 0x633a354aa4df4e7e expref: 13 pid: 6581 timeout: 457 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783441519.237287:0:5770:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000009aa69062/0xa2426164df2c7dcc lrc: 0/0,0 mode: --/PW res: [0x240000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801480010020 nid: 192.168.201.13@tcp remote: 0x633a354aa4df4e7e expref: 13 pid: 6581 timeout: 457 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783441519.237308:0:5770:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1783441519.237312:0:5770:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1783441519.237318:0:5770:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000ddebac60/0xa2426164df2c800a lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 6581 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783441519.237328:0:5770:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000ddebac60/0xa2426164df2c800a lrc: 4/0,1 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 6581 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783441519.237361:0:5770:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1783441519.237417:0:5770:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a875424700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:65454767-383a-4679-a788-eba05c6e0989+12:2354:x1870073673344256:12345-192.168.201.13@tcp:103:ldlm_bl.0 Request processed in 201us (4606us total) trans 0 rc 0/0 00000100:00100000:3.0:1783441519.237425:0:5770:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.13@tcp, seq: 57 00010000:00010000:3.0:1783441519.237456:0:6581:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000ddebac60/0xa2426164df2c800a lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6581 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783441519.237465:0:6581:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000ddebac60/0xa2426164df2c800a lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6581 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783441519.237474:0:6581:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000ddebac60/0xa2426164df2c800a lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6581 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783441519.237481:0:6581:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000ddebac60/0xa2426164df2c800a lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 6581 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783441519.237502:0:6581:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:3.0:1783441519.238288:0:6581:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a859086680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+8:3304:x1870073693281280:12345-0@lo:6:osp-syn-0-0.0 Request processed in 10576us (11642us total) trans 4294967310 rc 0/0 00000100:00100000:3.0:1783441519.238297:0:6581:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00010000:00010000:3.0:1783441519.239361:0:5772:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1783441519.239372:0:5772:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000ddebac60/0xa2426164df2c800a lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6581 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783441519.239384:0:5772:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91a85fe58c00 already unused, calling callback (ffffffffc155ff90) 00010000:00010000:3.0:1783441519.239388:0:5772:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000ddebac60/0xa2426164df2c800a lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6581 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783441519.239398:0:5772:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000ddebac60/0xa2426164df2c800a lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 6581 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783441519.239415:0:5772:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000ddebac60/0xa2426164df2c800a lrc: 1/0,0 mode: --/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6581 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783441519.239421:0:5772:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000ddebac60/0xa2426164df2c800a lrc: 0/0,0 mode: --/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6581 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783441519.239441:0:5772:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783441519.239443:0:5772:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783441519.239444:0:5772:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00080000:3.0:1783441519.239483:0:3304:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff91a87d6f0a80/2, rc 0, transno 4294967310 00000100:00100000:3.0:1783441519.239490:0:3304:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff91a87d6f0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3304:1870073693281280:0@lo:6:osp-syn-0-0.0 00000001:00080000:3.0:1783441519.259646:0:6613:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967309 is committed 00000001:00080000:3.0:1783441519.259663:0:6613:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967308 is committed 00000100:00100000:1.0:1783441519.259845:0:6582:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a875424e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:65454767-383a-4679-a788-eba05c6e0989+6:2354:x1870073673344128:12345-192.168.201.13@tcp:16:lhsmtool_posix.0 Request processed in 26812us (27100us total) trans 0 rc 0/0 00000100:00100000:1.0:1783441519.259857:0:6582:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.13@tcp, seq: 44 00000100:00100000:3.0:1783441519.263036:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.13@tcp (source: 12345-192.168.201.13@tcp) 00000100:00100000:1.0:1783441519.263159:0:6605:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073673344512 00000100:00100000:1.0:1783441519.263168:0:6605:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073673344512 00000100:00100000:1.0:1783441519.263224:0:6605:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.13@tcp, seq: 125 00000100:00100000:1.0:1783441519.263233:0:6605:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a875426300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:65454767-383a-4679-a788-eba05c6e0989+15:10518:x1870073673344512:12345-192.168.201.13@tcp:36:lhsmtool_posix.0 00010000:00010000:1.0:1783441519.263312:0:6605:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1783441519.263337:0:6605:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91a85fe58600/0xa2426164df2c7ff5 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.13@tcp remote: 0x633a354aa4df4f11 expref: 15 pid: 5786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783441519.263355:0:6605:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff91a8439b0000) 00010000:00010000:1.0:1783441519.263360:0:6605:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1783441519.263385:0:6605:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff91a87da47000/0xa2426164df2c8018 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6605 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783441519.263398:0:6605:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91a87da47000/0xa2426164df2c8018 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6605 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783441519.263406:0:6605:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91a87da47000/0xa2426164df2c8018 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6605 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1783441519.263622:0:6605:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 000000000ae29c72 reply state 00000000fae593be transno 4294967403 ns: mdt-lustre-MDT0000_UUID lock: ffff91a87da47000/0xa2426164df2c8018 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6605 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783441519.263632:0:6605:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1783441519.263790:0:6605:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a875426300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:65454767-383a-4679-a788-eba05c6e0989+16:10518:x1870073673344512:12345-192.168.201.13@tcp:36:lhsmtool_posix.0 Request processed in 557us (762us total) trans 4294967403 rc 0/0 00000100:00100000:1.0:1783441519.263798:0:6605:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.13@tcp, seq: 125 00000100:00100000:3.0:1783441519.267269:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.13@tcp (source: 12345-192.168.201.13@tcp) 00010000:00010000:1.0:1783441519.267347:0:3290:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff91a87da47000/0xa2426164df2c8018 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6605 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783441519.267359:0:3290:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff91a87da47000/0xa2426164df2c8018 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6605 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783441519.267367:0:3290:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff91a87da47000/0xa2426164df2c8018 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6605 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783441519.267389:0:3290:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91a87da47000 already unused, calling callback (ffffffffc1f9b4f0) 00010000:00010000:1.0:1783441519.267393:0:3290:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91a87da47000/0xa2426164df2c8018 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6605 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783441519.267399:0:3290:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91a87da47000/0xa2426164df2c8018 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6605 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783441519.267418:0:3290:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff91a8439b0000) 00010000:00010000:1.0:1783441519.267421:0:3290:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1783441519.267425:0:3290:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff91a87da47000/0xa2426164df2c8018 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6605 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783441519.267430:0:3290:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91a87da47000/0xa2426164df2c8018 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6605 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783441519.268332:0:8557:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073673344640 00000100:00100000:0.0:1783441519.268346:0:8557:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073673344640 00000100:00100000:0.0:1783441519.268455:0:8557:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.13@tcp, seq: 45 00000100:00100000:0.0:1783441519.268466:0:8557:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a875426d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:65454767-383a-4679-a788-eba05c6e0989+6:2354:x1870073673344640:12345-192.168.201.13@tcp:2:lhsmtool_posix.0 00002000:00010000:0.0:1783441519.268669:0:8557:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x4:0x0] updating lvb size from disk: 13 -> 13 00002000:00010000:0.0:1783441519.268674:0:8557:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x240000400:0x4:0x0] updating lvb mtime from disk: 1783441520 -> 1783441519 00002000:00010000:0.0:1783441519.268676:0:8557:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x240000400:0x4:0x0] updating lvb atime from disk: 0 -> 1783441518 00002000:00010000:0.0:1783441519.268678:0:8557:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x240000400:0x4:0x0] updating lvb ctime from disk: 1783441520 -> 1783441519 00002000:00010000:0.0:1783441519.268680:0:8557:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x4:0x0] updating lvb blocks from disk: 1 -> 11 00000100:00100000:0.0:1783441519.269002:0:8557:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a875426d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:65454767-383a-4679-a788-eba05c6e0989+7:2354:x1870073673344640:12345-192.168.201.13@tcp:2:lhsmtool_posix.0 Request processed in 536us (1742us total) trans 4294967311 rc 0/0 00000100:00100000:0.0:1783441519.269010:0:8557:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.13@tcp, seq: 45 00000100:00100000:3.0:1783441519.271351:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.13@tcp (source: 12345-192.168.201.13@tcp) 00000100:00100000:0.0:1783441519.271525:0:5786:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073673344896 00000100:00100000:0.0:1783441519.271534:0:5786:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073673344896 00000100:00100000:0.0:1783441519.271601:0:5786:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.13@tcp, seq: 126 00000100:00100000:0.0:1783441519.271610:0:5786:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a87d805c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:65454767-383a-4679-a788-eba05c6e0989+15:10518:x1870073673344896:12345-192.168.201.13@tcp:55:lhsmtool_posix.0 00010000:00010000:0.0:1783441519.271682:0:5786:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff91a85fe59c00/0xa2426164df2c801f lrc: 3/0,1 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783441519.271700:0:5786:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff91a85fe59a00/0xa2426164df2c7fd9 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.13@tcp remote: 0x633a354aa4df4f03 expref: 15 pid: 5786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783441519.271708:0:5786:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff91a85fe59c00/0xa2426164df2c801f lrc: 4/0,1 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783441519.271782:0:5786:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff91a85fe59a00/0xa2426164df2c7fd9 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.13@tcp remote: 0x633a354aa4df4f03 expref: 15 pid: 5786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783441519.271795:0:5786:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff91a85fe59a00/0xa2426164df2c7fd9 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.13@tcp remote: 0x633a354aa4df4f03 expref: 15 pid: 5786 timeout: 457 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783441519.271809:0:5786:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff91a87d647100 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5786:1870073693281792:192.168.201.13@tcp:104: 00000100:00100000:0.0:1783441519.272111:0:5786:0:(client.c:2702:ptlrpc_set_wait()) set ffff91a8582b69c0 going to sleep for 11 seconds 00000100:00100000:2.0:1783441519.275633:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.13@tcp (source: 12345-192.168.201.13@tcp) 00000100:00100000:3.0:1783441519.275711:0:11514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073673345024 00000100:00100000:3.0:1783441519.275721:0:11514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073673345024 00010000:00010000:3.0:1783441519.275789:0:11514:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff91a85fe59a00/0xa2426164df2c7fd9 lrc: 5/0,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.13@tcp remote: 0x633a354aa4df4f03 expref: 16 pid: 5786 timeout: 457 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783441519.275829:0:11514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.13@tcp, seq: 58 00000100:00100000:3.0:1783441519.275840:0:11514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a877fadc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:65454767-383a-4679-a788-eba05c6e0989+16:2355:x1870073673345024:12345-192.168.201.13@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1783441519.275857:0:11514:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1783441519.275865:0:11514:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff91a85fe59a00/0xa2426164df2c7fd9 lrc: 5/0,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.13@tcp remote: 0x633a354aa4df4f03 expref: 16 pid: 5786 timeout: 457 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783441519.275878:0:11514:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff91a85fe59a00/0xa2426164df2c7fd9 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.13@tcp remote: 0x633a354aa4df4f03 expref: 16 pid: 5786 timeout: 457 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783441519.275919:0:11514:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff91a8439b0000) 00010000:00010000:3.0:1783441519.275924:0:11514:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff91a85fe59c00/0xa2426164df2c801f lrc: 3/0,1 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783441519.275934:0:11514:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff91a85fe59c00/0xa2426164df2c801f lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783441519.275942:0:11514:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91a85fe59c00/0xa2426164df2c801f lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783441519.275999:0:11514:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1783441519.276067:0:11514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a877fadc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:65454767-383a-4679-a788-eba05c6e0989+16:2355:x1870073673345024:12345-192.168.201.13@tcp:103:ldlm_bl.0 Request processed in 228us (443us total) trans 0 rc 0/0 00000100:00100000:3.0:1783441519.276075:0:11514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.13@tcp, seq: 58 00010000:00010000:0.0:1783441519.277615:0:5786:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91a85fe59a00/0xa2426164df2c7fd9 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x9:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.13@tcp remote: 0x633a354aa4df4f03 expref: 15 pid: 5786 timeout: 457 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783441519.277639:0:5786:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff91a87d647100 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5786:1870073693281792:192.168.201.13@tcp:104: 00010000:00010000:0.0:1783441519.277664:0:5786:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff91a85fe59c00/0xa2426164df2c801f lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783441519.277674:0:5786:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff91a85fe59c00/0xa2426164df2c801f lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783441519.277697:0:5786:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91a85fe59c00/0xa2426164df2c801f lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783441519.277729:0:5786:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff91a85fe59c00/0xa2426164df2c801f lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783441519.277736:0:5786:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff91a85fe59c00/0xa2426164df2c801f lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783441519.278094:0:5786:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff91a85fe59c00/0xa2426164df2c801f lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783441519.278099:0:5786:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91a85fe59c00 already unused, calling callback (ffffffffc1f9b4f0) 00010000:00010000:0.0:1783441519.278104:0:5786:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91a85fe59c00/0xa2426164df2c801f lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783441519.278110:0:5786:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91a85fe59c00/0xa2426164df2c801f lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783441519.278124:0:5786:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff91a8439b0000) 00010000:00010000:0.0:1783441519.278127:0:5786:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 21 00010000:00010000:0.0:1783441519.278131:0:5786:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff91a85fe59c00/0xa2426164df2c801f lrc: 2/0,0 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783441519.278136:0:5786:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91a85fe59c00/0xa2426164df2c801f lrc: 0/0,0 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783441519.278248:0:5786:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a87d805c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:65454767-383a-4679-a788-eba05c6e0989+14:10518:x1870073673344896:12345-192.168.201.13@tcp:55:lhsmtool_posix.0 Request processed in 6637us (6903us total) trans 0 rc -22/-22 00000100:00100000:0.0:1783441519.278257:0:5786:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.13@tcp, seq: 126 00000100:00100000:2.0:1783441519.281232:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.13@tcp (source: 12345-192.168.201.13@tcp) 00000100:00100000:3.0:1783441519.281316:0:6581:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073673345152 00000100:00100000:3.0:1783441519.281327:0:6581:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073673345152 00000100:00100000:3.0:1783441519.281401:0:6581:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.13@tcp, seq: 46 00000100:00100000:3.0:1783441519.281411:0:6581:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a877faed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:65454767-383a-4679-a788-eba05c6e0989+7:2354:x1870073673345152:12345-192.168.201.13@tcp:1:lhsmtool_posix.0 00010000:00010000:3.0:1783441519.281457:0:6581:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 000000005a18b047/0xa2426164df2c8026 lrc: 3/1,0 mode: --/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6581 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783441519.281477:0:6581:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000006bec2146/0xa2426164df2c8003 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.201.13@tcp remote: 0x633a354aa4df4f1f expref: 7 pid: 6583 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783441519.281485:0:6581:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x240000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1783441519.281490:0:6581:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1783441519.281494:0:6581:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000005a18b047/0xa2426164df2c8026 lrc: 4/1,0 mode: --/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6581 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783441519.281532:0:6581:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 000000006bec2146/0xa2426164df2c8003 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.201.13@tcp remote: 0x633a354aa4df4f1f expref: 7 pid: 6583 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783441519.281546:0:6581:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 000000006bec2146/0xa2426164df2c8003 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.201.13@tcp remote: 0x633a354aa4df4f1f expref: 7 pid: 6583 timeout: 457 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783441519.281560:0:6581:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff91a875365c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:6581:1870073693281920:192.168.201.13@tcp:104: 00000100:00100000:3.0:1783441519.281651:0:6581:0:(client.c:2702:ptlrpc_set_wait()) set ffff91a7410c8f00 going to sleep for 11 seconds 00000100:00100000:1.0:1783441519.285208:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.13@tcp (source: 12345-192.168.201.13@tcp) 00000100:00100000:0.0:1783441519.285303:0:5771:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073673345280 00000100:00100000:0.0:1783441519.285312:0:5771:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073673345280 00010000:00010000:0.0:1783441519.285354:0:5771:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 000000006bec2146/0xa2426164df2c8003 lrc: 5/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.201.13@tcp remote: 0x633a354aa4df4f1f expref: 8 pid: 6583 timeout: 457 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783441519.285402:0:5771:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.13@tcp, seq: 59 00000100:00100000:0.0:1783441519.285410:0:5771:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a87d681880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:65454767-383a-4679-a788-eba05c6e0989+8:2353:x1870073673345280:12345-192.168.201.13@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1783441519.285425:0:5771:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1783441519.285447:0:5771:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 000000006bec2146/0xa2426164df2c8003 lrc: 5/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.201.13@tcp remote: 0x633a354aa4df4f1f expref: 8 pid: 6583 timeout: 457 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783441519.285460:0:5771:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 000000006bec2146/0xa2426164df2c8003 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.201.13@tcp remote: 0x633a354aa4df4f1f expref: 8 pid: 6583 timeout: 457 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783441519.285485:0:5771:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1783441519.285490:0:5771:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1783441519.285495:0:5771:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000005a18b047/0xa2426164df2c8026 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090000000000 nid: local remote: 0x0 expref: -99 pid: 6581 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783441519.285505:0:5771:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000005a18b047/0xa2426164df2c8026 lrc: 4/1,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090000000000 nid: local remote: 0x0 expref: -99 pid: 6581 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783441519.285524:0:5771:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1783441519.285578:0:5771:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a87d681880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:65454767-383a-4679-a788-eba05c6e0989+8:2353:x1870073673345280:12345-192.168.201.13@tcp:103:ldlm_bl.0 Request processed in 168us (379us total) trans 0 rc 0/0 00000100:00100000:0.0:1783441519.285586:0:5771:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.13@tcp, seq: 59 00010000:00010000:3.0:1783441519.285804:0:6581:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000006bec2146/0xa2426164df2c8003 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.201.13@tcp remote: 0x633a354aa4df4f1f expref: 7 pid: 6583 timeout: 457 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783441519.285819:0:6581:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff91a875365c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:6581:1870073693281920:192.168.201.13@tcp:104: 00010000:00010000:3.0:1783441519.285854:0:6581:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 000000005a18b047/0xa2426164df2c8026 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6581 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783441519.285864:0:6581:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 000000005a18b047/0xa2426164df2c8026 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6581 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783441519.285871:0:6581:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000005a18b047/0xa2426164df2c8026 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6581 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783441519.285914:0:6581:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 000000005a18b047/0xa2426164df2c8026 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6581 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783441519.285923:0:6581:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000005a18b047/0xa2426164df2c8026 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6581 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783441519.285931:0:6581:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000005a18b047/0xa2426164df2c8026 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6581 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783441519.285938:0:6581:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91a85eb3d600 already unused, calling callback (ffffffffc155ff90) 00010000:00010000:3.0:1783441519.285942:0:6581:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000005a18b047/0xa2426164df2c8026 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6581 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783441519.285969:0:6581:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000005a18b047/0xa2426164df2c8026 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6581 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783441519.285981:0:6581:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000005a18b047/0xa2426164df2c8026 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6581 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783441519.285988:0:6581:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000005a18b047/0xa2426164df2c8026 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6581 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783441519.286036:0:6581:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a877faed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:65454767-383a-4679-a788-eba05c6e0989+6:2354:x1870073673345152:12345-192.168.201.13@tcp:1:lhsmtool_posix.0 Request processed in 4627us (4814us total) trans 0 rc 0/0 00000100:00100000:3.0:1783441519.286044:0:6581:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.13@tcp, seq: 46 00000100:00100000:2.0:1783441519.289156:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.13@tcp (source: 12345-192.168.201.13@tcp) 00000100:00100000:1.0:1783441519.289266:0:6605:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073673345536 00000100:00100000:1.0:1783441519.289277:0:6605:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073673345536 00000100:00100000:1.0:1783441519.289354:0:6605:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.13@tcp, seq: 127 00000100:00100000:1.0:1783441519.289364:0:6605:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a8749a6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:65454767-383a-4679-a788-eba05c6e0989+14:10518:x1870073673345536:12345-192.168.201.13@tcp:57:lhsmtool_posix.0 00010000:00010000:1.0:1783441519.289451:0:6605:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff91a87da47000/0xa2426164df2c802d lrc: 3/0,1 mode: --/PW res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6605 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783441519.289471:0:6605:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91a87da47000/0xa2426164df2c802d lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6605 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783441519.289485:0:6605:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91a87da47000/0xa2426164df2c802d lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6605 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783441519.289720:0:6605:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff91a87da47200/0xa2426164df2c8034 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x9:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6605 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783441519.289787:0:6605:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff91a85fe59000/0xa2426164df2c7fe7 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.13@tcp remote: 0x633a354aa4df4f0a expref: 15 pid: 5786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783441519.289796:0:6605:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff91a87da47200/0xa2426164df2c8034 lrc: 4/0,1 mode: --/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6605 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783441519.289842:0:6605:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff91a85fe59000/0xa2426164df2c7fe7 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.201.13@tcp remote: 0x633a354aa4df4f0a expref: 15 pid: 5786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783441519.289856:0:6605:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff91a85fe59000/0xa2426164df2c7fe7 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.201.13@tcp remote: 0x633a354aa4df4f0a expref: 15 pid: 5786 timeout: 457 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783441519.289871:0:6605:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff91a87d682680 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:6605:1870073693282048:192.168.201.13@tcp:104: 00000100:00100000:1.0:1783441519.289961:0:6605:0:(client.c:2702:ptlrpc_set_wait()) set ffff91a847066840 going to sleep for 11 seconds 00000100:00100000:1.0:1783441519.292622:0:6605:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff91a87d682680 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:6605:1870073693282048:192.168.201.13@tcp:104: 00010000:00010000:1.0:1783441519.292657:0:6605:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff91a87da47200/0xa2426164df2c8034 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6605 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783441519.295092:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.13@tcp (source: 12345-192.168.201.13@tcp) 00000100:00100000:3.0:1783441519.295306:0:11015:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073673345664 00000100:00100000:3.0:1783441519.295316:0:11015:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073673345664 00010000:00010000:3.0:1783441519.295355:0:11015:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff91a85fe59000/0xa2426164df2c7fe7 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.201.13@tcp remote: 0x633a354aa4df4f0a expref: 16 pid: 5786 timeout: 457 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783441519.295399:0:11015:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.13@tcp, seq: 60 00000100:00100000:3.0:1783441519.295408:0:11015:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a8749a4700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:65454767-383a-4679-a788-eba05c6e0989+16:2355:x1870073673345664:12345-192.168.201.13@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1783441519.295422:0:11015:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1783441519.295429:0:11015:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff91a85fe59000/0xa2426164df2c7fe7 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.201.13@tcp remote: 0x633a354aa4df4f0a expref: 16 pid: 5786 timeout: 457 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783441519.295441:0:11015:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff91a85fe59000/0xa2426164df2c7fe7 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.201.13@tcp remote: 0x633a354aa4df4f0a expref: 16 pid: 5786 timeout: 457 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783441519.295481:0:11015:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91a85fe59000/0xa2426164df2c7fe7 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.201.13@tcp remote: 0x633a354aa4df4f0a expref: 16 pid: 5786 timeout: 457 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783441519.295498:0:11015:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff91a8439b0000) 00010000:00010000:3.0:1783441519.295503:0:11015:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff91a87da47200/0xa2426164df2c8034 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6605 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783441519.295513:0:11015:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff91a87da47200/0xa2426164df2c8034 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 6605 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783441519.295521:0:11015:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91a87da47200/0xa2426164df2c8034 lrc: 4/0,1 mode: EX/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 6605 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783441519.295655:0:11015:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1783441519.295719:0:11015:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a8749a4700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:65454767-383a-4679-a788-eba05c6e0989+15:2355:x1870073673345664:12345-192.168.201.13@tcp:103:ldlm_bl.0 Request processed in 310us (635us total) trans 0 rc 0/0 00000100:00100000:3.0:1783441519.295727:0:11015:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.13@tcp, seq: 60 00010000:00010000:1.0:1783441519.297293:0:6605:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff91a87da47200/0xa2426164df2c8034 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6605 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783441519.297310:0:6605:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91a87da47200/0xa2426164df2c8034 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6605 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1783441519.297513:0:6605:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967404 00000001:00080000:1.0:1783441519.297679:0:6605:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967405 00000001:00080000:1.0:1783441519.297729:0:6605:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967406 00000100:00100000:1.0:1783441519.298034:0:6605:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff91a87d682680 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-mdtlov_UUID:6605:1870073693282176:0@lo:1000:mdt00_003.0 00000100:00100000:1.0:1783441519.298112:0:6605:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783441519.298247:0:6605:0:(client.c:2702:ptlrpc_set_wait()) set ffff91a8470660c0 going to sleep for 11 seconds 00000100:00100000:3.0:1783441519.298537:0:5791:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073693282176 00000100:00100000:3.0:1783441519.298544:0:5791:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073693282176 00000100:00100000:2.0:1783441519.298768:0:5791:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:2.0:1783441519.298779:0:5791:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a87d683b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:6605:x1870073693282176:12345-0@lo:1000:mdt00_003.0 00000100:00100000:2.0:1783441519.299262:0:5791:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a87d683b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:6605:x1870073693282176:12345-0@lo:1000:mdt00_003.0 Request processed in 483us (1148us total) trans 0 rc 0/0 00000100:00100000:2.0:1783441519.299271:0:5791:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:1.0:1783441519.299333:0:6605:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967309 gen 2 00000004:00080000:1.0:1783441519.299339:0:6605:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967305 committed transno 4294967309 00000004:00080000:1.0:1783441519.299362:0:6605:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff91a87da68380, transno 4294967309 00000100:00100000:1.0:1783441519.299386:0:6605:0:(client.c:3156:ptlrpc_free_committed()) @@@ stopping search req@ffff91a87d6f0a80 x1870073693281280/t4294967310(4294967310) o6->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 544/432 e 0 to 0 dl 1783441535 ref 1 fl Complete:RQU/204/0 rc 0/0 job:'osp-syn-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1783441519.299398:0:6605:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff91a87d682680 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-mdtlov_UUID:6605:1870073693282176:0@lo:1000:mdt00_003.0 00000001:00080000:1.0:1783441519.299952:0:6605:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967407 00000100:00100000:1.0:1783441519.300026:0:6605:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff91a87d682680 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-mdtlov_UUID:6605:1870073693282304:0@lo:1000:mdt00_003.0 00000100:00100000:1.0:1783441519.300063:0:6605:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783441519.300613:0:6605:0:(client.c:2702:ptlrpc_set_wait()) set ffff91a847066840 going to sleep for 11 seconds 00000100:00100000:0.0:1783441519.300644:0:5790:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073693282304 00000100:00100000:0.0:1783441519.300658:0:5790:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073693282304 00000100:00100000:0.0:1783441519.300696:0:5790:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:0.0:1783441519.300705:0:5790:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a87d681180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:6605:x1870073693282304:12345-0@lo:1000:mdt00_003.0 00000100:00100000:0.0:1783441519.301146:0:5790:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a87d681180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+7:6605:x1870073693282304:12345-0@lo:1000:mdt00_003.0 Request processed in 442us (1080us total) trans 4294967312 rc 0/0 00000100:00100000:0.0:1783441519.301154:0:5790:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:1.0:1783441519.301315:0:6605:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff91a87d682680 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-mdtlov_UUID:6605:1870073693282304:0@lo:1000:mdt00_003.0 00010000:00010000:1.0:1783441519.301354:0:6605:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff91a87da47200/0xa2426164df2c8034 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6605 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783441519.301364:0:6605:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff91a87da47200/0xa2426164df2c8034 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6605 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783441519.301371:0:6605:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff91a87da47200/0xa2426164df2c8034 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6605 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783441519.301376:0:6605:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91a87da47200 already unused, calling callback (ffffffffc1f9b4f0) 00010000:00010000:1.0:1783441519.301381:0:6605:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91a87da47200/0xa2426164df2c8034 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6605 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783441519.301389:0:6605:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91a87da47200/0xa2426164df2c8034 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6605 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783441519.301418:0:6605:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff91a8439b0000) 00010000:00010000:1.0:1783441519.301421:0:6605:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1783441519.301426:0:6605:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff91a87da47200/0xa2426164df2c8034 lrc: 2/0,0 mode: --/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6605 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783441519.301432:0:6605:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91a87da47200/0xa2426164df2c8034 lrc: 0/0,0 mode: --/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6605 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783441519.301472:0:6605:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff91a85fe58200/0xa2426164df2c7f77 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210400000020 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783441519.301477:0:6605:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff91a85fe58200/0xa2426164df2c7f77 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210400000020 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783441519.301483:0:6605:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff91a85fe58200/0xa2426164df2c7f77 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210400000020 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783441519.301487:0:6605:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91a85fe58200 already unused, calling callback (ffffffffc1f9b4f0) 00010000:00010000:1.0:1783441519.301489:0:6605:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91a85fe58200/0xa2426164df2c7f77 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210400000020 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783441519.301494:0:6605:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91a85fe58200/0xa2426164df2c7f77 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40218400000020 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783441519.301501:0:6605:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff91a85faeeb00) 00010000:00010000:1.0:1783441519.301503:0:6605:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1783441519.301510:0:6605:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff91a87da46200/0xa2426164df2c7f7e lrc: 2/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.13@tcp remote: 0x633a354aa4df4eee expref: 18 pid: 6605 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783441519.301520:0:6605:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff91a87da46200/0xa2426164df2c7f7e lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.201.13@tcp remote: 0x633a354aa4df4eee expref: 18 pid: 6605 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783441519.301534:0:6605:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91a87da46200/0xa2426164df2c7f7e lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.201.13@tcp remote: 0x633a354aa4df4eee expref: 18 pid: 6605 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783441519.301565:0:6605:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: mdt-lustre-MDT0000_UUID lock: ffff91a87da46200/0xa2426164df2c7f7e lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.13@tcp remote: 0x633a354aa4df4eee expref: 18 pid: 6605 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783441519.301576:0:6605:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff91a87d682d80 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:6605:1870073693282432:192.168.201.13@tcp:105: 00000100:00100000:1.0:1783441519.301690:0:6605:0:(client.c:2702:ptlrpc_set_wait()) set ffff91a847066840 going to sleep for 11 seconds 00000100:00100000:0.0:1783441519.308472:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.13@tcp (source: 12345-192.168.201.13@tcp) 00000100:00100000:2.0:1783441519.309204:0:5788:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073673345792 00000100:00100000:2.0:1783441519.309217:0:5788:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073673345792 00000100:00100000:2.0:1783441519.309276:0:5788:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.13@tcp, seq: 31 00000100:00100000:2.0:1783441519.309287:0:5788:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a87d647100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:65454767-383a-4679-a788-eba05c6e0989+19:10517:x1870073673345792:12345-192.168.201.13@tcp:49:lfs.0 00000100:00100000:2.0:1783441519.309429:0:5788:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a87d647100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:65454767-383a-4679-a788-eba05c6e0989+19:10517:x1870073673345792:12345-192.168.201.13@tcp:49:lfs.0 Request processed in 144us (966us total) trans 0 rc 0/0 00000100:00100000:2.0:1783441519.309453:0:5788:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.13@tcp, seq: 31 00000100:00100000:1.0:1783441519.311493:0:6605:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff91a87d682d80 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:6605:1870073693282432:192.168.201.13@tcp:105: 00010000:00010000:1.0:1783441519.311529:0:6605:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff91a85fe58200/0xa2426164df2c7f77 lrc: 2/0,0 mode: --/EX res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x44a19400000020 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783441519.311539:0:6605:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91a85fe58200/0xa2426164df2c7f77 lrc: 0/0,0 mode: --/EX res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x44a19400000020 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783441519.311575:0:6605:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff91a87da46600/0xa2426164df2c803b lrc: 3/0,1 mode: --/EX res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6605 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783441519.311589:0:6605:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91a87da46600/0xa2426164df2c803b lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6605 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783441519.311600:0:6605:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91a87da46600/0xa2426164df2c803b lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6605 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783441519.311610:0:6605:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff91a87da46600/0xa2426164df2c803b lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6605 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783441519.311615:0:6605:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff91a87da46600/0xa2426164df2c803b lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6605 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783441519.311636:0:6605:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff91a87da46600/0xa2426164df2c803b lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6605 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783441519.311642:0:6605:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91a87da46600 already unused, calling callback (ffffffffc1f9b4f0) 00010000:00010000:1.0:1783441519.311645:0:6605:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91a87da46600/0xa2426164df2c803b lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6605 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783441519.311652:0:6605:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91a87da46600/0xa2426164df2c803b lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6605 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783441519.311665:0:6605:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff91a85faeeb00) 00010000:00010000:1.0:1783441519.311668:0:6605:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1783441519.311672:0:6605:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff91a87da46600/0xa2426164df2c803b lrc: 2/0,0 mode: --/EX res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6605 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783441519.311678:0:6605:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91a87da46600/0xa2426164df2c803b lrc: 0/0,0 mode: --/EX res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6605 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783441519.311689:0:6605:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff91a87da47000/0xa2426164df2c802d lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6605 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783441519.311695:0:6605:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff91a87da47000/0xa2426164df2c802d lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6605 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783441519.311700:0:6605:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff91a87da47000/0xa2426164df2c802d lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6605 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783441519.311706:0:6605:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91a87da47000 already unused, calling callback (ffffffffc1f9b4f0) 00010000:00010000:1.0:1783441519.311708:0:6605:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91a87da47000/0xa2426164df2c802d lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6605 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783441519.311725:0:6605:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91a87da47000/0xa2426164df2c802d lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6605 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783441519.311734:0:6605:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff91a85faeeb00) 00010000:00010000:1.0:1783441519.311737:0:6605:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:1.0:1783441519.311760:0:6605:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff91a87da47000/0xa2426164df2c802d lrc: 2/0,0 mode: --/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6605 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783441519.311767:0:6605:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91a87da47000/0xa2426164df2c802d lrc: 0/0,0 mode: --/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6605 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783441519.312289:0:6605:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a8749a6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:65454767-383a-4679-a788-eba05c6e0989+18:10518:x1870073673345536:12345-192.168.201.13@tcp:57:lhsmtool_posix.0 Request processed in 22924us (23140us total) trans 4294967408 rc 0/0 00000100:00100000:1.0:1783441519.312299:0:6605:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.13@tcp, seq: 127 00000020:00080000:1.0:1783441519.312304:0:6605:0:(tgt_main.c:784:tgt_ses_key_exit()) total 5 transactions per RPC 00000040:00080000:3.0:1783441519.315733:0:11531:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000100:00100000:0.0:1783441519.315890:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.13@tcp (source: 12345-192.168.201.13@tcp) 00000100:00100000:0.0:1783441519.316091:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.13@tcp (source: 12345-192.168.201.13@tcp) 00000100:00100000:2.0:1783441519.316173:0:5785:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073673346048 00000100:00100000:2.0:1783441519.316183:0:5785:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073673346048 00000100:00100000:2.0:1783441519.316233:0:5785:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.13@tcp, seq: 128 00000100:00100000:2.0:1783441519.316243:0:5785:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a87d647800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:65454767-383a-4679-a788-eba05c6e0989+18:10517:x1870073673346048:12345-192.168.201.13@tcp:58:lfs.0 00000040:00080000:2.0:1783441519.316600:0:5785:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].3, 136 off8600 00000100:00100000:2.0:1783441519.316688:0:5785:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a87d647800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:65454767-383a-4679-a788-eba05c6e0989+18:10517:x1870073673346048:12345-192.168.201.13@tcp:58:lfs.0 Request processed in 446us (806us total) trans 0 rc 0/0 00000100:00100000:2.0:1783441519.316696:0:5785:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.13@tcp, seq: 128 00000040:00080000:3.0:1783441519.317309:0:11531:0:(llog_cat.c:841:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1783441519.317369:0:11531:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 4 count 4 00000040:00080000:3.0:1783441519.317377:0:11531:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:3.0:1783441519.317489:0:11531:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff91a875365c00 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:11531:1870073693282560:192.168.201.13@tcp:107:hsm_cdtr.0 00000100:00100000:3.0:1783441519.317562:0:11531:0:(client.c:2702:ptlrpc_set_wait()) set ffff91a7410c8300 going to sleep for 11 seconds 00000100:00100000:1.0:1783441519.318773:0:5788:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073673346304 00000100:00100000:1.0:1783441519.318786:0:5788:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073673346304 00000100:00100000:1.0:1783441519.318847:0:5788:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.13@tcp, seq: 32 00000100:00100000:1.0:1783441519.318857:0:5788:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a8468a8450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:65454767-383a-4679-a788-eba05c6e0989+19:10518:x1870073673346304:12345-192.168.201.13@tcp:35:lhsmtool_posix.0 00000004:00080000:1.0:1783441519.319546:0:5788:0:(mdd_object.c:4010:mdd_close()) Object [0x200000401:0x9:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000001:00080000:1.0:1783441519.319647:0:5788:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967409 00010000:00010000:1.0:1783441519.319694:0:5788:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff91a87da46000/0xa2426164df2c8042 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783441519.319711:0:5788:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91a87da46000/0xa2426164df2c8042 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010080000000 pid: 5788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783441519.319723:0:5788:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91a87da46000/0xa2426164df2c8042 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010080000000 pid: 5788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783441519.319771:0:5788:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff91a87da46000/0xa2426164df2c8042 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010080000000 pid: 5788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783441519.319778:0:5788:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff91a87da46000/0xa2426164df2c8042 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010480000000 pid: 5788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783441519.319783:0:5788:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff91a87da46000/0xa2426164df2c8042 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010480000000 pid: 5788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783441519.319803:0:5788:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:1.0:1783441519.319911:0:5788:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a8468a8450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:65454767-383a-4679-a788-eba05c6e0989+21:10518:x1870073673346304:12345-192.168.201.13@tcp:35:lhsmtool_posix.0 Request processed in 1054us (3818us total) trans 4294967410 rc 0/0 00000100:00100000:1.0:1783441519.319921:0:5788:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.13@tcp, seq: 32 00000020:00080000:1.0:1783441519.319926:0:5788:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:2.0:1783441519.321625:0:5773:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1783441519.321638:0:5773:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff91a87da46000/0xa2426164df2c8042 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783441519.321647:0:5773:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91a87da46000 already unused, calling callback (ffffffffc155ff90) 00010000:00010000:2.0:1783441519.321652:0:5773:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91a87da46000/0xa2426164df2c8042 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783441519.321661:0:5773:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91a87da46000/0xa2426164df2c8042 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 5788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783441519.321680:0:5773:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff91a858b90c00) 00010000:00010000:2.0:1783441519.321683:0:5773:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:2.0:1783441519.321687:0:5773:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff91a87da46000/0xa2426164df2c8042 lrc: 1/0,0 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783441519.321692:0:5773:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91a87da46000/0xa2426164df2c8042 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783441519.321716:0:5773:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783441519.321731:0:5773:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783441519.321733:0:5773:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1783441519.324401:0:11531:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff91a875365c00 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:11531:1870073693282560:192.168.201.13@tcp:107:hsm_cdtr.0 00000100:00100000:2.0:1783441519.327414:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.13@tcp (source: 12345-192.168.201.13@tcp) 00000100:00100000:0.0:1783441519.327506:0:5787:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073673346432 00000100:00100000:0.0:1783441519.327517:0:5787:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073673346432 00000100:00100000:0.0:1783441519.327585:0:5787:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.13@tcp, seq: 129 00000100:00100000:0.0:1783441519.327596:0:5787:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a874dc7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:65454767-383a-4679-a788-eba05c6e0989+20:10519:x1870073673346432:12345-192.168.201.13@tcp:53:lhsmtool_posix.0 00000004:00000080:0.0:1783441519.327626:0:5787:0:(mdt_handler.c:7960:mdt_fid2path()) path get [0x200000401:0x7:0x0] from 18446744073709551615 #0 00000100:00100000:0.0:1783441519.327733:0:5787:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a874dc7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:65454767-383a-4679-a788-eba05c6e0989+20:10519:x1870073673346432:12345-192.168.201.13@tcp:53:lhsmtool_posix.0 Request processed in 139us (328us total) trans 0 rc 0/0 00000100:00100000:0.0:1783441519.327771:0:5787:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.13@tcp, seq: 129 00000100:00100000:0.0:1783441519.333351:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.13@tcp (source: 12345-192.168.201.13@tcp) 00000100:00100000:2.0:1783441519.333469:0:5785:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073673346688 00000100:00100000:2.0:1783441519.333479:0:5785:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073673346688 00000100:00100000:2.0:1783441519.333544:0:5785:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.13@tcp, seq: 130 00000100:00100000:2.0:1783441519.333554:0:5785:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a87d646a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:65454767-383a-4679-a788-eba05c6e0989+20:10519:x1870073673346688:12345-192.168.201.13@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1783441519.333574:0:5785:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1783441519.333596:0:5785:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91a85f83c000/0xa2426164df2c8049 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x633a354aa4df4f26 expref: -99 pid: 5785 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783441519.333706:0:5785:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff91a85f83ca00/0xa2426164df2c8050 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783441519.333721:0:5785:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91a85f83ca00/0xa2426164df2c8050 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783441519.333732:0:5785:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91a85f83ca00/0xa2426164df2c8050 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1783441519.334115:0:5785:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x7:0x0]: returning size 0 00010000:00010000:2.0:1783441519.334489:0:5785:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91a85f83c000/0xa2426164df2c8049 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.13@tcp remote: 0x633a354aa4df4f26 expref: 23 pid: 5785 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783441519.334509:0:5785:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff91a85f83ca00/0xa2426164df2c8050 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.13@tcp remote: 0x633a354aa4df4f26 expref: 22 pid: 5785 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783441519.334518:0:5785:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff91a85faeeb00) 00010000:00010000:2.0:1783441519.334520:0:5785:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:2.0:1783441519.334537:0:5785:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91a85f83ca00, rc 0) 00000100:00100000:2.0:1783441519.334650:0:5785:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a87d646a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:65454767-383a-4679-a788-eba05c6e0989+22:10519:x1870073673346688:12345-192.168.201.13@tcp:101:lhsmtool_posix.0 Request processed in 1096us (1308us total) trans 4294967411 rc 0/0 00000100:00100000:2.0:1783441519.334658:0:5785:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.13@tcp, seq: 130 00000100:00100000:3.0:1783441519.348722:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.13@tcp (source: 12345-192.168.201.13@tcp) 00000100:00100000:0.0:1783441519.348804:0:5787:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073673346944 00000100:00100000:0.0:1783441519.348814:0:5787:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073673346944 00000100:00100000:0.0:1783441519.349054:0:5787:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.13@tcp, seq: 131 00000100:00100000:0.0:1783441519.349066:0:5787:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a875365c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:65454767-383a-4679-a788-eba05c6e0989+22:10519:x1870073673346944:12345-192.168.201.13@tcp:57:lhsmtool_posix.0 00010000:00010000:0.0:1783441519.349148:0:5787:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff91a85fe59a00/0xa2426164df2c805e lrc: 3/0,1 mode: --/PW res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783441519.349164:0:5787:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91a85fe59a00/0xa2426164df2c805e lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783441519.349512:0:5787:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91a85fe59a00/0xa2426164df2c805e lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783441519.349705:0:5787:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff91a85fe59a00/0xa2426164df2c805e lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783441519.349714:0:5787:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff91a85fe59a00/0xa2426164df2c805e lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783441519.349719:0:5787:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff91a85fe59a00/0xa2426164df2c805e lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783441519.349725:0:5787:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91a85fe59a00 already unused, calling callback (ffffffffc1f9b4f0) 00010000:00010000:0.0:1783441519.349729:0:5787:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91a85fe59a00/0xa2426164df2c805e lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783441519.349736:0:5787:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91a85fe59a00/0xa2426164df2c805e lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783441519.350065:0:5787:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff91a85faeeb00) 00010000:00010000:0.0:1783441519.350068:0:5787:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:0.0:1783441519.350074:0:5787:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff91a85fe59a00/0xa2426164df2c805e lrc: 2/0,0 mode: --/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783441519.350080:0:5787:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91a85fe59a00/0xa2426164df2c805e lrc: 0/0,0 mode: --/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783441519.350540:0:5787:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a875365c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:65454767-383a-4679-a788-eba05c6e0989+23:10519:x1870073673346944:12345-192.168.201.13@tcp:57:lhsmtool_posix.0 Request processed in 1471us (1821us total) trans 4294967412 rc 0/0 00000100:00100000:0.0:1783441519.350550:0:5787:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.13@tcp, seq: 131 00000040:00080000:3.0:1783441519.357431:0:11531:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:3.0:1783441519.357442:0:11531:0:(llog_cat.c:841:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1783441519.357867:0:11531:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 64768 count 4 00000040:00080000:3.0:1783441519.357876:0:11531:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:3.0:1783441519.368641:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.13@tcp (source: 12345-192.168.201.13@tcp) 00000100:00100000:0.0:1783441519.368709:0:5786:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073673347072 00000100:00100000:0.0:1783441519.368719:0:5786:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073673347072 00000100:00100000:0.0:1783441519.368814:0:5786:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.13@tcp, seq: 132 00000100:00100000:0.0:1783441519.368832:0:5786:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a875367b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:65454767-383a-4679-a788-eba05c6e0989+23:10521:x1870073673347072:12345-192.168.201.13@tcp:101:lfs.0 00010000:00010000:0.0:1783441519.368860:0:5786:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1783441519.368881:0:5786:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91a85fe59a00/0xa2426164df2c8065 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x633a354aa4df4f2d expref: -99 pid: 5786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783441519.368964:0:5786:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff91a85fe58e00/0xa2426164df2c806c lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783441519.368979:0:5786:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91a85fe58e00/0xa2426164df2c806c lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783441519.368992:0:5786:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91a85fe58e00/0xa2426164df2c806c lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783441519.369008:0:5786:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff91a85fe58a00/0xa2426164df2c8073 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783441519.369015:0:5786:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91a85fe58a00/0xa2426164df2c8073 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783441519.369021:0:5786:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91a85fe58a00/0xa2426164df2c8073 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783441519.369434:0:5786:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff91a85fe58200/0xa2426164df2c807a lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783441519.369445:0:5786:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff91a85fe58800/0xa2426164df2c7f69 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.13@tcp remote: 0x633a354aa4df4ee7 expref: 24 pid: 5787 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783441519.370281:0:5786:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff91a85fe58200/0xa2426164df2c807a lrc: 4/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x13/0x48 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783441519.370327:0:5786:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff91a85fe58800/0xa2426164df2c7f69 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.13@tcp remote: 0x633a354aa4df4ee7 expref: 24 pid: 5787 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783441519.370341:0:5786:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff91a85fe58800/0xa2426164df2c7f69 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.13@tcp remote: 0x633a354aa4df4ee7 expref: 24 pid: 5787 timeout: 457 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783441519.370355:0:5786:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff91a87d646680 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5786:1870073693282688:192.168.201.13@tcp:104: 00000100:00100000:0.0:1783441519.370458:0:5786:0:(client.c:2702:ptlrpc_set_wait()) set ffff91a8582b60c0 going to sleep for 11 seconds 00000100:00100000:3.0:1783441519.370640:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.13@tcp (source: 12345-192.168.201.13@tcp) 00000100:00100000:1.0:1783441519.371192:0:5788:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073673347328 00000100:00100000:1.0:1783441519.371202:0:5788:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073673347328 00000100:00100000:1.0:1783441519.371324:0:5788:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.13@tcp, seq: 33 00000100:00100000:1.0:1783441519.371335:0:5788:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a875365180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:65454767-383a-4679-a788-eba05c6e0989+25:10519:x1870073673347328:12345-192.168.201.13@tcp:35:lhsmtool_posix.0 00000100:00100000:1.0:1783441519.371594:0:5788:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a875365180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:65454767-383a-4679-a788-eba05c6e0989+26:10519:x1870073673347328:12345-192.168.201.13@tcp:35:lhsmtool_posix.0 Request processed in 260us (953us total) trans 4294967413 rc 0/0 00000100:00100000:1.0:1783441519.371603:0:5788:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.13@tcp, seq: 33 00000100:00100000:3.0:1783441519.375286:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.13@tcp (source: 12345-192.168.201.13@tcp) 00000100:00100000:0.0:1783441519.375479:0:5786:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff91a87d646680 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5786:1870073693282688:192.168.201.13@tcp:104: 00010000:00010000:0.0:1783441519.375509:0:5786:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff91a85fe58200/0xa2426164df2c807a lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x13/0x48 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783441519.380143:0:5789:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073673347584 00000100:00100000:2.0:1783441519.380164:0:5789:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073673347584 00000100:00100000:2.0:1783441519.380224:0:5789:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.13@tcp, seq: 34 00000100:00100000:2.0:1783441519.380233:0:5789:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a87da68380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:65454767-383a-4679-a788-eba05c6e0989+26:5568:x1870073673347584:12345-192.168.201.13@tcp:35:ldlm_bl.0 00000100:00100000:2.0:1783441519.380511:0:5789:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a87da68380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:65454767-383a-4679-a788-eba05c6e0989+27:5568:x1870073673347584:12345-192.168.201.13@tcp:35:ldlm_bl.0 Request processed in 277us (5233us total) trans 4294967414 rc 0/0 00000100:00100000:2.0:1783441519.380519:0:5789:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.13@tcp, seq: 34 00000100:00100000:0.0:1783441519.384665:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.13@tcp (source: 12345-192.168.201.13@tcp) 00000100:00100000:1.0:1783441519.384776:0:5769:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073673347712 00000100:00100000:1.0:1783441519.384786:0:5769:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073673347712 00010000:00010000:1.0:1783441519.384902:0:5769:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff91a85fe58800/0xa2426164df2c7f69 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.13@tcp remote: 0x633a354aa4df4ee7 expref: 27 pid: 5787 timeout: 457 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783441519.386083:0:5769:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.13@tcp, seq: 61 00000100:00100000:1.0:1783441519.386099:0:5769:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a84545b450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:65454767-383a-4679-a788-eba05c6e0989+27:2355:x1870073673347712:12345-192.168.201.13@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1783441519.386132:0:5769:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1783441519.386141:0:5769:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff91a85fe58800/0xa2426164df2c7f69 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.13@tcp remote: 0x633a354aa4df4ee7 expref: 27 pid: 5787 timeout: 457 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783441519.386154:0:5769:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff91a85fe58800/0xa2426164df2c7f69 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.13@tcp remote: 0x633a354aa4df4ee7 expref: 27 pid: 5787 timeout: 457 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783441519.386177:0:5769:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91a85fe58800/0xa2426164df2c7f69 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.13@tcp remote: 0x633a354aa4df4ee7 expref: 27 pid: 5787 timeout: 457 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783441519.386195:0:5769:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff91a85faeeb00) 00010000:00010000:1.0:1783441519.386199:0:5769:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff91a85fe58200/0xa2426164df2c807a lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x13/0x48 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783441519.386208:0:5769:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff91a85fe58200/0xa2426164df2c807a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783441519.386215:0:5769:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91a85fe58200/0xa2426164df2c807a lrc: 4/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783441519.386250:0:5769:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1783441519.386313:0:5769:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a84545b450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:65454767-383a-4679-a788-eba05c6e0989+26:2355:x1870073673347712:12345-192.168.201.13@tcp:103:ldlm_bl.0 Request processed in 220us (1657us total) trans 0 rc 0/0 00000100:00100000:1.0:1783441519.386321:0:5769:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.13@tcp, seq: 61 00010000:00010000:2.0:1783441519.388089:0:5786:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff91a85fe58200/0xa2426164df2c807a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783441519.388105:0:5786:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91a85fe58200/0xa2426164df2c807a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1783441519.388152:0:5786:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x7:0x0]: returning size 0 00000004:00200000:2.0:1783441519.388156:0:5786:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1783441519.388177:0:5786:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff91a85fe58200/0xa2426164df2c807a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783441519.388191:0:5786:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91a85fe58200/0xa2426164df2c807a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783441519.388200:0:5786:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff91a85fe58e00/0xa2426164df2c806c lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783441519.388205:0:5786:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff91a85fe58e00/0xa2426164df2c806c lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783441519.388231:0:5786:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff91a85fe58e00/0xa2426164df2c806c lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783441519.388236:0:5786:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91a85fe58e00 already unused, calling callback (ffffffffc1f9b4f0) 00010000:00010000:2.0:1783441519.388241:0:5786:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91a85fe58e00/0xa2426164df2c806c lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783441519.388248:0:5786:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91a85fe58e00/0xa2426164df2c806c lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783441519.388260:0:5786:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff91a8439b0300) 00010000:00010000:2.0:1783441519.388263:0:5786:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1783441519.388267:0:5786:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff91a85fe58e00/0xa2426164df2c806c lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783441519.388273:0:5786:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91a85fe58e00/0xa2426164df2c806c lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783441519.388288:0:5786:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff91a85fe58a00/0xa2426164df2c8073 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783441519.388294:0:5786:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff91a85fe58a00/0xa2426164df2c8073 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783441519.388299:0:5786:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff91a85fe58a00/0xa2426164df2c8073 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783441519.388303:0:5786:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91a85fe58a00 already unused, calling callback (ffffffffc1f9b4f0) 00010000:00010000:2.0:1783441519.388306:0:5786:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91a85fe58a00/0xa2426164df2c8073 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783441519.388320:0:5786:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91a85fe58a00/0xa2426164df2c8073 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783441519.388327:0:5786:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff91a8439b0900) 00010000:00010000:2.0:1783441519.388329:0:5786:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1783441519.388332:0:5786:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff91a85fe58a00/0xa2426164df2c8073 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783441519.388336:0:5786:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91a85fe58a00/0xa2426164df2c8073 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783441519.388377:0:5786:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91a85fe59a00/0xa2426164df2c8065 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.13@tcp remote: 0x633a354aa4df4f2d expref: 26 pid: 5786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783441519.388389:0:5786:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff91a85fe58200/0xa2426164df2c807a lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.13@tcp remote: 0x633a354aa4df4f2d expref: 25 pid: 5786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783441519.388395:0:5786:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff91a85faeeb00) 00010000:00010000:2.0:1783441519.388397:0:5786:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1783441519.388399:0:5786:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91a85fe58200, rc 0) 00000100:00100000:2.0:1783441519.388470:0:5786:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a875367b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:65454767-383a-4679-a788-eba05c6e0989+25:10521:x1870073673347072:12345-192.168.201.13@tcp:101:lfs.0 Request processed in 19647us (19839us total) trans 0 rc 0/0 00000100:00100000:2.0:1783441519.388477:0:5786:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.13@tcp, seq: 132 00000100:00100000:3.0:1783441519.468996:0:3304:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1783441519.469021:0:3304:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff91a87d681880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3304:1870073693282816:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1783441519.469106:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783441519.469451:0:6584:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073693282816 00000100:00100000:1.0:1783441519.469468:0:6584:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073693282816 00000100:00100000:1.0:1783441519.469527:0:6584:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 67 00000100:00100000:1.0:1783441519.469536:0:6584:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a844b7d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3304:x1870073693282816:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1783441519.469558:0:6584:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 45940736 pending 0 free 3859808256 avail 3856662528 00000100:00100000:1.0:1783441519.469625:0:6584:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a844b7d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3304:x1870073693282816:12345-0@lo:13:osp-pre-0-0.0 Request processed in 89us (519us total) trans 0 rc 0/0 00000100:00100000:1.0:1783441519.469632:0:6584:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 67 00000100:00100000:3.0:1783441519.469870:0:3304:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff91a87d681880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3304:1870073693282816:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1783441519.483451:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.13@tcp (source: 12345-192.168.201.13@tcp) 00000100:00100000:2.0:1783441519.483566:0:5780:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073673347840 00000100:00100000:2.0:1783441519.483576:0:5780:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073673347840 00000100:00100000:2.0:1783441519.483638:0:5780:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.13@tcp, seq: 291 00000100:00100000:2.0:1783441519.483648:0:5780:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a848f71450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:51c2a82e-e792-4f56-84e8-12cc033e9e70+13:2355:x1870073673347840:12345-192.168.201.13@tcp:400:kworker.0 00000100:00100000:2.0:1783441519.483795:0:5780:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a848f71450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:51c2a82e-e792-4f56-84e8-12cc033e9e70+13:2355:x1870073673347840:12345-192.168.201.13@tcp:400:kworker.0 Request processed in 147us (354us total) trans 0 rc 0/0 00000100:00100000:2.0:1783441519.483803:0:5780:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.13@tcp, seq: 291 00000100:00100000:3.0:1783441519.486530:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.13@tcp (source: 12345-192.168.201.13@tcp) 00000100:00100000:1.0:1783441519.486624:0:6583:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073673347968 00000100:00100000:1.0:1783441519.486633:0:6583:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073673347968 00000100:00100000:1.0:1783441519.486722:0:6583:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.13@tcp, seq: 83 00000100:00100000:1.0:1783441519.486732:0:6583:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a87531ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:65454767-383a-4679-a788-eba05c6e0989+7:2355:x1870073673347968:12345-192.168.201.13@tcp:400:kworker.0 00000100:00100000:1.0:1783441519.486837:0:6583:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a87531ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:65454767-383a-4679-a788-eba05c6e0989+7:2355:x1870073673347968:12345-192.168.201.13@tcp:400:kworker.0 Request processed in 107us (319us total) trans 0 rc 0/0 00000100:00100000:1.0:1783441519.486844:0:6583:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.13@tcp, seq: 83 00000100:00080000:0.0:1783441519.490986:0:5781:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1783441519.497377:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.13@tcp (source: 12345-192.168.201.13@tcp) 00000100:00100000:1.0:1783441519.497617:0:6605:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073673348096 00000100:00100000:1.0:1783441519.497627:0:6605:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073673348096 00000100:00100000:1.0:1783441519.497708:0:6605:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.13@tcp, seq: 153 00000100:00100000:1.0:1783441519.497720:0:6605:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a87d646680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:d5aa2a25-c618-49e9-a833-85b3b4747e53+5:2355:x1870073673348096:12345-192.168.201.13@tcp:400:kworker.0 00000100:00100000:1.0:1783441519.497839:0:6605:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a87d646680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:d5aa2a25-c618-49e9-a833-85b3b4747e53+5:2355:x1870073673348096:12345-192.168.201.13@tcp:400:kworker.0 Request processed in 123us (474us total) trans 0 rc 0/0 00000100:00100000:1.0:1783441519.497847:0:6605:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.13@tcp, seq: 153 00000100:00080000:0.0:1783441519.498685:0:5781:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:3.0:1783441519.788967:0:5772:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:1.0:1783441520.316979:0:11951:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:1.0:1783441520.316988:0:11951:0:(llog_cat.c:841:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1783441520.317045:0:11951:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 4 count 4 00000040:00080000:1.0:1783441520.317051:0:11951:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:3.0:1783441520.597251:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.13@tcp (source: 12345-192.168.201.13@tcp) 00000100:00100000:2.0:1783441520.597346:0:5785:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073673348352 00000100:00100000:2.0:1783441520.597355:0:5785:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073673348352 00000100:00100000:2.0:1783441520.597430:0:5785:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.13@tcp, seq: 133 00000100:00100000:2.0:1783441520.597437:0:5785:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a87531f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:65454767-383a-4679-a788-eba05c6e0989+25:10544:x1870073673348352:12345-192.168.201.13@tcp:101:lfs.0 00010000:00010000:2.0:1783441520.597459:0:5785:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1783441520.597479:0:5785:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91a85f83cc00/0xa2426164df2c8081 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x633a354aa4df4f34 expref: -99 pid: 5785 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783441520.597568:0:5785:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff91a85f83c600/0xa2426164df2c8088 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783441520.597579:0:5785:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91a85f83c600/0xa2426164df2c8088 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x7:0x0].0x0 bits 0xd/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783441520.597587:0:5785:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91a85f83c600/0xa2426164df2c8088 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x7:0x0].0x0 bits 0xd/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1783441520.597594:0:5785:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x7:0x0]: returning size 0 00010000:00010000:2.0:1783441520.597692:0:5785:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91a85f83cc00/0xa2426164df2c8081 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.13@tcp remote: 0x633a354aa4df4f34 expref: 28 pid: 5785 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783441520.597704:0:5785:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff91a85f83c600/0xa2426164df2c8088 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x7:0x0].0x0 bits 0xd/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.13@tcp remote: 0x633a354aa4df4f34 expref: 27 pid: 5785 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783441520.597710:0:5785:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff91a85faeeb00) 00010000:00010000:2.0:1783441520.597724:0:5785:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint d 00010000:00010000:2.0:1783441520.597727:0:5785:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91a85f83c600, rc 0) 00000100:00100000:2.0:1783441520.598154:0:5785:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a87531f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:65454767-383a-4679-a788-eba05c6e0989+27:10544:x1870073673348352:12345-192.168.201.13@tcp:101:lfs.0 Request processed in 715us (910us total) trans 4294967415 rc 0/0 00000100:00100000:2.0:1783441520.598163:0:5785:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.13@tcp, seq: 133 00000100:00080000:0.0:1783441520.598230:0:5781:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1783441520.602464:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.13@tcp (source: 12345-192.168.201.13@tcp) 00000100:00100000:1.0:1783441520.602888:0:6605:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073673348480 00000100:00100000:1.0:1783441520.602898:0:6605:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073673348480 00000100:00100000:1.0:1783441520.602965:0:6605:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.13@tcp, seq: 134 00000100:00100000:1.0:1783441520.602976:0:6605:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a87d87c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:65454767-383a-4679-a788-eba05c6e0989+27:10544:x1870073673348480:12345-192.168.201.13@tcp:54:lfs.0 00010000:00010000:1.0:1783441520.603050:0:6605:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff91a87da47000/0xa2426164df2c8096 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6605 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783441520.603074:0:6605:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91a87da47000/0xa2426164df2c8096 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6605 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783441520.603086:0:6605:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91a87da47000/0xa2426164df2c8096 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6605 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783441520.603115:0:6605:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff91a87da47000/0xa2426164df2c8096 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6605 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783441520.603121:0:6605:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff91a87da47000/0xa2426164df2c8096 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 6605 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783441520.603127:0:6605:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff91a87da47000/0xa2426164df2c8096 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6605 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783441520.603132:0:6605:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91a87da47000 already unused, calling callback (ffffffffc1f9b4f0) 00010000:00010000:1.0:1783441520.603135:0:6605:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91a87da47000/0xa2426164df2c8096 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6605 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783441520.603142:0:6605:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91a87da47000/0xa2426164df2c8096 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 6605 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783441520.603153:0:6605:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff91a85faeeb00) 00010000:00010000:1.0:1783441520.603156:0:6605:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1783441520.603161:0:6605:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff91a87da47000/0xa2426164df2c8096 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6605 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783441520.603167:0:6605:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91a87da47000/0xa2426164df2c8096 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6605 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783441520.603246:0:6605:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a87d87c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:65454767-383a-4679-a788-eba05c6e0989+27:10544:x1870073673348480:12345-192.168.201.13@tcp:54:lfs.0 Request processed in 272us (793us total) trans 0 rc 0/0 00000100:00100000:1.0:1783441520.603258:0:6605:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.13@tcp, seq: 134 00000100:00100000:1.0:1783441520.757970:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.13@tcp (source: 12345-192.168.201.13@tcp) 00000100:00100000:0.0:1783441520.758147:0:6582:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073673348608 00000100:00100000:0.0:1783441520.758170:0:6582:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073673348608 00000100:00100000:0.0:1783441520.758236:0:6582:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.13@tcp, seq: 47 00000100:00100000:0.0:1783441520.758247:0:6582:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a87d680380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:65454767-383a-4679-a788-eba05c6e0989+6:2352:x1870073673348608:12345-192.168.201.13@tcp:101:cat.0 00010000:00010000:0.0:1783441520.758266:0:6582:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1783441520.758304:0:6582:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000ddebac60/0xa2426164df2c809d lrc: 2/0,0 mode: --/PR res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x633a354aa4df4f3b expref: -99 pid: 6582 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1783441520.758333:0:6582:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x4:0x0] initial LVB size: 13, mtime: 0x6a4d286f, atime: 0x6a4d286e, ctime: 0x6a4d286f, blocks: 0xb 00010000:00010000:0.0:1783441520.758352:0:6582:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=358s v=(0 0) 00010000:00010000:0.0:1783441520.758357:0:6582:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1783441520.758367:0:6582:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000ddebac60/0xa2426164df2c809d lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.13@tcp remote: 0x633a354aa4df4f3b expref: 7 pid: 6582 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783441520.758387:0:6582:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000ddebac60/0xa2426164df2c809d lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.13@tcp remote: 0x633a354aa4df4f3b expref: 7 pid: 6582 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783441520.758401:0:6582:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91a85fe58c00, rc 0) 00000100:00100000:0.0:1783441520.758467:0:6582:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a87d680380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:65454767-383a-4679-a788-eba05c6e0989+7:2352:x1870073673348608:12345-192.168.201.13@tcp:101:cat.0 Request processed in 222us (508us total) trans 0 rc 0/0 00000100:00100000:0.0:1783441520.758475:0:6582:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.13@tcp, seq: 47 00000100:00100000:3.0:1783441520.767593:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.13@tcp (source: 12345-192.168.201.13@tcp) 00000100:00100000:1.0:1783441520.767697:0:6588:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073673348736 00000100:00100000:1.0:1783441520.767707:0:6588:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073673348736 00002000:00100000:1.0:1783441520.767812:0:6588:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x4:0x0] (0->4095) req@ffff91a87d87f480 x1870073673348736/t0(0) o3->65454767-383a-4679-a788-eba05c6e0989@192.168.201.13@tcp:161/0 lens 488/0 e 0 to 0 dl 1783441531 ref 1 fl New:/600/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1783441520.767831:0:6588:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff91a87d87f480 with x1870073673348736 ext(0->4095) 00002000:00010000:1.0:1783441520.767837:0:6588:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff91a87d87f480 00000100:00100000:1.0:1783441520.767861:0:6588:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.13@tcp, seq: 3 00000100:00100000:1.0:1783441520.767880:0:6588:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a87d87f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:65454767-383a-4679-a788-eba05c6e0989+7:2353:x1870073673348736:12345-192.168.201.13@tcp:3:cat.0 00000100:00100000:1.0:1783441520.768160:0:6588:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a87d87f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:65454767-383a-4679-a788-eba05c6e0989+7:2353:x1870073673348736:12345-192.168.201.13@tcp:3:cat.0 Request processed in 289us (577us total) trans 0 rc 4096/4096 00000100:00100000:1.0:1783441520.768168:0:6588:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.13@tcp, seq: 3 00002000:00100000:1.0:1783441520.768175:0:6588:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x4:0x0] (0->4095) req@ffff91a87d87f480 x1870073673348736/t0(0) o3->65454767-383a-4679-a788-eba05c6e0989@192.168.201.13@tcp:161/0 lens 488/4536 e 0 to 0 dl 1783441531 ref 1 fl Complete:/600/0 rc 4096/4096 job:'cat.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1783441520.768183:0:6588:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff91a87d87f480 with x1870073673348736 ext(0->4095) 00002000:00010000:1.0:1783441520.768186:0:6588:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff91a87d87f480 00010000:00010000:2.0:1783441520.816183:0:5773:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:3.0:1783441521.596910:0:7492:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967304 is committed 00000001:00080000:3.0:1783441521.596934:0:7492:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967302 is committed 00010000:00010000:1.0:1783441521.837218:0:5772:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783441522.861200:0:5773:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1783441523.053221:0:3304:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff91a87d87d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:6c1ddb50-5795-40c6-a2b6-8f58add9da62:3304:1870073693282944:0@lo:400:kworker.0 00000100:00100000:3.0:1783441523.053295:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783441523.053346:0:3304:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff91a87d87ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3304:1870073693283456:0@lo:400:kworker.0 00000100:00100000:3.0:1783441523.053374:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783441523.053402:0:3304:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1783441523.053408:0:3304:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff91a87d87d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3304:1870073693283328:0@lo:400:kworker.0 00000100:00100000:3.0:1783441523.053434:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783441523.053466:0:5786:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073693283456 00000100:00100000:3.0:1783441523.053473:0:5786:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073693283456 00000100:00100000:3.0:1783441523.053537:0:5786:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 154 00000100:00100000:3.0:1783441523.053546:0:5786:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a87d87ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3304:x1870073693283456:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1783441523.053596:0:5786:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a87d87ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3304:x1870073693283456:12345-0@lo:400:kworker.0 Request processed in 50us (221us total) trans 0 rc 0/0 00000100:00100000:3.0:1783441523.053603:0:5786:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 154 00000100:00100000:3.0:1783441523.053644:0:3304:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff91a87d87ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3304:1870073693283456:0@lo:400:kworker.0 00000100:00100000:2.0:1783441523.053802:0:3306:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff91a87d87fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3306:1870073693283200:0@lo:400:kworker.0 00000100:00100000:2.0:1783441523.053845:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783441523.053873:0:3306:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:2.0:1783441523.053879:0:3306:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff91a87d87e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3306:1870073693283072:0@lo:400:kworker.0 00000100:00100000:2.0:1783441523.053899:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783441523.053916:0:3306:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff91a87d87ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3306:1870073693283584:0@lo:400:kworker.0 00000100:00100000:2.0:1783441523.053937:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783441523.053961:0:5785:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073693283200 00000100:00100000:2.0:1783441523.053965:0:5785:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073693283200 00000100:00100000:2.0:1783441523.053989:0:5785:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073693283072 00000100:00100000:2.0:1783441523.053992:0:5785:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073693283072 00000100:00100000:2.0:1783441523.054006:0:5785:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 155 00000100:00100000:2.0:1783441523.054012:0:5785:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a874dc5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3306:x1870073693283200:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1783441523.054045:0:5785:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a874dc5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3306:x1870073693283200:12345-0@lo:400:kworker.0 Request processed in 33us (200us total) trans 0 rc 0/0 00000100:00100000:2.0:1783441523.054051:0:5785:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 155 00000100:00100000:2.0:1783441523.054063:0:5785:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 156 00000100:00100000:2.0:1783441523.054069:0:5785:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a874dc4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3306:x1870073693283072:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1783441523.054094:0:5785:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a874dc4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3306:x1870073693283072:12345-0@lo:400:kworker.0 Request processed in 26us (194us total) trans 0 rc 0/0 00000100:00100000:2.0:1783441523.054110:0:5785:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 156 00000100:00100000:2.0:1783441523.054132:0:8557:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073693283328 00000100:00100000:2.0:1783441523.054136:0:8557:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073693283328 00000100:00100000:2.0:1783441523.054433:0:8557:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073693283584 00000100:00100000:2.0:1783441523.054438:0:8557:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073693283584 00000100:00100000:2.0:1783441523.054458:0:8557:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 84 00000100:00100000:2.0:1783441523.054464:0:8557:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a87d87df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+7:3304:x1870073693283328:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1783441523.054498:0:8557:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a87d87df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+7:3304:x1870073693283328:12345-0@lo:400:kworker.0 Request processed in 34us (1063us total) trans 0 rc 0/0 00000100:00100000:2.0:1783441523.054504:0:8557:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 84 00000100:00100000:2.0:1783441523.054515:0:8557:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 85 00000100:00100000:2.0:1783441523.054520:0:8557:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a874dc4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3306:x1870073693283584:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1783441523.054543:0:8557:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a874dc4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3306:x1870073693283584:12345-0@lo:400:kworker.0 Request processed in 23us (605us total) trans 0 rc 0/0 00000100:00100000:2.0:1783441523.054549:0:8557:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 85 00000100:00100000:2.0:1783441523.054580:0:3306:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff91a87d87e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3306:1870073693283072:0@lo:400:kworker.0 00000100:00100000:2.0:1783441523.054589:0:3306:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967304 gen 2 00000004:00080000:2.0:1783441523.054594:0:3306:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967303 committed transno 4294967304 00000004:00080000:2.0:1783441523.054610:0:3306:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff91a875425180, transno 4294967304 00000100:00100000:2.0:1783441523.054619:0:3306:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff91a87d87ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3306:1870073693283584:0@lo:400:kworker.0 00000100:00100000:2.0:1783441523.054629:0:3306:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff91a87d87fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3306:1870073693283200:0@lo:400:kworker.0 00000100:00100000:3.0:1783441523.055248:0:3304:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff91a87d87d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3304:1870073693283328:0@lo:400:kworker.0 00000100:00100000:1.0:1783441523.055336:0:5778:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073693282944 00000100:00100000:1.0:1783441523.055342:0:5778:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073693282944 00000100:00100000:1.0:1783441523.055382:0:5778:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 292 00000100:00100000:1.0:1783441523.055389:0:5778:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a848f34850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6c1ddb50-5795-40c6-a2b6-8f58add9da62+19:3304:x1870073693282944:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1783441523.055446:0:5778:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a848f34850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6c1ddb50-5795-40c6-a2b6-8f58add9da62+19:3304:x1870073693282944:12345-0@lo:400:kworker.0 Request processed in 58us (2151us total) trans 0 rc 0/0 00000100:00100000:1.0:1783441523.055468:0:5778:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 292 00000100:00080000:0.0:1783441523.055569:0:5781:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1783441523.055574:0:5781:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1783441523.055577:0:5781:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1783441523.055638:0:3304:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff91a87d87d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:6c1ddb50-5795-40c6-a2b6-8f58add9da62:3304:1870073693282944:0@lo:400:kworker.0 00000040:00080000:2.0:1783441523.438582:0:11531:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:2.0:1783441523.438595:0:11531:0:(llog_cat.c:841:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1783441523.438647:0:11531:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 4 count 4 00000040:00080000:2.0:1783441523.438655:0:11531:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:2.0:1783441523.567306:0:3305:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1783441523.567326:0:3305:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff91a874dc7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3305:1870073693283712:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1783441523.567401:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783441523.567462:0:6584:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073693283712 00000100:00100000:2.0:1783441523.567469:0:6584:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073693283712 00000100:00100000:2.0:1783441523.567512:0:6584:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 68 00000100:00100000:2.0:1783441523.567520:0:6584:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a867c3c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3305:x1870073693283712:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1783441523.567553:0:6584:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1783441523.567591:0:6584:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a867c3c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3305:x1870073693283712:12345-0@lo:13:osp-pre-1-0.0 Request processed in 72us (190us total) trans 0 rc 0/0 00000100:00100000:2.0:1783441523.567598:0:6584:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 68 00000100:00100000:3.0:1783441523.570173:0:3305:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff91a874dc7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3305:1870073693283712:0@lo:13:osp-pre-1-0.0 00010000:00010000:3.0:1783441523.891543:0:5772:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1783441524.606563:0:3303:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff91a87d87d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3303:1870073693283840:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1783441524.606634:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783441524.606844:0:6585:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073693283840 00000100:00100000:1.0:1783441524.606852:0:6585:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073693283840 00000100:00100000:1.0:1783441524.606902:0:6585:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 69 00000100:00100000:1.0:1783441524.606911:0:6585:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a87d87d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3303:x1870073693283840:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1783441524.606947:0:6585:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 45940736 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1783441524.606994:0:6585:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a87d87d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3303:x1870073693283840:12345-0@lo:13:osp-pre-0-0.0 Request processed in 83us (360us total) trans 0 rc 0/0 00000100:00100000:1.0:1783441524.607001:0:6585:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 69 00000100:00100000:1.0:1783441524.607050:0:3303:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff91a87d87d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3303:1870073693283840:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1783441524.608614:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.13@tcp (source: 12345-192.168.201.13@tcp) 00000100:00100000:2.0:1783441524.608641:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.13@tcp (source: 12345-192.168.201.13@tcp) 00000100:00100000:2.0:1783441524.608665:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.13@tcp (source: 12345-192.168.201.13@tcp) 00000100:00100000:2.0:1783441524.608684:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.13@tcp (source: 12345-192.168.201.13@tcp) 00000100:00100000:2.0:1783441524.608705:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.13@tcp (source: 12345-192.168.201.13@tcp) 00000100:00100000:2.0:1783441524.608729:0:8557:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073673349120 00000100:00100000:2.0:1783441524.608735:0:8557:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073673349120 00000100:00100000:2.0:1783441524.608798:0:8557:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073673349248 00000100:00100000:2.0:1783441524.608801:0:8557:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073673349248 00000100:00100000:2.0:1783441524.608836:0:8557:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.13@tcp, seq: 86 00000100:00100000:2.0:1783441524.608845:0:8557:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a874dc5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:65454767-383a-4679-a788-eba05c6e0989+7:2354:x1870073673349120:12345-192.168.201.13@tcp:400:kworker.0 00000100:00100000:2.0:1783441524.608908:0:8557:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a874dc5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:65454767-383a-4679-a788-eba05c6e0989+7:2354:x1870073673349120:12345-192.168.201.13@tcp:400:kworker.0 Request processed in 63us (264us total) trans 0 rc 0/0 00000100:00100000:2.0:1783441524.608916:0:8557:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.13@tcp, seq: 86 00000100:00100000:2.0:1783441524.608932:0:8557:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.13@tcp, seq: 87 00000100:00100000:2.0:1783441524.608939:0:8557:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a874dc5180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:65454767-383a-4679-a788-eba05c6e0989+5:2354:x1870073673349248:12345-192.168.201.13@tcp:400:kworker.0 00000100:00100000:2.0:1783441524.608973:0:8557:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a874dc5180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:65454767-383a-4679-a788-eba05c6e0989+5:2354:x1870073673349248:12345-192.168.201.13@tcp:400:kworker.0 Request processed in 34us (267us total) trans 0 rc 0/0 00000100:00100000:2.0:1783441524.608979:0:8557:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.13@tcp, seq: 87 00000100:00100000:2.0:1783441524.608996:0:5785:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073673349376 00000100:00100000:2.0:1783441524.608998:0:5785:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073673349376 00000100:00100000:2.0:1783441524.609031:0:5785:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073673348992 00000100:00100000:2.0:1783441524.609034:0:5785:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073673348992 00000100:00100000:2.0:1783441524.609051:0:5785:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.13@tcp, seq: 157 00000100:00100000:2.0:1783441524.609058:0:5785:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a874dc6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d5aa2a25-c618-49e9-a833-85b3b4747e53+5:2354:x1870073673349376:12345-192.168.201.13@tcp:400:kworker.0 00000100:00100000:2.0:1783441524.609084:0:5785:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a874dc6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d5aa2a25-c618-49e9-a833-85b3b4747e53+5:2354:x1870073673349376:12345-192.168.201.13@tcp:400:kworker.0 Request processed in 27us (419us total) trans 0 rc 0/0 00000100:00100000:2.0:1783441524.609091:0:5785:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.13@tcp, seq: 157 00000100:00100000:2.0:1783441524.609102:0:5785:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.13@tcp, seq: 158 00000100:00100000:2.0:1783441524.609108:0:5785:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a874dc7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:65454767-383a-4679-a788-eba05c6e0989+27:2354:x1870073673348992:12345-192.168.201.13@tcp:400:kworker.0 00000100:00100000:2.0:1783441524.609133:0:5785:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a874dc7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:65454767-383a-4679-a788-eba05c6e0989+27:2354:x1870073673348992:12345-192.168.201.13@tcp:400:kworker.0 Request processed in 25us (448us total) trans 0 rc 0/0 00000100:00100000:2.0:1783441524.609139:0:5785:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.13@tcp, seq: 158 00000100:00080000:2.0:1783441524.612713:0:5781:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1783441524.612723:0:5781:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1783441524.612726:0:5781:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1783441524.612946:0:5779:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073673348864 00000100:00100000:3.0:1783441524.613331:0:5779:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073673348864 00000100:00100000:3.0:1783441524.613387:0:5779:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.13@tcp, seq: 293 00000100:00100000:3.0:1783441524.613397:0:5779:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a848f36450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:51c2a82e-e792-4f56-84e8-12cc033e9e70+13:2354:x1870073673348864:12345-192.168.201.13@tcp:400:kworker.0 00000100:00100000:3.0:1783441524.613467:0:5779:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a848f36450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:51c2a82e-e792-4f56-84e8-12cc033e9e70+13:2354:x1870073673348864:12345-192.168.201.13@tcp:400:kworker.0 Request processed in 70us (4861us total) trans 0 rc 0/0 00000100:00100000:3.0:1783441524.613475:0:5779:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.13@tcp, seq: 293 00000001:00080000:0.0:1783441524.669222:0:5807:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967412 is committed 00000020:00080000:0.0:1783441524.669236:0:5807:0:(update_trans.c:1341:distribute_txn_batchid_cb()) lustre-MDT0000: 3 batchid updated 00000001:00080000:0.0:1783441524.669247:0:5807:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967413 is committed 00000020:00080000:0.0:1783441524.669262:0:5807:0:(update_trans.c:60:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff91a8470660c0 refcount 2 committed 0 result 0 batchid 4 00000020:00080000:0.0:1783441524.669267:0:5807:0:(update_trans.c:68:top_multiple_thandle_dump()) st ffff91a847b0a100 obd lustre-OST0000-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff91a847066c00 00000020:00080000:0.0:1783441524.669271:0:5807:0:(update_trans.c:68:top_multiple_thandle_dump()) st ffff91a847b0a300 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff91a865582c00 00000001:00080000:0.0:1783441524.669286:0:5807:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967415 is committed 00000020:00080000:1.0:1783441524.669476:0:5818:0:(update_trans.c:1581:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 4 committed batchid 3 00000020:00080000:1.0:1783441524.669657:0:5818:0:(update_trans.c:1581:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 3 00000001:00080000:1.0:1783441524.688862:0:6613:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967312 is committed 00000001:00080000:1.0:1783441524.688881:0:6613:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967311 is committed 00010000:00010000:2.0:1783441524.911550:0:5773:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783441525.933030:0:5772:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1783441526.506316:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.13@tcp (source: 12345-192.168.201.13@tcp) 00000100:00100000:0.0:1783441526.506514:0:5786:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073673349504 00000100:00100000:0.0:1783441526.506539:0:5786:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073673349504 00000100:00100000:0.0:1783441526.506620:0:5786:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.13@tcp, seq: 135 00000100:00100000:0.0:1783441526.506631:0:5786:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a874dc6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:65454767-383a-4679-a788-eba05c6e0989+14:10197:x1870073673349504:12345-192.168.201.13@tcp:60:lhsmtool_posix.0 00000100:00100000:0.0:1783441526.506801:0:5786:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a874dc6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:65454767-383a-4679-a788-eba05c6e0989+14:10197:x1870073673349504:12345-192.168.201.13@tcp:60:lhsmtool_posix.0 Request processed in 172us (494us total) trans 0 rc 0/0 00000100:00100000:0.0:1783441526.506809:0:5786:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.13@tcp, seq: 135 00000100:00080000:2.0:1783441526.507338:0:5781:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1783441526.511983:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.13@tcp (source: 12345-192.168.201.13@tcp) 00000100:00100000:1.0:1783441526.515918:0:5788:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073673349760 00000100:00100000:1.0:1783441526.515951:0:5788:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073673349760 00000100:00100000:1.0:1783441526.516029:0:5788:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.13@tcp, seq: 35 00000100:00100000:1.0:1783441526.516041:0:5788:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a87d87ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:65454767-383a-4679-a788-eba05c6e0989+14:10197:x1870073673349760:12345-192.168.201.13@tcp:35:lhsmtool_posix.0 00000100:00100000:1.0:1783441526.516910:0:5788:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a87d87ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:65454767-383a-4679-a788-eba05c6e0989+15:10197:x1870073673349760:12345-192.168.201.13@tcp:35:lhsmtool_posix.0 Request processed in 864us (4932us total) trans 4294967416 rc 0/0 00000100:00100000:1.0:1783441526.516920:0:5788:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.13@tcp, seq: 35 00000100:00100000:3.0:1783441526.929185:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.13@tcp (source: 12345-192.168.201.13@tcp) 00000100:00100000:2.0:1783441526.931533:0:5787:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073673349888 00000100:00100000:2.0:1783441526.931545:0:5787:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073673349888 00000100:00100000:2.0:1783441526.931641:0:5787:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.13@tcp, seq: 136 00000100:00100000:2.0:1783441526.931651:0:5787:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a87d87c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d5aa2a25-c618-49e9-a833-85b3b4747e53+5:10997:x1870073673349888:12345-192.168.201.13@tcp:101:lsof.0 00010000:00010000:2.0:1783441526.931686:0:5787:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1783441526.931708:0:5787:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91a85f83da00/0xa2426164df2c80a4 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x633a354aa4df4f42 expref: -99 pid: 5787 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00080000:0.0:1783441526.931800:0:5781:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:2.0:1783441526.931807:0:5787:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff91a85f83d000/0xa2426164df2c80ab lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783441526.931823:0:5787:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91a85f83d000/0xa2426164df2c80ab lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783441526.931838:0:5787:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91a85f83d000/0xa2426164df2c80ab lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1783441526.932194:0:5787:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 7680 00000004:00200000:2.0:1783441526.932199:0:5787:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 2 stripe count 1 MDT count 1 00000004:00010000:2.0:1783441526.932293:0:5787:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff91a85f83d000/0xa2426164df2c80ab lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783441526.932368:0:5787:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91a85f83da00/0xa2426164df2c80a4 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.13@tcp remote: 0x633a354aa4df4f42 expref: 7 pid: 5787 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783441526.932385:0:5787:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff91a85f83d000/0xa2426164df2c80ab lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.13@tcp remote: 0x633a354aa4df4f42 expref: 6 pid: 5787 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783441526.932395:0:5787:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff91a85faee700) 00010000:00010000:2.0:1783441526.932398:0:5787:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1783441526.932401:0:5787:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91a85f83d000, rc 0) 00000100:00100000:2.0:1783441526.932540:0:5787:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a87d87c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d5aa2a25-c618-49e9-a833-85b3b4747e53+6:10997:x1870073673349888:12345-192.168.201.13@tcp:101:lsof.0 Request processed in 889us (3364us total) trans 0 rc 0/0 00000100:00100000:2.0:1783441526.932547:0:5787:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.13@tcp, seq: 136 00010000:00010000:2.0:1783441526.957191:0:5773:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783441527.981311:0:5772:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1783441528.173093:0:3305:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff91a87d87f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3305:1870073693284096:0@lo:400:kworker.0 00000100:00100000:2.0:1783441528.173171:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783441528.173285:0:3303:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1783441528.173301:0:3303:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff91a87d87dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:6c1ddb50-5795-40c6-a2b6-8f58add9da62:3303:1870073693283968:0@lo:400:kworker.0 00000100:00100000:1.0:1783441528.173338:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783441528.173383:0:5780:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073693283968 00000100:00100000:1.0:1783441528.173403:0:5780:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073693283968 00000100:00100000:1.0:1783441528.173451:0:5780:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 294 00000100:00100000:1.0:1783441528.173459:0:5780:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a848f36c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6c1ddb50-5795-40c6-a2b6-8f58add9da62+19:3303:x1870073693283968:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1783441528.173509:0:5780:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a848f36c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6c1ddb50-5795-40c6-a2b6-8f58add9da62+19:3303:x1870073693283968:12345-0@lo:400:kworker.0 Request processed in 50us (170us total) trans 0 rc 0/0 00000100:00100000:1.0:1783441528.173517:0:5780:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 294 00000100:00100000:1.0:1783441528.173565:0:3303:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff91a87d87dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:6c1ddb50-5795-40c6-a2b6-8f58add9da62:3303:1870073693283968:0@lo:400:kworker.0 00000100:00100000:0.0:1783441528.174205:0:5786:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073693284096 00000100:00100000:0.0:1783441528.174211:0:5786:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073693284096 00000100:00100000:0.0:1783441528.174249:0:5786:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 159 00000100:00100000:0.0:1783441528.174256:0:5786:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a874dc4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3305:x1870073693284096:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1783441528.174324:0:3306:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff91a87d87ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3306:1870073693284224:0@lo:400:kworker.0 00000100:00100000:1.0:1783441528.174354:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783441528.174409:0:5785:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073693284224 00000100:00100000:1.0:1783441528.174413:0:5785:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073693284224 00000100:00100000:1.0:1783441528.174445:0:5785:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 160 00000100:00100000:1.0:1783441528.174452:0:5785:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a87d682d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3306:x1870073693284224:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1783441528.174485:0:5785:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a87d682d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3306:x1870073693284224:12345-0@lo:400:kworker.0 Request processed in 34us (129us total) trans 0 rc 0/0 00000100:00100000:1.0:1783441528.174491:0:5785:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 160 00000100:00100000:1.0:1783441528.174517:0:3306:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff91a87d87ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3306:1870073693284224:0@lo:400:kworker.0 00000100:00080000:1.0:1783441528.174543:0:5781:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1783441528.175466:0:3304:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff91a87d87f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3304:1870073693284480:0@lo:400:kworker.0 00000100:00100000:1.0:1783441528.175505:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783441528.175536:0:3304:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1783441528.175542:0:3304:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff91a87d87e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3304:1870073693284352:0@lo:400:kworker.0 00000100:00100000:1.0:1783441528.175568:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783441528.175598:0:8557:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073693284352 00000100:00100000:1.0:1783441528.175603:0:8557:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073693284352 00000100:00100000:1.0:1783441528.175647:0:8557:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 88 00000100:00100000:1.0:1783441528.175667:0:8557:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a87d682a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3304:x1870073693284352:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1783441528.175721:0:8557:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a87d682a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3304:x1870073693284352:12345-0@lo:400:kworker.0 Request processed in 55us (151us total) trans 0 rc 0/0 00000100:00100000:1.0:1783441528.175728:0:8557:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 88 00000100:00080000:1.0:1783441528.175777:0:5781:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1783441528.175796:0:3304:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967312 gen 2 00000004:00080000:1.0:1783441528.175801:0:3304:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff91a87d6f0a80, transno 4294967310 00000004:00080000:1.0:1783441528.175810:0:3304:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967312 committed transno 4294967312 00000100:00100000:1.0:1783441528.175829:0:3304:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff91a87d87e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3304:1870073693284352:0@lo:400:kworker.0 00000100:00100000:1.0:1783441528.175846:0:3306:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1783441528.175854:0:3306:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff91a87d87d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3306:1870073693284608:0@lo:400:kworker.0 00000100:00100000:1.0:1783441528.175877:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783441528.175903:0:6582:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073693284608 00000100:00100000:1.0:1783441528.175906:0:6582:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073693284608 00000100:00100000:1.0:1783441528.175934:0:6582:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 89 00000100:00100000:1.0:1783441528.175940:0:6582:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a87d682680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3306:x1870073693284608:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1783441528.175986:0:6582:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a87d682680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3306:x1870073693284608:12345-0@lo:400:kworker.0 Request processed in 45us (108us total) trans 0 rc 0/0 00000100:00100000:1.0:1783441528.176200:0:6582:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 89 00000100:00080000:1.0:1783441528.176219:0:5781:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1783441528.176236:0:3306:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff91a87d87d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3306:1870073693284608:0@lo:400:kworker.0 00000100:00100000:0.0:1783441528.177886:0:5786:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a874dc4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3305:x1870073693284096:12345-0@lo:400:kworker.0 Request processed in 3618us (4702us total) trans 0 rc 0/0 00000100:00100000:0.0:1783441528.177899:0:5786:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 159 00000100:00100000:0.0:1783441528.177933:0:5786:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073693284480 00000100:00100000:0.0:1783441528.177940:0:5786:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073693284480 00000100:00080000:1.0:1783441528.178145:0:5781:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1783441528.178864:0:5786:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 161 00000100:00100000:0.0:1783441528.178879:0:5786:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a87d680a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3304:x1870073693284480:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1783441528.178955:0:5786:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a87d680a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3304:x1870073693284480:12345-0@lo:400:kworker.0 Request processed in 83us (3449us total) trans 0 rc 0/0 00000100:00100000:0.0:1783441528.178962:0:5786:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 161 00000100:00100000:1.0:1783441528.179198:0:3304:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff91a87d87f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3304:1870073693284480:0@lo:400:kworker.0 00000100:00100000:2.0:1783441528.181195:0:3305:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff91a87d87f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3305:1870073693284096:0@lo:400:kworker.0 00000100:00100000:3.0:1783441528.689537:0:3305:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1783441528.689563:0:3305:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff91a874dc6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3305:1870073693284736:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1783441528.689650:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783441528.689839:0:6585:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073693284736 00000100:00100000:1.0:1783441528.689849:0:6585:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073693284736 00000100:00100000:1.0:1783441528.689917:0:6585:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 70 00000100:00100000:1.0:1783441528.689933:0:6585:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a87d87c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3305:x1870073693284736:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1783441528.689984:0:6585:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1783441528.690039:0:6585:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a87d87c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3305:x1870073693284736:12345-0@lo:13:osp-pre-1-0.0 Request processed in 107us (388us total) trans 0 rc 0/0 00000100:00100000:1.0:1783441528.690046:0:6585:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 70 00000100:00100000:3.0:1783441528.690450:0:3305:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff91a874dc6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3305:1870073693284736:0@lo:13:osp-pre-1-0.0 00010000:00010000:2.0:1783441529.005012:0:5773:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1783441529.712157:0:3303:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff91a87d87f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3303:1870073693284864:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1783441529.712227:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783441529.713043:0:6584:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073693284864 00000100:00100000:2.0:1783441529.713068:0:6584:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073693284864 00000100:00100000:2.0:1783441529.713115:0:6584:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 71 00000100:00100000:2.0:1783441529.713124:0:6584:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a87d681880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3303:x1870073693284864:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1783441529.713158:0:6584:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 45940736 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1783441529.713213:0:6584:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a87d681880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3303:x1870073693284864:12345-0@lo:13:osp-pre-0-0.0 Request processed in 88us (984us total) trans 0 rc 0/0 00000100:00100000:2.0:1783441529.713220:0:6584:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 71 00000100:00100000:2.0:1783441529.713470:0:3303:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff91a87d87f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3303:1870073693284864:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1783441529.720424:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.13@tcp (source: 12345-192.168.201.13@tcp) 00000100:00100000:1.0:1783441529.720467:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.13@tcp (source: 12345-192.168.201.13@tcp) 00000100:00100000:1.0:1783441529.720497:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.13@tcp (source: 12345-192.168.201.13@tcp) 00000100:00100000:1.0:1783441529.720518:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.13@tcp (source: 12345-192.168.201.13@tcp) 00000100:00100000:1.0:1783441529.720543:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.13@tcp (source: 12345-192.168.201.13@tcp) 00000100:00100000:1.0:1783441529.720569:0:5786:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073673350528 00000100:00100000:1.0:1783441529.720579:0:5786:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073673350528 00000100:00100000:1.0:1783441529.720633:0:5786:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073673350144 00000100:00100000:1.0:1783441529.720636:0:5786:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073673350144 00000100:00100000:1.0:1783441529.720662:0:5786:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.13@tcp, seq: 162 00000100:00100000:1.0:1783441529.720672:0:5786:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a87d683100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d5aa2a25-c618-49e9-a833-85b3b4747e53+6:2355:x1870073673350528:12345-192.168.201.13@tcp:400:kworker.0 00000100:00100000:1.0:1783441529.720784:0:5786:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a87d683100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d5aa2a25-c618-49e9-a833-85b3b4747e53+6:2355:x1870073673350528:12345-192.168.201.13@tcp:400:kworker.0 Request processed in 113us (285us total) trans 0 rc 0/0 00000100:00100000:1.0:1783441529.720792:0:5786:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.13@tcp, seq: 162 00000100:00100000:1.0:1783441529.720813:0:5786:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.13@tcp, seq: 163 00000100:00100000:1.0:1783441529.720821:0:5786:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a875690e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:65454767-383a-4679-a788-eba05c6e0989+15:2355:x1870073673350144:12345-192.168.201.13@tcp:400:kworker.0 00000100:00100000:1.0:1783441529.720850:0:5786:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a875690e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:65454767-383a-4679-a788-eba05c6e0989+15:2355:x1870073673350144:12345-192.168.201.13@tcp:400:kworker.0 Request processed in 30us (331us total) trans 0 rc 0/0 00000100:00100000:1.0:1783441529.720856:0:5786:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.13@tcp, seq: 163 00000100:00100000:1.0:1783441529.720890:0:6583:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073673350272 00000100:00100000:1.0:1783441529.720894:0:6583:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073673350272 00000100:00100000:1.0:1783441529.720918:0:6583:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073673350400 00000100:00100000:1.0:1783441529.720921:0:6583:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073673350400 00000100:00100000:1.0:1783441529.720939:0:6583:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.13@tcp, seq: 90 00000100:00100000:1.0:1783441529.720945:0:6583:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a87d681f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:65454767-383a-4679-a788-eba05c6e0989+6:2355:x1870073673350272:12345-192.168.201.13@tcp:400:kworker.0 00000100:00100000:1.0:1783441529.720972:0:6583:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a87d681f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:65454767-383a-4679-a788-eba05c6e0989+6:2355:x1870073673350272:12345-192.168.201.13@tcp:400:kworker.0 Request processed in 28us (505us total) trans 0 rc 0/0 00000100:00100000:1.0:1783441529.720991:0:6583:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.13@tcp, seq: 90 00000100:00100000:1.0:1783441529.721003:0:6583:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.13@tcp, seq: 91 00000100:00100000:1.0:1783441529.721009:0:6583:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a875691f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:65454767-383a-4679-a788-eba05c6e0989+5:2355:x1870073673350400:12345-192.168.201.13@tcp:400:kworker.0 00000100:00100000:1.0:1783441529.721032:0:6583:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a875691f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:65454767-383a-4679-a788-eba05c6e0989+5:2355:x1870073673350400:12345-192.168.201.13@tcp:400:kworker.0 Request processed in 24us (488us total) trans 0 rc 0/0 00000100:00100000:1.0:1783441529.721038:0:6583:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.13@tcp, seq: 91 00000100:00080000:1.0:1783441529.721165:0:5781:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1783441529.721169:0:5781:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1783441529.721172:0:5781:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1783441529.722603:0:5778:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073673350016 00000100:00100000:3.0:1783441529.722624:0:5778:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073673350016 00000100:00100000:3.0:1783441529.722730:0:5778:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.13@tcp, seq: 295 00000100:00100000:3.0:1783441529.722801:0:5778:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a848f37c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:51c2a82e-e792-4f56-84e8-12cc033e9e70+13:2355:x1870073673350016:12345-192.168.201.13@tcp:400:kworker.0 00000100:00100000:3.0:1783441529.722914:0:5778:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a848f37c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:51c2a82e-e792-4f56-84e8-12cc033e9e70+13:2355:x1870073673350016:12345-192.168.201.13@tcp:400:kworker.0 Request processed in 117us (2498us total) trans 0 rc 0/0 00000100:00100000:3.0:1783441529.722924:0:5778:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.13@tcp, seq: 295 00000001:00080000:3.0:1783441529.829542:0:5807:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967416 is committed 00000020:00080000:3.0:1783441529.829573:0:5807:0:(update_trans.c:1341:distribute_txn_batchid_cb()) lustre-MDT0000: 4 batchid updated 00000020:00080000:0.0:1783441529.829868:0:5818:0:(update_trans.c:1581:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 4 00000020:00080000:0.0:1783441529.829888:0:5818:0:(update_trans.c:1581:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 4 00010000:00010000:3.0:1783441530.030680:0:5772:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783441531.062878:0:5773:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:3.0:1783441531.294523:0:12153:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: == sanity-pcc test 1b: Test manual lfs pcc attach with restore on remote access ========================================================== 12:25:30 (1783441530) 00010000:00010000:3.0:1783441532.077193:0:5772:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1783441532.531331:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.13@tcp (source: 12345-192.168.201.13@tcp) 00000100:00100000:0.0:1783441532.531465:0:5786:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073673350784 00000100:00100000:0.0:1783441532.531477:0:5786:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073673350784 00000100:00100000:0.0:1783441532.531577:0:5786:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.13@tcp, seq: 137 00000100:00100000:0.0:1783441532.531591:0:5786:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a875425180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:65454767-383a-4679-a788-eba05c6e0989+14:11262:x1870073673350784:12345-192.168.201.13@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1783441532.531638:0:5786:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1783441532.531665:0:5786:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91a85fe58e00/0xa2426164df2c80b2 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x633a354aa4df4f49 expref: -99 pid: 5786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783441532.531824:0:5786:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff91a85fe58a00/0xa2426164df2c80b9 lrc: 3/1,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783441532.531844:0:5786:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91a85fe58a00/0xa2426164df2c80b9 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783441532.531860:0:5786:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91a85fe58a00/0xa2426164df2c80b9 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00080000:1.0:1783441532.532037:0:5781:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:0.0:1783441532.532080:0:5786:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff91a85fe59a00/0xa2426164df2c80c0 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783441532.532088:0:5786:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91a85fe59a00/0xa2426164df2c80c0 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783441532.532096:0:5786:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91a85fe59a00/0xa2426164df2c80c0 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783441532.532600:0:5786:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff91a85fe58800/0xa2426164df2c80c7 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783441532.532613:0:5786:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91a85fe58800/0xa2426164df2c80c7 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783441532.532621:0:5786:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91a85fe58800/0xa2426164df2c80c7 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1783441532.532633:0:5786:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000002:0x2:0x0]: returning size 6656 00010000:00010000:0.0:1783441532.533257:0:5786:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff91a85fe58a00/0xa2426164df2c80b9 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783441532.533270:0:5786:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff91a85fe58a00/0xa2426164df2c80b9 lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783441532.533278:0:5786:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff91a85fe58a00/0xa2426164df2c80b9 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783441532.533285:0:5786:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91a85fe58a00 already unused, calling callback (ffffffffc1f9b4f0) 00010000:00010000:0.0:1783441532.533291:0:5786:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91a85fe58a00/0xa2426164df2c80b9 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783441532.533300:0:5786:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91a85fe58a00/0xa2426164df2c80b9 lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783441532.533317:0:5786:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x0 (ffff91a85faeee00) 00010000:00010000:0.0:1783441532.533321:0:5786:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1783441532.533326:0:5786:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff91a85fe58a00/0xa2426164df2c80b9 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783441532.533333:0:5786:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91a85fe58a00/0xa2426164df2c80b9 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783441532.533350:0:5786:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff91a85fe59a00/0xa2426164df2c80c0 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783441532.533356:0:5786:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff91a85fe59a00/0xa2426164df2c80c0 lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783441532.533361:0:5786:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff91a85fe59a00/0xa2426164df2c80c0 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783441532.533378:0:5786:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91a85fe59a00 already unused, calling callback (ffffffffc1f9b4f0) 00010000:00010000:0.0:1783441532.533381:0:5786:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91a85fe59a00/0xa2426164df2c80c0 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783441532.533386:0:5786:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91a85fe59a00/0xa2426164df2c80c0 lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783441532.533395:0:5786:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x8d45d6bc (ffff91a8439b0200) 00010000:00010000:0.0:1783441532.533398:0:5786:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1783441532.533401:0:5786:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff91a85fe59a00/0xa2426164df2c80c0 lrc: 2/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783441532.533407:0:5786:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91a85fe59a00/0xa2426164df2c80c0 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783441532.534166:0:5786:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91a85fe58e00/0xa2426164df2c80b2 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.13@tcp remote: 0x633a354aa4df4f49 expref: 17 pid: 5786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783441532.534186:0:5786:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff91a85fe58800/0xa2426164df2c80c7 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.13@tcp remote: 0x633a354aa4df4f49 expref: 16 pid: 5786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783441532.534193:0:5786:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff91a858b90e00) 00010000:00010000:0.0:1783441532.534197:0:5786:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1783441532.534199:0:5786:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91a85fe58800, rc 0) 00000100:00100000:0.0:1783441532.534292:0:5786:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a875425180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:65454767-383a-4679-a788-eba05c6e0989+16:11262:x1870073673350784:12345-192.168.201.13@tcp:101:lhsmtool_posix.0 Request processed in 2704us (2974us total) trans 4294967417 rc 0/0 00000100:00100000:0.0:1783441532.534301:0:5786:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.13@tcp, seq: 137 00000100:00100000:3.0:1783441532.537946:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.13@tcp (source: 12345-192.168.201.13@tcp) 00000100:00100000:3.0:1783441532.538004:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.13@tcp (source: 12345-192.168.201.13@tcp) 00000100:00100000:2.0:1783441532.538150:0:11514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073673351040 00000100:00100000:2.0:1783441532.538163:0:11514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073673351040 00000100:00100000:2.0:1783441532.538259:0:11514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.13@tcp, seq: 8 00000100:00100000:2.0:1783441532.538271:0:11514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a87d87d500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:65454767-383a-4679-a788-eba05c6e0989+16:2352:x1870073673351040:12345-192.168.201.13@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1783441532.538292:0:11514:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1783441532.538324:0:11514:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91a85fe58800/0xa2426164df2c80c7 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.13@tcp remote: 0x633a354aa4df4f49 expref: 16 pid: 5786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783441532.538351:0:11514:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff91a858b90e00) 00010000:00010000:2.0:1783441532.538358:0:11514:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1783441532.538447:0:11514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a87d87d500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:65454767-383a-4679-a788-eba05c6e0989+15:2352:x1870073673351040:12345-192.168.201.13@tcp:103:ldlm_bl.0 Request processed in 176us (441us total) trans 0 rc 0/0 00000100:00100000:2.0:1783441532.538474:0:11514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.13@tcp, seq: 8 00000100:00100000:1.0:1783441532.538690:0:6605:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073673350912 00000100:00100000:1.0:1783441532.538695:0:6605:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073673350912 00000100:00100000:1.0:1783441532.538770:0:6605:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.13@tcp, seq: 138 00000100:00100000:1.0:1783441532.538780:0:6605:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a87d87f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:65454767-383a-4679-a788-eba05c6e0989+15:11262:x1870073673350912:12345-192.168.201.13@tcp:59:lhsmtool_posix.0 00000100:00100000:1.0:1783441532.538887:0:6605:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a87d87f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:65454767-383a-4679-a788-eba05c6e0989+15:11262:x1870073673350912:12345-192.168.201.13@tcp:59:lhsmtool_posix.0 Request processed in 109us (957us total) trans 0 rc 0/0 00000100:00100000:1.0:1783441532.538894:0:6605:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.13@tcp, seq: 138 00000040:00080000:1.0:1783441532.655349:0:11531:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:1.0:1783441532.655379:0:11531:0:(llog_cat.c:841:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1783441532.657230:0:11531:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 64768 count 4 00000040:00080000:1.0:1783441532.657256:0:11531:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00010000:00010000:1.0:1783441533.105373:0:5773:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1783441533.293081:0:3305:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff91a87d87ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3305:1870073693285120:0@lo:400:kworker.0 00000100:00100000:3.0:1783441533.293184:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783441533.293249:0:3305:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff91a87d87ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3305:1870073693285632:0@lo:400:kworker.0 00000100:00100000:3.0:1783441533.293281:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783441533.293319:0:3305:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1783441533.293325:0:3305:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff91a87d87dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3305:1870073693285248:0@lo:400:kworker.0 00000100:00100000:3.0:1783441533.293370:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783441533.293413:0:5787:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073693285120 00000100:00100000:3.0:1783441533.293422:0:5787:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073693285120 00000100:00100000:3.0:1783441533.293486:0:5787:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073693285248 00000100:00100000:3.0:1783441533.293490:0:5787:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073693285248 00000100:00100000:3.0:1783441533.293524:0:5787:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 164 00000100:00100000:3.0:1783441533.293534:0:5787:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a87d87e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3305:x1870073693285120:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1783441533.293597:0:5787:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a87d87e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3305:x1870073693285120:12345-0@lo:400:kworker.0 Request processed in 63us (413us total) trans 0 rc 0/0 00000100:00100000:3.0:1783441533.293604:0:5787:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 164 00000100:00100000:3.0:1783441533.293624:0:5787:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 165 00000100:00100000:3.0:1783441533.293631:0:5787:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a745903100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3305:x1870073693285248:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1783441533.293658:0:5787:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a745903100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3305:x1870073693285248:12345-0@lo:400:kworker.0 Request processed in 28us (287us total) trans 0 rc 0/0 00000100:00100000:3.0:1783441533.293675:0:5787:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 165 00000100:00100000:3.0:1783441533.293697:0:6583:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073693285632 00000100:00100000:3.0:1783441533.293701:0:6583:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073693285632 00000100:00100000:3.0:1783441533.293733:0:6583:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 92 00000100:00100000:3.0:1783441533.293768:0:6583:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a87d87f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3305:x1870073693285632:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1783441533.293801:0:6583:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a87d87f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3305:x1870073693285632:12345-0@lo:400:kworker.0 Request processed in 62us (519us total) trans 0 rc 0/0 00000100:00100000:3.0:1783441533.293808:0:6583:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 92 00000100:00080000:3.0:1783441533.293829:0:5781:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1783441533.293835:0:5781:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1783441533.293872:0:3305:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff91a87d87dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3305:1870073693285248:0@lo:400:kworker.0 00000100:00100000:3.0:1783441533.293884:0:3305:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff91a87d87ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3305:1870073693285120:0@lo:400:kworker.0 00000100:00100000:3.0:1783441533.293893:0:3305:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff91a87d87ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3305:1870073693285632:0@lo:400:kworker.0 00000100:00100000:2.0:1783441533.294011:0:3303:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff91a87d87d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3303:1870073693285376:0@lo:400:kworker.0 00000100:00100000:2.0:1783441533.294045:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783441533.294068:0:3303:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:2.0:1783441533.294074:0:3303:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff91a87d87e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:6c1ddb50-5795-40c6-a2b6-8f58add9da62:3303:1870073693284992:0@lo:400:kworker.0 00000100:00100000:2.0:1783441533.294105:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783441533.294132:0:3303:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff91a87d87fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3303:1870073693285504:0@lo:400:kworker.0 00000100:00100000:2.0:1783441533.294156:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783441533.294180:0:6582:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073693285376 00000100:00100000:2.0:1783441533.294185:0:6582:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073693285376 00000100:00100000:2.0:1783441533.294219:0:6582:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 93 00000100:00100000:2.0:1783441533.294225:0:6582:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a874dc5f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3303:x1870073693285376:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1783441533.294261:0:6582:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a874dc5f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3303:x1870073693285376:12345-0@lo:400:kworker.0 Request processed in 37us (216us total) trans 0 rc 0/0 00000100:00100000:2.0:1783441533.294267:0:6582:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 93 00000100:00100000:2.0:1783441533.294285:0:5779:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073693284992 00000100:00100000:2.0:1783441533.294289:0:5779:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073693284992 00000100:00100000:2.0:1783441533.294313:0:5779:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 296 00000100:00100000:2.0:1783441533.294320:0:5779:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a848f36050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6c1ddb50-5795-40c6-a2b6-8f58add9da62+19:3303:x1870073693284992:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1783441533.294352:0:5779:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a848f36050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6c1ddb50-5795-40c6-a2b6-8f58add9da62+19:3303:x1870073693284992:12345-0@lo:400:kworker.0 Request processed in 32us (245us total) trans 0 rc 0/0 00000100:00100000:2.0:1783441533.294357:0:5779:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 296 00000100:00100000:2.0:1783441533.294396:0:3303:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff91a87d87e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:6c1ddb50-5795-40c6-a2b6-8f58add9da62:3303:1870073693284992:0@lo:400:kworker.0 00000100:00100000:2.0:1783441533.294408:0:3303:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff91a87d87d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3303:1870073693285376:0@lo:400:kworker.0 00000100:00100000:0.0:1783441533.294511:0:5786:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073693285504 00000100:00100000:0.0:1783441533.294522:0:5786:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073693285504 00000100:00100000:0.0:1783441533.294565:0:5786:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 166 00000100:00100000:0.0:1783441533.294573:0:5786:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a874dc4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3303:x1870073693285504:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1783441533.294614:0:5786:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a874dc4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3303:x1870073693285504:12345-0@lo:400:kworker.0 Request processed in 42us (457us total) trans 0 rc 0/0 00000100:00100000:0.0:1783441533.294620:0:5786:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 166 00000100:00100000:0.0:1783441533.294650:0:3303:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff91a87d87fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3303:1870073693285504:0@lo:400:kworker.0 00000100:00080000:3.0:1783441533.296003:0:5781:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1783441533.296013:0:5781:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000040:00080000:1.0:1783441533.678114:0:11531:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:1.0:1783441533.678126:0:11531:0:(llog_cat.c:841:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1783441533.678641:0:11531:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 3 count 1 00000040:00080000:1.0:1783441533.678649:0:11531:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:3.0:1783441533.805120:0:3306:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff91a874dc5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3306:1870073693285760:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1783441533.805229:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783441533.805389:0:6584:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073693285760 00000100:00100000:2.0:1783441533.805401:0:6584:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073693285760 00000100:00100000:2.0:1783441533.805474:0:6584:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 72 00000100:00100000:2.0:1783441533.805486:0:6584:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a745900e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3306:x1870073693285760:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1783441533.805535:0:6584:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1783441533.805595:0:6584:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a745900e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3306:x1870073693285760:12345-0@lo:13:osp-pre-1-0.0 Request processed in 111us (366us total) trans 0 rc 0/0 00000100:00100000:2.0:1783441533.805603:0:6584:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 72 00000100:00100000:3.0:1783441533.805720:0:3306:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff91a874dc5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3306:1870073693285760:0@lo:13:osp-pre-1-0.0 00010000:00010000:0.0:1783441534.125915:0:5772:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1783441534.830195:0:3303:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff91a875424700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3303:1870073693285888:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1783441534.830295:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783441534.835793:0:6584:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073693285888 00000100:00100000:2.0:1783441534.835813:0:6584:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073693285888 00000100:00100000:2.0:1783441534.835886:0:6584:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 73 00000100:00100000:2.0:1783441534.835899:0:6584:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a877fae680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3303:x1870073693285888:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1783441534.835955:0:6584:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 45940736 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1783441534.836064:0:6584:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a877fae680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3303:x1870073693285888:12345-0@lo:13:osp-pre-0-0.0 Request processed in 167us (5769us total) trans 0 rc 0/0 00000100:00100000:2.0:1783441534.836073:0:6584:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 73 00000100:00100000:2.0:1783441534.836145:0:3303:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff91a875424700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3303:1870073693285888:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1783441534.857734:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.13@tcp (source: 12345-192.168.201.13@tcp) 00000100:00100000:2.0:1783441534.857805:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.13@tcp (source: 12345-192.168.201.13@tcp) 00000100:00100000:2.0:1783441534.857841:0:6583:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073673351424 00000100:00100000:2.0:1783441534.857854:0:6583:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073673351424 00000100:00100000:2.0:1783441534.857934:0:6583:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.13@tcp, seq: 94 00000100:00100000:2.0:1783441534.857947:0:6583:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a874dc7100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:65454767-383a-4679-a788-eba05c6e0989+6:2354:x1870073673351424:12345-192.168.201.13@tcp:400:kworker.0 00000100:00100000:2.0:1783441534.858047:0:6583:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a874dc7100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:65454767-383a-4679-a788-eba05c6e0989+6:2354:x1870073673351424:12345-192.168.201.13@tcp:400:kworker.0 Request processed in 102us (240us total) trans 0 rc 0/0 00000100:00100000:2.0:1783441534.858056:0:6583:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.13@tcp, seq: 94 00000100:00080000:2.0:1783441534.858093:0:5781:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1783441534.858128:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.13@tcp (source: 12345-192.168.201.13@tcp) 00000100:00100000:2.0:1783441534.858268:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.13@tcp (source: 12345-192.168.201.13@tcp) 00000100:00100000:2.0:1783441534.858293:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.13@tcp (source: 12345-192.168.201.13@tcp) 00000100:00100000:2.0:1783441534.858317:0:5786:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073673351680 00000100:00100000:2.0:1783441534.858321:0:5786:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073673351680 00000100:00100000:2.0:1783441534.858354:0:5786:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073673351296 00000100:00100000:2.0:1783441534.858357:0:5786:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073673351296 00000100:00100000:2.0:1783441534.858380:0:5786:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.13@tcp, seq: 167 00000100:00100000:2.0:1783441534.858387:0:5786:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a874dc4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d5aa2a25-c618-49e9-a833-85b3b4747e53+6:2354:x1870073673351680:12345-192.168.201.13@tcp:400:kworker.0 00000100:00100000:1.0:1783441534.860607:0:5780:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073673351168 00000100:00100000:1.0:1783441534.860625:0:5780:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073673351168 00000100:00100000:2.0:1783441534.861578:0:5786:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a874dc4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d5aa2a25-c618-49e9-a833-85b3b4747e53+6:2354:x1870073673351680:12345-192.168.201.13@tcp:400:kworker.0 Request processed in 3178us (3435us total) trans 0 rc 0/0 00000100:00100000:2.0:1783441534.861594:0:5786:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.13@tcp, seq: 167 00000100:00100000:1.0:1783441534.861808:0:5780:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.13@tcp, seq: 297 00000100:00100000:1.0:1783441534.861819:0:5780:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a848f37850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:51c2a82e-e792-4f56-84e8-12cc033e9e70+13:2354:x1870073673351168:12345-192.168.201.13@tcp:400:kworker.0 00000100:00100000:1.0:1783441534.861902:0:5780:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a848f37850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:51c2a82e-e792-4f56-84e8-12cc033e9e70+13:2354:x1870073673351168:12345-192.168.201.13@tcp:400:kworker.0 Request processed in 85us (4267us total) trans 0 rc 0/0 00000100:00100000:1.0:1783441534.861910:0:5780:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.13@tcp, seq: 297 00000100:00100000:2.0:1783441534.862814:0:5786:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.13@tcp, seq: 168 00000100:00100000:2.0:1783441534.862845:0:5786:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a874dc6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:65454767-383a-4679-a788-eba05c6e0989+15:2354:x1870073673351296:12345-192.168.201.13@tcp:400:kworker.0 00000100:00100000:2.0:1783441534.862914:0:5786:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a874dc6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:65454767-383a-4679-a788-eba05c6e0989+15:2354:x1870073673351296:12345-192.168.201.13@tcp:400:kworker.0 Request processed in 82us (4645us total) trans 0 rc 0/0 00000100:00100000:2.0:1783441534.862921:0:5786:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.13@tcp, seq: 168 00000100:00100000:2.0:1783441534.862966:0:6582:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073673351552 00000100:00100000:2.0:1783441534.862976:0:6582:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073673351552 00000100:00100000:2.0:1783441534.863037:0:6582:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.13@tcp, seq: 95 00000100:00100000:2.0:1783441534.863044:0:6582:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a874dc5c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:65454767-383a-4679-a788-eba05c6e0989+5:2354:x1870073673351552:12345-192.168.201.13@tcp:400:kworker.0 00000100:00100000:2.0:1783441534.863076:0:6582:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a874dc5c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:65454767-383a-4679-a788-eba05c6e0989+5:2354:x1870073673351552:12345-192.168.201.13@tcp:400:kworker.0 Request processed in 33us (4781us total) trans 0 rc 0/0 00000100:00100000:2.0:1783441534.863082:0:6582:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.13@tcp, seq: 95 00000100:00080000:2.0:1783441534.863102:0:5781:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1783441534.863125:0:5781:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000001:00080000:2.0:1783441534.921072:0:5807:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967417 is committed 00000100:00100000:0.0:1783441535.052729:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.13@tcp (source: 12345-192.168.201.13@tcp) 00000100:00100000:2.0:1783441535.052899:0:5786:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073673351808 00000100:00100000:2.0:1783441535.052914:0:5786:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073673351808 00000100:00100000:2.0:1783441535.052994:0:5786:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.13@tcp, seq: 139 00000100:00100000:2.0:1783441535.053008:0:5786:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a87d644700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:65454767-383a-4679-a788-eba05c6e0989+14:11305:x1870073673351808:12345-192.168.201.13@tcp:101:lfs.0 00010000:00010000:2.0:1783441535.053037:0:5786:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1783441535.053065:0:5786:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91a85f83da00/0xa2426164df2c80d5 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x633a354aa4df4f50 expref: -99 pid: 5786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783441535.053156:0:5786:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff91a85f83c000/0xa2426164df2c80dc lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783441535.053174:0:5786:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91a85f83c000/0xa2426164df2c80dc lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783441535.053190:0:5786:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91a85f83c000/0xa2426164df2c80dc lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783441535.053222:0:5786:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff91a85f83c400/0xa2426164df2c80e3 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783441535.053230:0:5786:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91a85f83c400/0xa2426164df2c80e3 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783441535.053237:0:5786:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91a85f83c400/0xa2426164df2c80e3 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783441535.053605:0:5786:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff91a85f83c000/0xa2426164df2c80dc lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783441535.053615:0:5786:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff91a85f83c000/0xa2426164df2c80dc lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783441535.053641:0:5786:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff91a85f83c000/0xa2426164df2c80dc lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783441535.053655:0:5786:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91a85f83c000 already unused, calling callback (ffffffffc1f9b4f0) 00010000:00010000:2.0:1783441535.053660:0:5786:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91a85f83c000/0xa2426164df2c80dc lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783441535.053669:0:5786:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91a85f83c000/0xa2426164df2c80dc lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783441535.053684:0:5786:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff91a85faee700) 00010000:00010000:2.0:1783441535.053688:0:5786:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1783441535.053694:0:5786:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff91a85f83c000/0xa2426164df2c80dc lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783441535.053699:0:5786:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91a85f83c000/0xa2426164df2c80dc lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783441535.053714:0:5786:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff91a85f83c400/0xa2426164df2c80e3 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783441535.053720:0:5786:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff91a85f83c400/0xa2426164df2c80e3 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783441535.053727:0:5786:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff91a85f83c400/0xa2426164df2c80e3 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783441535.053733:0:5786:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91a85f83c400 already unused, calling callback (ffffffffc1f9b4f0) 00010000:00010000:2.0:1783441535.053736:0:5786:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91a85f83c400/0xa2426164df2c80e3 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783441535.053789:0:5786:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91a85f83c400/0xa2426164df2c80e3 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783441535.053798:0:5786:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x94c4507b (ffff91a8429bd400) 00010000:00010000:2.0:1783441535.053801:0:5786:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1783441535.053803:0:5786:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff91a85f83c400/0xa2426164df2c80e3 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783441535.053809:0:5786:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91a85f83c400/0xa2426164df2c80e3 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783441535.053852:0:5786:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff91a85f83da00/0xa2426164df2c80d5 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.13@tcp remote: 0x633a354aa4df4f50 expref: 15 pid: 5786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783441535.053865:0:5786:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff91a85faee700) 00010000:00010000:2.0:1783441535.053867:0:5786:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1783441535.053871:0:5786:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91a85f83da00/0xa2426164df2c80d5 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.13@tcp remote: 0x633a354aa4df4f50 expref: 15 pid: 5786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783441535.053881:0:5786:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91a85f83da00, rc 0) 00000100:00100000:2.0:1783441535.053967:0:5786:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a87d644700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:65454767-383a-4679-a788-eba05c6e0989+14:11305:x1870073673351808:12345-192.168.201.13@tcp:101:lfs.0 Request processed in 962us (1249us total) trans 0 rc 301/301 00000100:00100000:2.0:1783441535.053978:0:5786:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.13@tcp, seq: 139 00000100:00100000:2.0:1783441535.058889:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.13@tcp (source: 12345-192.168.201.13@tcp) 00000100:00100000:3.0:1783441535.059212:0:6605:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073673352064 00000100:00100000:3.0:1783441535.059226:0:6605:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073673352064 00000100:00100000:3.0:1783441535.059307:0:6605:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.13@tcp, seq: 140 00000100:00100000:3.0:1783441535.059319:0:6605:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a874dc6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:65454767-383a-4679-a788-eba05c6e0989+14:11305:x1870073673352064:12345-192.168.201.13@tcp:36:lfs.0 00010000:00010000:3.0:1783441535.059395:0:6605:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1783441535.059431:0:6605:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91a841476000/0xa2426164df2c7a53 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.13@tcp remote: 0x633a354aa4df4d89 expref: 14 pid: 5787 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783441535.059457:0:6605:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff91a85faee700) 00010000:00010000:3.0:1783441535.059463:0:6605:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1783441535.060108:0:6605:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff91a85eb3d600/0xa2426164df2c80ea lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6605 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783441535.060131:0:6605:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff91a85f83d000/0xa2426164df2c80ab lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.13@tcp remote: 0x633a354aa4df4f42 expref: 5 pid: 5787 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783441535.060140:0:6605:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff91a85eb3d600/0xa2426164df2c80ea lrc: 4/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6605 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783441535.060189:0:6605:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff91a85f83d000/0xa2426164df2c80ab lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.13@tcp remote: 0x633a354aa4df4f42 expref: 5 pid: 5787 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783441535.060278:0:6605:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff91a85f83d000/0xa2426164df2c80ab lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.13@tcp remote: 0x633a354aa4df4f42 expref: 5 pid: 5787 timeout: 472 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783441535.060313:0:6605:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff91a745902300 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:6605:1870073693286016:192.168.201.13@tcp:104: 00000100:00100000:3.0:1783441535.060580:0:6605:0:(client.c:2702:ptlrpc_set_wait()) set ffff91a7410c8300 going to sleep for 11 seconds 00000100:00100000:3.0:1783441535.079003:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.13@tcp (source: 12345-192.168.201.13@tcp) 00000100:00100000:3.0:1783441535.079081:0:6605:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff91a745902300 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:6605:1870073693286016:192.168.201.13@tcp:104: 00010000:00010000:3.0:1783441535.079116:0:6605:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff91a85eb3d600/0xa2426164df2c80ea lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6605 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783441535.081021:0:5769:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073673352192 00000100:00100000:1.0:1783441535.081043:0:5769:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073673352192 00010000:00010000:1.0:1783441535.081109:0:5769:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff91a85f83d000/0xa2426164df2c80ab lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.13@tcp remote: 0x633a354aa4df4f42 expref: 6 pid: 5787 timeout: 472 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783441535.081172:0:5769:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.13@tcp, seq: 62 00000100:00100000:1.0:1783441535.081183:0:5769:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a745903800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:d5aa2a25-c618-49e9-a833-85b3b4747e53+6:2355:x1870073673352192:12345-192.168.201.13@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1783441535.081202:0:5769:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1783441535.081210:0:5769:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff91a85f83d000/0xa2426164df2c80ab lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.13@tcp remote: 0x633a354aa4df4f42 expref: 6 pid: 5787 timeout: 472 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783441535.081242:0:5769:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff91a85f83d000/0xa2426164df2c80ab lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.13@tcp remote: 0x633a354aa4df4f42 expref: 6 pid: 5787 timeout: 472 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783441535.081273:0:5769:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91a85f83d000/0xa2426164df2c80ab lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.13@tcp remote: 0x633a354aa4df4f42 expref: 6 pid: 5787 timeout: 472 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783441535.081291:0:5769:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff91a85faee700) 00010000:00010000:1.0:1783441535.081298:0:5769:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff91a85eb3d600/0xa2426164df2c80ea lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6605 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783441535.081309:0:5769:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff91a85eb3d600/0xa2426164df2c80ea lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 6605 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783441535.081317:0:5769:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91a85eb3d600/0xa2426164df2c80ea lrc: 4/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 6605 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783441535.081352:0:5769:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1783441535.081437:0:5769:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a745903800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:d5aa2a25-c618-49e9-a833-85b3b4747e53+5:2355:x1870073673352192:12345-192.168.201.13@tcp:103:ldlm_bl.0 Request processed in 254us (2448us total) trans 0 rc 0/0 00000100:00100000:1.0:1783441535.081445:0:5769:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.13@tcp, seq: 62 00010000:00010000:3.0:1783441535.082204:0:6605:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff91a85eb3d600/0xa2426164df2c80ea lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6605 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783441535.082219:0:6605:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91a85eb3d600/0xa2426164df2c80ea lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6605 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783441535.082252:0:6605:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff91a85eb3d000/0xa2426164df2c80f1 lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6605 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783441535.082266:0:6605:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91a85eb3d000/0xa2426164df2c80f1 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6605 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783441535.082277:0:6605:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91a85eb3d000/0xa2426164df2c80f1 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6605 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1783441535.083732:0:6605:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xa:0x0]: returning size 512 00010000:00010000:3.0:1783441535.083792:0:6605:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff91a85eb3d600/0xa2426164df2c80ea lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6605 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783441535.083804:0:6605:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff91a85eb3d600/0xa2426164df2c80ea lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6605 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783441535.083826:0:6605:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff91a85eb3d600/0xa2426164df2c80ea lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6605 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783441535.083833:0:6605:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91a85eb3d600 already unused, calling callback (ffffffffc1f9b4f0) 00010000:00010000:3.0:1783441535.083839:0:6605:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91a85eb3d600/0xa2426164df2c80ea lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6605 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783441535.083849:0:6605:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91a85eb3d600/0xa2426164df2c80ea lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6605 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783441535.083869:0:6605:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff91a85faee700) 00010000:00010000:3.0:1783441535.083873:0:6605:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1783441535.083878:0:6605:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff91a85eb3d600/0xa2426164df2c80ea lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6605 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783441535.083886:0:6605:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91a85eb3d600/0xa2426164df2c80ea lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6605 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1783441535.083912:0:6605:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000ae4ac4c8 reply state 00000000322f69df transno 4294967418 ns: mdt-lustre-MDT0000_UUID lock: ffff91a85eb3d000/0xa2426164df2c80f1 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6605 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783441535.083922:0:6605:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1783441535.084057:0:6605:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a874dc6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:65454767-383a-4679-a788-eba05c6e0989+15:11305:x1870073673352064:12345-192.168.201.13@tcp:36:lfs.0 Request processed in 24735us (25180us total) trans 4294967418 rc 0/0 00000100:00100000:3.0:1783441535.084068:0:6605:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.13@tcp, seq: 140 00010000:00010000:2.0:1783441535.093041:0:3289:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff91a85eb3d000/0xa2426164df2c80f1 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6605 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783441535.093064:0:3289:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff91a85eb3d000/0xa2426164df2c80f1 lrc: 2/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6605 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783441535.093091:0:3289:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff91a85eb3d000/0xa2426164df2c80f1 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6605 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783441535.093098:0:3289:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91a85eb3d000 already unused, calling callback (ffffffffc1f9b4f0) 00010000:00010000:2.0:1783441535.093105:0:3289:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91a85eb3d000/0xa2426164df2c80f1 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6605 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783441535.093114:0:3289:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91a85eb3d000/0xa2426164df2c80f1 lrc: 4/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6605 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783441535.093137:0:3289:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x94c4507b (ffff91a85faeea00) 00010000:00010000:2.0:1783441535.093140:0:3289:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1783441535.093145:0:3289:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff91a85eb3d000/0xa2426164df2c80f1 lrc: 2/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6605 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783441535.093151:0:3289:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91a85eb3d000/0xa2426164df2c80f1 lrc: 0/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6605 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783441535.161059:0:5773:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1783441535.205860:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.13@tcp (source: 12345-192.168.201.13@tcp) 00000100:00100000:2.0:1783441535.206314:0:5786:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073673352320 00000100:00100000:2.0:1783441535.206331:0:5786:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073673352320 00000100:00100000:2.0:1783441535.206411:0:5786:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.13@tcp, seq: 141 00000100:00100000:2.0:1783441535.206423:0:5786:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a745902300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:65454767-383a-4679-a788-eba05c6e0989+14:11313:x1870073673352320:12345-192.168.201.13@tcp:101:lctl.0 00010000:00010000:2.0:1783441535.206458:0:5786:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1783441535.206489:0:5786:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91a85f83c000/0xa2426164df2c80f8 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x633a354aa4df4f57 expref: -99 pid: 5786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783441535.206575:0:5786:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff91a85f83d000/0xa2426164df2c80ff lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783441535.206608:0:5786:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91a85f83d000/0xa2426164df2c80ff lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783441535.206622:0:5786:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91a85f83d000/0xa2426164df2c80ff lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1783441535.206719:0:5786:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 7680 00000004:00200000:2.0:1783441535.206723:0:5786:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 3 stripe count 1 MDT count 1 00000004:00010000:2.0:1783441535.210036:0:5786:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff91a85f83d000/0xa2426164df2c80ff lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783441535.210127:0:5786:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91a85f83c000/0xa2426164df2c80f8 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.13@tcp remote: 0x633a354aa4df4f57 expref: 16 pid: 5786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783441535.210152:0:5786:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff91a85f83d000/0xa2426164df2c80ff lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.13@tcp remote: 0x633a354aa4df4f57 expref: 15 pid: 5786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783441535.210165:0:5786:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff91a8429bd400) 00010000:00010000:2.0:1783441535.210168:0:5786:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1783441535.210173:0:5786:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91a85f83d000, rc 0) 00000100:00100000:2.0:1783441535.210288:0:5786:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a745902300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:65454767-383a-4679-a788-eba05c6e0989+15:11313:x1870073673352320:12345-192.168.201.13@tcp:101:lctl.0 Request processed in 3864us (4436us total) trans 0 rc 0/0 00000100:00100000:2.0:1783441535.210301:0:5786:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.13@tcp, seq: 141 00000100:00100000:3.0:1783441535.277899:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.13@tcp (source: 12345-192.168.201.13@tcp) 00000100:00100000:2.0:1783441535.280835:0:5787:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073673352448 00000100:00100000:2.0:1783441535.280860:0:5787:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073673352448 00000100:00100000:2.0:1783441535.280979:0:5787:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.13@tcp, seq: 142 00000100:00100000:2.0:1783441535.280993:0:5787:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a745901500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:65454767-383a-4679-a788-eba05c6e0989+15:11319:x1870073673352448:12345-192.168.201.13@tcp:101:bash.0 00010000:00010000:2.0:1783441535.281024:0:5787:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1783441535.281074:0:5787:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91a85f83c000/0xa2426164df2c8106 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x633a354aa4df4f5e expref: -99 pid: 5787 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783441535.281175:0:5787:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff91a85f83c400/0xa2426164df2c810d lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783441535.281195:0:5787:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91a85f83c400/0xa2426164df2c810d lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783441535.281209:0:5787:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91a85f83c400/0xa2426164df2c810d lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783441535.281239:0:5787:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff91a85f83da00/0xa2426164df2c8114 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783441535.281248:0:5787:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91a85f83da00/0xa2426164df2c8114 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783441535.281254:0:5787:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91a85f83da00/0xa2426164df2c8114 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783441535.281407:0:5787:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff91a85f83cc00/0xa2426164df2c811b lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783441535.281416:0:5787:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91a85f83cc00/0xa2426164df2c811b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783441535.281424:0:5787:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91a85f83cc00/0xa2426164df2c811b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1783441535.281463:0:5787:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xa:0x0]: returning size 512 00000004:00200000:2.0:1783441535.281467:0:5787:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1783441535.281493:0:5787:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff91a85f83cc00/0xa2426164df2c811b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783441535.281513:0:5787:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff91a85f83c400/0xa2426164df2c810d lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783441535.281520:0:5787:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff91a85f83c400/0xa2426164df2c810d lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783441535.281528:0:5787:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff91a85f83c400/0xa2426164df2c810d lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783441535.281534:0:5787:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91a85f83c400 already unused, calling callback (ffffffffc1f9b4f0) 00010000:00010000:2.0:1783441535.281539:0:5787:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91a85f83c400/0xa2426164df2c810d lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783441535.281547:0:5787:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91a85f83c400/0xa2426164df2c810d lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783441535.281562:0:5787:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff91a8429bd400) 00010000:00010000:2.0:1783441535.281565:0:5787:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1783441535.281571:0:5787:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff91a85f83c400/0xa2426164df2c810d lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783441535.281577:0:5787:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91a85f83c400/0xa2426164df2c810d lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783441535.281593:0:5787:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff91a85f83da00/0xa2426164df2c8114 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783441535.281599:0:5787:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff91a85f83da00/0xa2426164df2c8114 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783441535.281604:0:5787:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff91a85f83da00/0xa2426164df2c8114 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783441535.281618:0:5787:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91a85f83da00 already unused, calling callback (ffffffffc1f9b4f0) 00010000:00010000:2.0:1783441535.281621:0:5787:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91a85f83da00/0xa2426164df2c8114 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783441535.281637:0:5787:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91a85f83da00/0xa2426164df2c8114 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783441535.281647:0:5787:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x94c4507b (ffff91a8429bd700) 00010000:00010000:2.0:1783441535.281650:0:5787:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1783441535.281653:0:5787:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff91a85f83da00/0xa2426164df2c8114 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783441535.281659:0:5787:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91a85f83da00/0xa2426164df2c8114 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783441535.281695:0:5787:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91a85f83c000/0xa2426164df2c8106 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.13@tcp remote: 0x633a354aa4df4f5e expref: 17 pid: 5787 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783441535.281710:0:5787:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff91a85f83cc00/0xa2426164df2c811b lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.13@tcp remote: 0x633a354aa4df4f5e expref: 16 pid: 5787 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783441535.281717:0:5787:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff91a8429bdc00) 00010000:00010000:2.0:1783441535.281720:0:5787:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:2.0:1783441535.281723:0:5787:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91a85f83cc00, rc 0) 00000100:00100000:2.0:1783441535.281885:0:5787:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a745901500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:65454767-383a-4679-a788-eba05c6e0989+16:11319:x1870073673352448:12345-192.168.201.13@tcp:101:bash.0 Request processed in 893us (3996us total) trans 0 rc 0/0 00000100:00100000:2.0:1783441535.281895:0:5787:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.13@tcp, seq: 142 00000100:00100000:0.0:1783441535.287480:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.13@tcp (source: 12345-192.168.201.13@tcp) 00000100:00100000:3.0:1783441535.287647:0:5785:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073673352704 00000100:00100000:3.0:1783441535.287661:0:5785:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073673352704 00000100:00100000:3.0:1783441535.287875:0:5785:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.13@tcp, seq: 143 00000100:00100000:3.0:1783441535.287914:0:5785:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a87d645500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:65454767-383a-4679-a788-eba05c6e0989+16:11319:x1870073673352704:12345-192.168.201.13@tcp:101:bash.0 00010000:00010000:3.0:1783441535.287942:0:5785:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1783441535.287971:0:5785:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91a85eb3d600/0xa2426164df2c8122 lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x633a354aa4df4f65 expref: -99 pid: 5785 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783441535.288463:0:5785:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff91a85eb3da00/0xa2426164df2c8129 lrc: 3/0,1 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783441535.288483:0:5785:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91a85eb3da00/0xa2426164df2c8129 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783441535.288498:0:5785:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91a85eb3da00/0xa2426164df2c8129 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783441535.288696:0:5785:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff91a85eb3ce00/0xa2426164df2c8130 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783441535.288722:0:5785:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91a85eb3ce00/0xa2426164df2c8130 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783441535.288738:0:5785:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91a85eb3ce00/0xa2426164df2c8130 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:3.0:1783441535.289651:0:5785:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x4:0x0], index 1: 0 00010000:00010000:3.0:1783441535.290975:0:5785:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff91a85eb3d200/0xa2426164df2c8137 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783441535.290995:0:5785:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91a85eb3d200/0xa2426164df2c8137 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783441535.291006:0:5785:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91a85eb3d200/0xa2426164df2c8137 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783441535.291064:0:5785:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff91a85eb3da00/0xa2426164df2c8129 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783441535.291071:0:5785:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff91a85eb3da00/0xa2426164df2c8129 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783441535.291078:0:5785:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff91a85eb3da00/0xa2426164df2c8129 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783441535.291084:0:5785:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91a85eb3da00 already unused, calling callback (ffffffffc1f9b4f0) 00010000:00010000:3.0:1783441535.291088:0:5785:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91a85eb3da00/0xa2426164df2c8129 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783441535.291095:0:5785:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91a85eb3da00/0xa2426164df2c8129 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783441535.291107:0:5785:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff91a8429bdc00) 00010000:00010000:3.0:1783441535.291111:0:5785:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1783441535.291115:0:5785:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff91a85eb3da00/0xa2426164df2c8129 lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783441535.291121:0:5785:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91a85eb3da00/0xa2426164df2c8129 lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1783441535.291135:0:5785:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000f7d98cf9 reply state 00000000d2b19d8e transno 4294967419 ns: mdt-lustre-MDT0000_UUID lock: ffff91a85eb3ce00/0xa2426164df2c8130 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783441535.291154:0:5785:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:3.0:1783441535.291195:0:5785:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91a85eb3d600/0xa2426164df2c8122 lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.13@tcp remote: 0x633a354aa4df4f65 expref: 19 pid: 5785 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783441535.291221:0:5785:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff91a85eb3d200/0xa2426164df2c8137 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.13@tcp remote: 0x633a354aa4df4f65 expref: 18 pid: 5785 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783441535.291229:0:5785:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff91a85faee500) 00010000:00010000:3.0:1783441535.291232:0:5785:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1783441535.291234:0:5785:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91a85eb3d200, rc 0) 00000100:00100000:3.0:1783441535.291318:0:5785:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a87d645500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:65454767-383a-4679-a788-eba05c6e0989+19:11319:x1870073673352704:12345-192.168.201.13@tcp:101:bash.0 Request processed in 3406us (3854us total) trans 4294967419 rc 0/0 00000100:00100000:3.0:1783441535.291327:0:5785:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.13@tcp, seq: 143 00000100:00100000:1.0:1783441535.297602:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.13@tcp (source: 12345-192.168.201.13@tcp) 00000100:00100000:2.0:1783441535.297737:0:6583:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073673352832 00010000:00010000:0.0:1783441535.297768:0:3290:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff91a85eb3ce00/0xa2426164df2c8130 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783441535.297783:0:3290:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff91a85eb3ce00/0xa2426164df2c8130 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783441535.297790:0:3290:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff91a85eb3ce00/0xa2426164df2c8130 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783441535.297796:0:3290:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91a85eb3ce00 already unused, calling callback (ffffffffc1f9b4f0) 00010000:00010000:0.0:1783441535.297806:0:3290:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91a85eb3ce00/0xa2426164df2c8130 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783441535.297815:0:3290:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91a85eb3ce00/0xa2426164df2c8130 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783441535.297825:0:6583:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073673352832 00010000:00010000:0.0:1783441535.297833:0:3290:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff91a85faee700) 00010000:00010000:0.0:1783441535.297839:0:3290:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1783441535.297844:0:3290:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff91a85eb3ce00/0xa2426164df2c8130 lrc: 2/0,0 mode: --/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783441535.297873:0:3290:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91a85eb3ce00/0xa2426164df2c8130 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783441535.297935:0:6583:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.13@tcp, seq: 48 00000100:00100000:2.0:1783441535.297951:0:6583:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a877face00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:65454767-383a-4679-a788-eba05c6e0989+5:2354:x1870073673352832:12345-192.168.201.13@tcp:101:bash.0 00010000:00010000:2.0:1783441535.297978:0:6583:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1783441535.298007:0:6583:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000006656bc4f/0xa2426164df2c8145 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x633a354aa4df4f6c expref: -99 pid: 6583 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1783441535.298042:0:6583:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x4:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1783441535.298068:0:6583:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x4:0x0].0x0 since=373s v=(0 0) 00010000:00010000:2.0:1783441535.298186:0:6583:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1783441535.298199:0:6583:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000006656bc4f/0xa2426164df2c8145 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.13@tcp remote: 0x633a354aa4df4f6c expref: 6 pid: 6583 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783441535.298221:0:6583:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 000000006656bc4f/0xa2426164df2c8145 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.13@tcp remote: 0x633a354aa4df4f6c expref: 6 pid: 6583 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783441535.298237:0:6583:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91a85f83da00, rc 0) 00000100:00100000:2.0:1783441535.298378:0:6583:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a877face00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:65454767-383a-4679-a788-eba05c6e0989+6:2354:x1870073673352832:12345-192.168.201.13@tcp:101:bash.0 Request processed in 430us (786us total) trans 0 rc 0/0 00000100:00100000:2.0:1783441535.298385:0:6583:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.13@tcp, seq: 48 00000100:00100000:2.0:1783441535.305955:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.13@tcp (source: 12345-192.168.201.13@tcp) 00000100:00100000:0.0:1783441535.306244:0:6582:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073673352960 00000100:00100000:0.0:1783441535.306258:0:6582:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073673352960 00000100:00100000:0.0:1783441535.306330:0:6582:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.13@tcp, seq: 49 00000100:00100000:0.0:1783441535.306341:0:6582:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a874dc7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:65454767-383a-4679-a788-eba05c6e0989+6:11319:x1870073673352960:12345-192.168.201.13@tcp:101:bash.0 00010000:00010000:0.0:1783441535.306372:0:6582:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1783441535.306400:0:6582:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000004be678b2/0xa2426164df2c814c lrc: 2/0,0 mode: --/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x633a354aa4df4f73 expref: -99 pid: 6582 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783441535.306449:0:6582:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 000000006656bc4f/0xa2426164df2c8145 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.13@tcp remote: 0x633a354aa4df4f6c expref: 7 pid: 6583 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783441535.306460:0:6582:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1783441535.306465:0:6582:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1783441535.306470:0:6582:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000004be678b2/0xa2426164df2c814c lrc: 4/0,0 mode: --/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.201.13@tcp remote: 0x633a354aa4df4f73 expref: 7 pid: 6582 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783441535.306519:0:6582:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 000000006656bc4f/0xa2426164df2c8145 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.201.13@tcp remote: 0x633a354aa4df4f6c expref: 7 pid: 6583 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783441535.306534:0:6582:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 000000006656bc4f/0xa2426164df2c8145 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.201.13@tcp remote: 0x633a354aa4df4f6c expref: 7 pid: 6583 timeout: 473 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783441535.306552:0:6582:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff91a87d644380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:6582:1870073693286144:192.168.201.13@tcp:104: 00000100:00100000:0.0:1783441535.306719:0:6582:0:(client.c:2702:ptlrpc_set_wait()) set ffff91a846aea3c0 going to sleep for 11 seconds 00000100:00100000:1.0:1783441535.318275:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.13@tcp (source: 12345-192.168.201.13@tcp) 00000100:00100000:2.0:1783441535.318296:0:6582:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff91a87d644380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:6582:1870073693286144:192.168.201.13@tcp:104: 00010000:00010000:2.0:1783441535.318345:0:6582:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 000000004be678b2/0xa2426164df2c814c lrc: 3/0,0 mode: --/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.201.13@tcp remote: 0x633a354aa4df4f73 expref: 7 pid: 6582 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783441535.318375:0:6582:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91a85fe58600, rc 0) 00000100:00100000:2.0:1783441535.318527:0:6582:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a874dc7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:65454767-383a-4679-a788-eba05c6e0989+7:11319:x1870073673352960:12345-192.168.201.13@tcp:101:bash.0 Request processed in 12185us (12586us total) trans 0 rc 0/0 00000100:00100000:2.0:1783441535.318539:0:6582:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.13@tcp, seq: 49 00000100:00100000:3.0:1783441535.318653:0:5770:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073673353088 00000100:00100000:3.0:1783441535.318664:0:5770:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073673353088 00010000:00010000:3.0:1783441535.318704:0:5770:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 000000006656bc4f/0xa2426164df2c8145 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.201.13@tcp remote: 0x633a354aa4df4f6c expref: 7 pid: 6583 timeout: 473 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783441535.318774:0:5770:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.13@tcp, seq: 63 00000100:00100000:3.0:1783441535.318785:0:5770:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a877fadc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:65454767-383a-4679-a788-eba05c6e0989+7:2355:x1870073673353088:12345-192.168.201.13@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1783441535.318803:0:5770:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1783441535.318842:0:5770:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 000000006656bc4f/0xa2426164df2c8145 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.201.13@tcp remote: 0x633a354aa4df4f6c expref: 7 pid: 6583 timeout: 473 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783441535.318858:0:5770:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 000000006656bc4f/0xa2426164df2c8145 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.201.13@tcp remote: 0x633a354aa4df4f6c expref: 7 pid: 6583 timeout: 473 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783441535.318887:0:5770:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000006656bc4f/0xa2426164df2c8145 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.201.13@tcp remote: 0x633a354aa4df4f6c expref: 7 pid: 6583 timeout: 473 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783441535.318919:0:5770:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1783441535.318924:0:5770:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1783441535.318934:0:5770:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 000000004be678b2/0xa2426164df2c814c lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.201.13@tcp remote: 0x633a354aa4df4f73 expref: 6 pid: 6582 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783441535.318945:0:5770:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000004be678b2/0xa2426164df2c814c lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.201.13@tcp remote: 0x633a354aa4df4f73 expref: 6 pid: 6582 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783441535.318990:0:5770:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 000000004be678b2/0xa2426164df2c814c lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.201.13@tcp remote: 0x633a354aa4df4f73 expref: 6 pid: 6582 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783441535.319006:0:5770:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff91a745900000 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:5770:1870073693286272:192.168.201.13@tcp:105: 00000100:00100000:3.0:1783441535.319076:0:5770:0:(client.c:2702:ptlrpc_set_wait()) set ffff91a848552840 going to sleep for 11 seconds 00000100:00100000:3.0:1783441535.331092:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.13@tcp (source: 12345-192.168.201.13@tcp) 00000100:00100000:0.0:1783441535.331290:0:5770:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff91a745900000 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:5770:1870073693286272:192.168.201.13@tcp:105: 00010000:00010000:0.0:1783441535.331343:0:5770:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1783441535.331423:0:5770:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a877fadc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:65454767-383a-4679-a788-eba05c6e0989+6:2355:x1870073673353088:12345-192.168.201.13@tcp:103:ldlm_bl.0 Request processed in 12638us (13161us total) trans 0 rc 0/0 00000100:00100000:0.0:1783441535.331437:0:5770:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.13@tcp, seq: 63 00000100:00100000:1.0:1783441535.331565:0:5788:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073673353344 00000100:00100000:1.0:1783441535.331576:0:5788:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073673353344 00000100:00100000:0.0:1783441535.332095:0:5789:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.13@tcp, seq: 36 00000100:00100000:0.0:1783441535.332109:0:5789:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a745900380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:65454767-383a-4679-a788-eba05c6e0989+18:11319:x1870073673353344:12345-192.168.201.13@tcp:35:bash.0 00000100:00100000:0.0:1783441535.332706:0:5789:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a745900380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:65454767-383a-4679-a788-eba05c6e0989+19:11319:x1870073673353344:12345-192.168.201.13@tcp:35:bash.0 Request processed in 595us (1623us total) trans 4294967420 rc 0/0 00000100:00100000:0.0:1783441535.332716:0:5789:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.13@tcp, seq: 36 00000100:00100000:3.0:1783441535.419428:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.13@tcp (source: 12345-192.168.201.13@tcp) 00000100:00100000:0.0:1783441535.419803:0:6605:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073673353600 00000100:00100000:0.0:1783441535.419816:0:6605:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073673353600 00000100:00100000:0.0:1783441535.419901:0:6605:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.13@tcp, seq: 144 00000100:00100000:0.0:1783441535.419912:0:6605:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a745903480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:65454767-383a-4679-a788-eba05c6e0989+19:11329:x1870073673353600:12345-192.168.201.13@tcp:101:lfs.0 00010000:00010000:0.0:1783441535.419948:0:6605:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1783441535.419990:0:6605:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91a85fe59600/0xa2426164df2c8153 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x633a354aa4df4f7a expref: -99 pid: 6605 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1783441535.420150:0:6605:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xa:0x0]: returning size 512 00010000:00010000:0.0:1783441535.420330:0:6605:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff91a85fe59600/0xa2426164df2c8153 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.13@tcp remote: 0x633a354aa4df4f7a expref: 21 pid: 6605 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783441535.420351:0:6605:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff91a8429bd400) 00010000:00010000:0.0:1783441535.420354:0:6605:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1783441535.420380:0:6605:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91a85fe59600/0xa2426164df2c8153 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.13@tcp remote: 0x633a354aa4df4f7a expref: 21 pid: 6605 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783441535.420398:0:6605:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91a85fe59600, rc 0) 00000100:00100000:0.0:1783441535.420493:0:6605:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a745903480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:65454767-383a-4679-a788-eba05c6e0989+20:11329:x1870073673353600:12345-192.168.201.13@tcp:101:lfs.0 Request processed in 582us (1081us total) trans 4294967421 rc 301/301 00000100:00100000:0.0:1783441535.420501:0:6605:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.13@tcp, seq: 144 00000100:00100000:1.0:1783441535.433219:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.13@tcp (source: 12345-192.168.201.13@tcp) 00000100:00100000:2.0:1783441535.433414:0:5788:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073673353856 00000100:00100000:2.0:1783441535.433430:0:5788:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073673353856 00000100:00100000:2.0:1783441535.433518:0:5788:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.13@tcp, seq: 37 00000100:00100000:2.0:1783441535.433529:0:5788:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a8749a5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:65454767-383a-4679-a788-eba05c6e0989+20:11329:x1870073673353856:12345-192.168.201.13@tcp:35:lfs.0 00000100:00100000:2.0:1783441535.434239:0:5788:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a8749a5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:65454767-383a-4679-a788-eba05c6e0989+21:11329:x1870073673353856:12345-192.168.201.13@tcp:35:lfs.0 Request processed in 707us (1031us total) trans 4294967422 rc 0/0 00000100:00100000:2.0:1783441535.434250:0:5788:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.13@tcp, seq: 37 00000100:00100000:1.0:1783441535.536369:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.13@tcp (source: 12345-192.168.201.13@tcp) 00000100:00100000:2.0:1783441535.536546:0:5786:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073673353984 00000100:00100000:2.0:1783441535.536560:0:5786:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073673353984 00000100:00100000:2.0:1783441535.536659:0:5786:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.13@tcp, seq: 145 00000100:00100000:2.0:1783441535.536672:0:5786:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a8749a5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:65454767-383a-4679-a788-eba05c6e0989+21:11335:x1870073673353984:12345-192.168.201.13@tcp:101:lfs.0 00010000:00010000:2.0:1783441535.536710:0:5786:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1783441535.536779:0:5786:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91a85f83d600/0xa2426164df2c8161 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x633a354aa4df4f81 expref: -99 pid: 5786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783441535.536876:0:5786:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff91a85f83d800/0xa2426164df2c8168 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783441535.536893:0:5786:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91a85f83d800/0xa2426164df2c8168 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783441535.536907:0:5786:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91a85f83d800/0xa2426164df2c8168 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1783441535.536997:0:5786:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xa:0x0]: returning size 512 00000004:00200000:2.0:1783441535.537020:0:5786:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 1 stripe count 1 MDT count 1 00000004:00010000:2.0:1783441535.537053:0:5786:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff91a85f83d800/0xa2426164df2c8168 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783441535.537088:0:5786:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91a85f83d600/0xa2426164df2c8161 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.13@tcp remote: 0x633a354aa4df4f81 expref: 23 pid: 5786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783441535.537109:0:5786:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff91a85f83d800/0xa2426164df2c8168 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.13@tcp remote: 0x633a354aa4df4f81 expref: 22 pid: 5786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783441535.537120:0:5786:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff91a8429bdc00) 00010000:00010000:2.0:1783441535.537124:0:5786:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1783441535.537128:0:5786:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91a85f83d800, rc 0) 00000100:00100000:2.0:1783441535.537217:0:5786:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a8749a5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:65454767-383a-4679-a788-eba05c6e0989+22:11335:x1870073673353984:12345-192.168.201.13@tcp:101:lfs.0 Request processed in 548us (863us total) trans 0 rc 0/0 00000100:00100000:2.0:1783441535.537225:0:5786:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.13@tcp, seq: 145 00000100:00100000:3.0:1783441535.543422:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.13@tcp (source: 12345-192.168.201.13@tcp) 00000100:00100000:0.0:1783441535.543558:0:6605:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073673354240 00000100:00100000:0.0:1783441535.543572:0:6605:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073673354240 00000100:00100000:0.0:1783441535.543664:0:6605:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.13@tcp, seq: 146 00000100:00100000:0.0:1783441535.543676:0:6605:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a745901880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:65454767-383a-4679-a788-eba05c6e0989+22:11335:x1870073673354240:12345-192.168.201.13@tcp:101:lfs.0 00010000:00010000:0.0:1783441535.543706:0:6605:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1783441535.543734:0:6605:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91a85fe59600/0xa2426164df2c816f lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x633a354aa4df4f88 expref: -99 pid: 6605 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783441535.543902:0:6605:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff91a85fe59200/0xa2426164df2c8176 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6605 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783441535.543921:0:6605:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91a85fe59200/0xa2426164df2c8176 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6605 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783441535.543935:0:6605:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91a85fe59200/0xa2426164df2c8176 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6605 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1783441535.543948:0:6605:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 13 00010000:00010000:0.0:1783441535.544254:0:6605:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91a85fe59600/0xa2426164df2c816f lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.13@tcp remote: 0x633a354aa4df4f88 expref: 25 pid: 6605 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783441535.544278:0:6605:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff91a85fe59200/0xa2426164df2c8176 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.13@tcp remote: 0x633a354aa4df4f88 expref: 24 pid: 6605 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783441535.544442:0:6605:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff91a85faee500) 00010000:00010000:0.0:1783441535.544446:0:6605:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1783441535.544450:0:6605:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91a85fe59200, rc 0) 00000100:00100000:0.0:1783441535.544599:0:6605:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a745901880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:65454767-383a-4679-a788-eba05c6e0989+24:11335:x1870073673354240:12345-192.168.201.13@tcp:101:lfs.0 Request processed in 925us (1194us total) trans 4294967423 rc 0/0 00000100:00100000:0.0:1783441535.544608:0:6605:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.13@tcp, seq: 146 00000100:00100000:1.0:1783441535.551891:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.13@tcp (source: 12345-192.168.201.13@tcp) 00000100:00100000:3.0:1783441535.551993:0:11015:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073673354624 00000100:00100000:3.0:1783441535.552006:0:11015:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073673354624 00000100:00100000:3.0:1783441535.552105:0:11015:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.13@tcp, seq: 9 00000100:00100000:3.0:1783441535.552116:0:11015:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a8749a4700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:65454767-383a-4679-a788-eba05c6e0989+24:2354:x1870073673354624:12345-192.168.201.13@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1783441535.552135:0:11015:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1783441535.552168:0:11015:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91a85fe59200/0xa2426164df2c8176 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.13@tcp remote: 0x633a354aa4df4f88 expref: 24 pid: 6605 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783441535.552194:0:11015:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff91a85faee500) 00010000:00010000:3.0:1783441535.552207:0:11015:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1783441535.553704:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.13@tcp (source: 12345-192.168.201.13@tcp) 00000100:00100000:2.0:1783441535.553783:0:5785:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073673354496 00000100:00100000:2.0:1783441535.553794:0:5785:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073673354496 00000100:00100000:2.0:1783441535.553861:0:5785:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.13@tcp, seq: 147 00000100:00100000:2.0:1783441535.553871:0:5785:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a87d80ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:65454767-383a-4679-a788-eba05c6e0989+24:11335:x1870073673354496:12345-192.168.201.13@tcp:101:lfs.0 00010000:00010000:2.0:1783441535.553902:0:5785:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1783441535.553928:0:5785:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91a85f83d600/0xa2426164df2c8184 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x633a354aa4df4f8f expref: -99 pid: 5785 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783441535.554072:0:5785:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff91a85f83c400/0xa2426164df2c818b lrc: 3/0,1 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783441535.554089:0:5785:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91a85f83c400/0xa2426164df2c818b lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783441535.554123:0:5785:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91a85f83c400/0xa2426164df2c818b lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1783441535.554141:0:5785:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 13 00010000:00010000:2.0:1783441535.554314:0:5785:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91a85f83d600/0xa2426164df2c8184 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.13@tcp remote: 0x633a354aa4df4f8f expref: 27 pid: 5785 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783441535.554335:0:5785:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff91a85f83c400/0xa2426164df2c818b lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.13@tcp remote: 0x633a354aa4df4f8f expref: 26 pid: 5785 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783441535.554344:0:5785:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff91a85faee500) 00010000:00010000:2.0:1783441535.554347:0:5785:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:2.0:1783441535.554351:0:5785:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91a85f83c400, rc 0) 00000100:00100000:2.0:1783441535.554435:0:5785:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a87d80ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:65454767-383a-4679-a788-eba05c6e0989+26:11335:x1870073673354496:12345-192.168.201.13@tcp:101:lfs.0 Request processed in 565us (799us total) trans 4294967424 rc 0/0 00000100:00100000:2.0:1783441535.554455:0:5785:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.13@tcp, seq: 147 00000100:00100000:3.0:1783441535.555568:0:11015:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a8749a4700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:65454767-383a-4679-a788-eba05c6e0989+25:2354:x1870073673354624:12345-192.168.201.13@tcp:103:ldlm_bl.0 Request processed in 3443us (3684us total) trans 0 rc 0/0 00000100:00100000:3.0:1783441535.555581:0:11015:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.13@tcp, seq: 9 00000100:00100000:1.0:1783441535.568530:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.13@tcp (source: 12345-192.168.201.13@tcp) 00000100:00100000:3.0:1783441535.568930:0:6581:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073673354752 00000100:00100000:3.0:1783441535.568943:0:6581:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073673354752 00000100:00100000:3.0:1783441535.569035:0:6581:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.13@tcp, seq: 50 00000100:00100000:3.0:1783441535.569048:0:6581:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a87d80ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:65454767-383a-4679-a788-eba05c6e0989+6:2355:x1870073673354752:12345-192.168.201.13@tcp:1:lfs.0 00010000:00010000:3.0:1783441535.569112:0:6581:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000005a18b047/0xa2426164df2c8199 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6581 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783441535.569139:0:6581:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 000000004be678b2/0xa2426164df2c814c lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.201.13@tcp remote: 0x633a354aa4df4f73 expref: 6 pid: 6582 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783441535.569150:0:6581:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1783441535.569155:0:6581:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x4:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1783441535.569160:0:6581:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000005a18b047/0xa2426164df2c8199 lrc: 4/0,1 mode: --/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6581 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783441535.569207:0:6581:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 000000004be678b2/0xa2426164df2c814c lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.201.13@tcp remote: 0x633a354aa4df4f73 expref: 6 pid: 6582 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783441535.569226:0:6581:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 000000004be678b2/0xa2426164df2c814c lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.201.13@tcp remote: 0x633a354aa4df4f73 expref: 6 pid: 6582 timeout: 473 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783441535.569244:0:6581:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff91a745902680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:6581:1870073693286400:192.168.201.13@tcp:104: 00000100:00100000:3.0:1783441535.569371:0:6581:0:(client.c:2702:ptlrpc_set_wait()) set ffff91a8485526c0 going to sleep for 11 seconds 00000100:00100000:1.0:1783441535.573980:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.13@tcp (source: 12345-192.168.201.13@tcp) 00000100:00100000:0.0:1783441535.574109:0:6588:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073673354880 00000100:00100000:0.0:1783441535.574121:0:6588:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073673354880 00002000:00100000:0.0:1783441535.574193:0:6588:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x4:0x0] (0->12) req@ffff91a87d80f480 x1870073673354880/t0(0) o4->65454767-383a-4679-a788-eba05c6e0989@192.168.201.13@tcp:176/0 lens 504/0 e 0 to 0 dl 1783441546 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1783441535.574205:0:6588:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff91a87d80f480 with x1870073673354880 ext(0->12) 00010000:00010000:0.0:1783441535.574216:0:6588:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 000000004be678b2/0xa2426164df2c814c lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.201.13@tcp remote: 0x633a354aa4df4f73 expref: 7 pid: 6582 timeout: 473 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783441535.574236:0:6588:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 000000004be678b2/0xa2426164df2c814c lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.201.13@tcp remote: 0x633a354aa4df4f73 expref: 7 pid: 6582 timeout: 473 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1783441535.574244:0:6588:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff91a87d80f480 00000100:00100000:0.0:1783441535.574288:0:6588:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.13@tcp, seq: 2 00000100:00100000:0.0:1783441535.574309:0:6588:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a87d80f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:65454767-383a-4679-a788-eba05c6e0989+7:2355:x1870073673354880:12345-192.168.201.13@tcp:4:lfs.0 00000100:00100000:0.0:1783441535.575088:0:6588:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a87d80f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:65454767-383a-4679-a788-eba05c6e0989+9:2355:x1870073673354880:12345-192.168.201.13@tcp:4:lfs.0 Request processed in 784us (1126us total) trans 4294967305 rc 0/0 00000100:00100000:0.0:1783441535.575099:0:6588:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.13@tcp, seq: 2 00002000:00100000:0.0:1783441535.575110:0:6588:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x4:0x0] (0->12) req@ffff91a87d80f480 x1870073673354880/t4294967305(0) o4->65454767-383a-4679-a788-eba05c6e0989@192.168.201.13@tcp:176/0 lens 504/448 e 0 to 0 dl 1783441546 ref 1 fl Complete:H/600/0 rc 0/0 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1783441535.575127:0:6588:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff91a87d80f480 with x1870073673354880 ext(0->12) 00010000:00010000:0.0:1783441535.575135:0:6588:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 000000004be678b2/0xa2426164df2c814c lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.201.13@tcp remote: 0x633a354aa4df4f73 expref: 9 pid: 6582 timeout: 473 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783441535.575152:0:6588:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 000000004be678b2/0xa2426164df2c814c lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.201.13@tcp remote: 0x633a354aa4df4f73 expref: 9 pid: 6582 timeout: 473 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1783441535.575160:0:6588:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff91a87d80f480 00000100:00100000:3.0:1783441535.576462:0:6581:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff91a745902680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:6581:1870073693286400:192.168.201.13@tcp:104: 00010000:00010000:3.0:1783441535.576503:0:6581:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 000000005a18b047/0xa2426164df2c8199 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6581 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783441535.580864:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.13@tcp (source: 12345-192.168.201.13@tcp) 00000100:00100000:2.0:1783441535.581081:0:5771:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073673355008 00000100:00100000:2.0:1783441535.581093:0:5771:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073673355008 00010000:00010000:2.0:1783441535.581154:0:5771:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 000000004be678b2/0xa2426164df2c814c lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.201.13@tcp remote: 0x633a354aa4df4f73 expref: 9 pid: 6582 timeout: 473 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783441535.581208:0:5771:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.13@tcp, seq: 64 00000100:00100000:2.0:1783441535.581219:0:5771:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a87d80d180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:65454767-383a-4679-a788-eba05c6e0989+9:2353:x1870073673355008:12345-192.168.201.13@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1783441535.581236:0:5771:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00002000:00010000:2.0:1783441535.581263:0:5771:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0x4:0x0] updating lvb size from disk: 0 -> 13 00002000:00010000:2.0:1783441535.581266:0:5771:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000400:0x4:0x0] updating lvb mtime from disk: 0 -> 1783441536 00002000:00010000:2.0:1783441535.581285:0:5771:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000400:0x4:0x0] updating lvb atime from disk: 0 -> 1783441536 00002000:00010000:2.0:1783441535.581287:0:5771:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000400:0x4:0x0] updating lvb ctime from disk: 0 -> 1783441536 00010000:00010000:2.0:1783441535.581301:0:5771:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 000000004be678b2/0xa2426164df2c814c lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.201.13@tcp remote: 0x633a354aa4df4f73 expref: 9 pid: 6582 timeout: 473 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783441535.581318:0:5771:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 000000004be678b2/0xa2426164df2c814c lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.201.13@tcp remote: 0x633a354aa4df4f73 expref: 9 pid: 6582 timeout: 473 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783441535.581350:0:5771:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000004be678b2/0xa2426164df2c814c lrc: 0/0,0 mode: --/PW res: [0x280000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.201.13@tcp remote: 0x633a354aa4df4f73 expref: 9 pid: 6582 timeout: 473 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783441535.581373:0:5771:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x4:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1783441535.581378:0:5771:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x4:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1783441535.581385:0:5771:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 000000005a18b047/0xa2426164df2c8199 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 6581 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783441535.581396:0:5771:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000005a18b047/0xa2426164df2c8199 lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 6581 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783441535.581434:0:5771:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1783441535.581513:0:5771:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a87d80d180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:65454767-383a-4679-a788-eba05c6e0989+8:2353:x1870073673355008:12345-192.168.201.13@tcp:103:ldlm_bl.0 Request processed in 295us (663us total) trans 0 rc 0/0 00000100:00100000:2.0:1783441535.581521:0:5771:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.13@tcp, seq: 64 00010000:00010000:0.0:1783441535.582335:0:6581:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 000000005a18b047/0xa2426164df2c8199 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6581 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783441535.582353:0:6581:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000005a18b047/0xa2426164df2c8199 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6581 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783441535.582392:0:6581:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000005a18b047/0xa2426164df2c8199 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6581 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783441535.582400:0:6581:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000005a18b047/0xa2426164df2c8199 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6581 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783441535.582408:0:6581:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000005a18b047/0xa2426164df2c8199 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6581 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783441535.582415:0:6581:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91a85eb3d600 already unused, calling callback (ffffffffc155ff90) 00010000:00010000:0.0:1783441535.582420:0:6581:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000005a18b047/0xa2426164df2c8199 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6581 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783441535.582444:0:6581:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000005a18b047/0xa2426164df2c8199 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6581 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783441535.582463:0:6581:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000005a18b047/0xa2426164df2c8199 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6581 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783441535.582471:0:6581:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000005a18b047/0xa2426164df2c8199 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6581 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783441535.582572:0:6581:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a87d80ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:65454767-383a-4679-a788-eba05c6e0989+7:2355:x1870073673354752:12345-192.168.201.13@tcp:1:lfs.0 Request processed in 13523us (14055us total) trans 0 rc 0/0 00000100:00100000:0.0:1783441535.582583:0:6581:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.13@tcp, seq: 50 00000100:00100000:1.0:1783441535.586647:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.13@tcp (source: 12345-192.168.201.13@tcp) 00000100:00100000:0.0:1783441535.586781:0:5789:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073673355264 00000100:00100000:0.0:1783441535.586795:0:5789:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073673355264 00000100:00100000:0.0:1783441535.586865:0:5789:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.13@tcp, seq: 38 00000100:00100000:0.0:1783441535.586876:0:5789:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a8468ab450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:65454767-383a-4679-a788-eba05c6e0989+25:11335:x1870073673355264:12345-192.168.201.13@tcp:35:lfs.0 00000004:00010000:0.0:1783441535.586979:0:5789:0:(mdt_open.c:1998:mdt_hsm_release()) ### [0x200000401:0xb:0x0] lease broken? 0 ns: mdt-lustre-MDT0000_UUID lock: ffff91a85f83c400/0xa2426164df2c818b lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.13@tcp remote: 0x633a354aa4df4f8f expref: 25 pid: 5785 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1783441535.587307:0:5789:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967425 00000001:00080000:0.0:1783441535.587356:0:5789:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967426 00000001:00080000:0.0:1783441535.588034:0:5789:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967427 00010000:00010000:0.0:1783441535.588113:0:5789:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff91a85fe59600/0xa2426164df2c81a0 lrc: 3/0,1 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5789 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783441535.588133:0:5789:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff91a85eb3d200/0xa2426164df2c8137 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.13@tcp remote: 0x633a354aa4df4f65 expref: 29 pid: 5785 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783441535.588151:0:5789:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff91a85fe59600/0xa2426164df2c81a0 lrc: 4/0,1 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5789 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783441535.588198:0:5789:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff91a85eb3d200/0xa2426164df2c8137 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.13@tcp remote: 0x633a354aa4df4f65 expref: 29 pid: 5785 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783441535.588216:0:5789:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff91a85eb3d200/0xa2426164df2c8137 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.13@tcp remote: 0x633a354aa4df4f65 expref: 29 pid: 5785 timeout: 473 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783441535.588235:0:5789:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff91a87d645880 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000_UUID:5789:1870073693286528:192.168.201.13@tcp:104: 00000100:00100000:0.0:1783441535.588341:0:5789:0:(client.c:2702:ptlrpc_set_wait()) set ffff91a846aea3c0 going to sleep for 11 seconds 00000100:00100000:1.0:1783441535.592200:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.13@tcp (source: 12345-192.168.201.13@tcp) 00000100:00100000:3.0:1783441535.592296:0:5770:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073673355392 00000100:00100000:3.0:1783441535.592309:0:5770:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073673355392 00010000:00010000:3.0:1783441535.592362:0:5770:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff91a85eb3d200/0xa2426164df2c8137 lrc: 5/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.13@tcp remote: 0x633a354aa4df4f65 expref: 30 pid: 5785 timeout: 473 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783441535.592412:0:5770:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.13@tcp, seq: 65 00000100:00100000:3.0:1783441535.592424:0:5770:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a87d80c700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:65454767-383a-4679-a788-eba05c6e0989+30:2354:x1870073673355392:12345-192.168.201.13@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1783441535.592443:0:5770:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1783441535.592451:0:5770:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff91a85eb3d200/0xa2426164df2c8137 lrc: 5/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.13@tcp remote: 0x633a354aa4df4f65 expref: 30 pid: 5785 timeout: 473 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783441535.592467:0:5770:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff91a85eb3d200/0xa2426164df2c8137 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.13@tcp remote: 0x633a354aa4df4f65 expref: 30 pid: 5785 timeout: 473 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783441535.592495:0:5770:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff91a85faee500) 00010000:00010000:3.0:1783441535.592500:0:5770:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff91a85fe59600/0xa2426164df2c81a0 lrc: 3/0,1 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5789 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783441535.592512:0:5770:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff91a85fe59600/0xa2426164df2c81a0 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 5789 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783441535.592519:0:5770:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91a85fe59600/0xa2426164df2c81a0 lrc: 4/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 5789 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783441535.592541:0:5770:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1783441535.592651:0:5770:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a87d80c700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:65454767-383a-4679-a788-eba05c6e0989+30:2354:x1870073673355392:12345-192.168.201.13@tcp:103:ldlm_bl.0 Request processed in 228us (466us total) trans 0 rc 0/0 00000100:00100000:3.0:1783441535.592660:0:5770:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.13@tcp, seq: 65 00010000:00010000:0.0:1783441535.592939:0:5789:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91a85eb3d200/0xa2426164df2c8137 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.13@tcp remote: 0x633a354aa4df4f65 expref: 29 pid: 5785 timeout: 473 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783441535.592970:0:5789:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff91a87d645880 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000_UUID:5789:1870073693286528:192.168.201.13@tcp:104: 00010000:00010000:0.0:1783441535.592998:0:5789:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff91a85fe59600/0xa2426164df2c81a0 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5789 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783441535.593008:0:5789:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff91a85fe59600/0xa2426164df2c81a0 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5789 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783441535.593015:0:5789:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91a85fe59600/0xa2426164df2c81a0 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5789 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1783441535.593180:0:5789:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967428 00000001:00080000:0.0:1783441535.593445:0:5789:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967429 00000100:00100000:0.0:1783441535.593918:0:5789:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff91a87d645880 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:5789:1870073693286656:0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:0.0:1783441535.594544:0:5789:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783441535.594829:0:5789:0:(client.c:2702:ptlrpc_set_wait()) set ffff91a843b9e0c0 going to sleep for 11 seconds 00000100:00100000:2.0:1783441535.595628:0:5791:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073693286656 00000100:00100000:2.0:1783441535.595701:0:5791:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073693286656 00000100:00100000:2.0:1783441535.595899:0:5791:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:2.0:1783441535.595910:0:5791:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a87d647100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:5789:x1870073693286656:12345-0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:2.0:1783441535.596099:0:5791:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a87d647100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:5789:x1870073693286656:12345-0@lo:1000:mdt_rdpg00_001.0 Request processed in 191us (1559us total) trans 0 rc 0/0 00000100:00100000:2.0:1783441535.596106:0:5791:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:1.0:1783441535.596292:0:5789:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff91a87d645880 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:5789:1870073693286656:0@lo:1000:mdt_rdpg00_001.0 00000001:00080000:1.0:1783441535.597147:0:5789:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967430 00000100:00100000:1.0:1783441535.597264:0:5789:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff91a867cd6300 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:5789:1870073693286784:0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:1.0:1783441535.597325:0:5789:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783441535.597367:0:5789:0:(client.c:2702:ptlrpc_set_wait()) set ffff91a8486300c0 going to sleep for 11 seconds 00000100:00100000:3.0:1783441535.597478:0:5790:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073693286784 00000100:00100000:3.0:1783441535.597486:0:5790:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073693286784 00000100:00100000:3.0:1783441535.597532:0:5790:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:3.0:1783441535.597543:0:5790:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a867cd4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:5789:x1870073693286784:12345-0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:3.0:1783441535.597815:0:5790:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a867cd4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:5789:x1870073693286784:12345-0@lo:1000:mdt_rdpg00_001.0 Request processed in 273us (489us total) trans 4294967306 rc 0/0 00000100:00100000:3.0:1783441535.597824:0:5790:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:1.0:1783441535.598108:0:5789:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff91a867cd6300 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:5789:1870073693286784:0@lo:1000:mdt_rdpg00_001.0 00000001:00080000:1.0:1783441535.598186:0:5789:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967431 00010000:00010000:1.0:1783441535.598237:0:5789:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff91a85fe59600/0xa2426164df2c81a0 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5789 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783441535.598248:0:5789:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff91a85fe59600/0xa2426164df2c81a0 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5789 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783441535.598256:0:5789:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff91a85fe59600/0xa2426164df2c81a0 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5789 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783441535.598262:0:5789:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91a85fe59600 already unused, calling callback (ffffffffc1f9b4f0) 00010000:00010000:1.0:1783441535.598267:0:5789:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91a85fe59600/0xa2426164df2c81a0 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5789 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783441535.598276:0:5789:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91a85fe59600/0xa2426164df2c81a0 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5789 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783441535.598314:0:5789:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff91a85faee500) 00010000:00010000:1.0:1783441535.598317:0:5789:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 28 00010000:00010000:1.0:1783441535.598323:0:5789:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff91a85fe59600/0xa2426164df2c81a0 lrc: 2/0,0 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5789 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783441535.598329:0:5789:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91a85fe59600/0xa2426164df2c81a0 lrc: 0/0,0 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5789 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:1.0:1783441535.598540:0:5789:0:(mdd_object.c:4010:mdd_close()) Object [0x200000401:0xc:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000040:00080000:1.0:1783441535.598947:0:5789:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].4, 64 off8448 00000004:00080000:1.0:1783441535.599207:0:5789:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 373473464645ns, next at 374473461126ns, rc = 0 00000001:00080000:1.0:1783441535.599218:0:5789:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967432 00010000:00010000:1.0:1783441535.599264:0:5789:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff91a85faee500) 00010000:00010000:1.0:1783441535.599267:0:5789:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:1.0:1783441535.599277:0:5789:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91a85f83c400/0xa2426164df2c818b lrc: 0/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x4/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.13@tcp remote: 0x633a354aa4df4f8f expref: 33 pid: 5785 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783441535.599465:0:5789:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a8468ab450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:65454767-383a-4679-a788-eba05c6e0989+32:11335:x1870073673355264:12345-192.168.201.13@tcp:35:lfs.0 Request processed in 12589us (12844us total) trans 4294967433 rc 0/0 00000100:00100000:1.0:1783441535.599475:0:5789:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.13@tcp, seq: 38 00000020:00080000:1.0:1783441535.599481:0:5789:0:(tgt_main.c:784:tgt_ses_key_exit()) total 9 transactions per RPC 00000100:00080000:0.0:1783441535.599671:0:5781:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1783441535.603690:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.13@tcp (source: 12345-192.168.201.13@tcp) 00000100:00100000:3.0:1783441535.603982:0:5787:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073673355520 00000100:00100000:3.0:1783441535.603996:0:5787:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073673355520 00000100:00100000:3.0:1783441535.604074:0:5787:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.13@tcp, seq: 148 00000100:00100000:3.0:1783441535.604085:0:5787:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a875365180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:65454767-383a-4679-a788-eba05c6e0989+32:11335:x1870073673355520:12345-192.168.201.13@tcp:101:lfs.0 00010000:00010000:3.0:1783441535.604118:0:5787:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1783441535.604150:0:5787:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91a85eb3da00/0xa2426164df2c81a7 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x633a354aa4df4f96 expref: -99 pid: 5787 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783441535.604235:0:5787:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91a85eb3da00/0xa2426164df2c81a7 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.201.13@tcp remote: 0x633a354aa4df4f96 expref: 33 pid: 5787 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783441535.604253:0:5787:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff91a85eb3da00/0xa2426164df2c81a7 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.13@tcp remote: 0x633a354aa4df4f96 expref: 33 pid: 5787 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783441535.604279:0:5787:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff91a85faee000) 00010000:00010000:3.0:1783441535.604282:0:5787:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1783441535.604287:0:5787:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91a85eb3da00, rc 0) 00000100:00100000:3.0:1783441535.604391:0:5787:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a875365180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:65454767-383a-4679-a788-eba05c6e0989+33:11335:x1870073673355520:12345-192.168.201.13@tcp:101:lfs.0 Request processed in 307us (715us total) trans 0 rc 0/0 00000100:00100000:3.0:1783441535.604398:0:5787:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.13@tcp, seq: 148 00000100:00100000:3.0:1783441535.613228:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.13@tcp (source: 12345-192.168.201.13@tcp) 00000100:00100000:2.0:1783441535.613333:0:5788:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073673355776 00000100:00100000:2.0:1783441535.613346:0:5788:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073673355776 00000100:00100000:2.0:1783441535.613418:0:5788:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.13@tcp, seq: 39 00000100:00100000:2.0:1783441535.613429:0:5788:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a745902680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:65454767-383a-4679-a788-eba05c6e0989+33:11335:x1870073673355776:12345-192.168.201.13@tcp:35:lfs.0 00000100:00100000:2.0:1783441535.613842:0:5788:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a745902680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:65454767-383a-4679-a788-eba05c6e0989+34:11335:x1870073673355776:12345-192.168.201.13@tcp:35:lfs.0 Request processed in 413us (626us total) trans 4294967434 rc 0/0 00000100:00100000:2.0:1783441535.613852:0:5788:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.13@tcp, seq: 39 00000100:00100000:1.0:1783441535.706507:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.13@tcp (source: 12345-192.168.201.13@tcp) 00000100:00100000:2.0:1783441535.706787:0:5786:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073673356032 00000100:00100000:2.0:1783441535.706801:0:5786:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073673356032 00000100:00100000:2.0:1783441535.706890:0:5786:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.13@tcp, seq: 149 00000100:00100000:2.0:1783441535.706904:0:5786:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a87da68380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:65454767-383a-4679-a788-eba05c6e0989+34:11345:x1870073673356032:12345-192.168.201.13@tcp:101:lfs.0 00010000:00010000:2.0:1783441535.706940:0:5786:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1783441535.706981:0:5786:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91a85f83d600/0xa2426164df2c81ae lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x633a354aa4df4f9d expref: -99 pid: 5786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1783441535.707191:0:5786:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xa:0x0]: returning size 512 00010000:00010000:2.0:1783441535.707351:0:5786:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff91a85f83d600/0xa2426164df2c81ae lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.13@tcp remote: 0x633a354aa4df4f9d expref: 36 pid: 5786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783441535.707371:0:5786:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff91a8429bd400) 00010000:00010000:2.0:1783441535.707375:0:5786:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1783441535.707380:0:5786:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91a85f83d600/0xa2426164df2c81ae lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.13@tcp remote: 0x633a354aa4df4f9d expref: 36 pid: 5786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783441535.707412:0:5786:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91a85f83d600, rc 0) 00000100:00100000:2.0:1783441535.707502:0:5786:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a87da68380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:65454767-383a-4679-a788-eba05c6e0989+35:11345:x1870073673356032:12345-192.168.201.13@tcp:101:lfs.0 Request processed in 601us (1011us total) trans 4294967435 rc 301/301 00000100:00100000:2.0:1783441535.707511:0:5786:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.13@tcp, seq: 149 00000100:00100000:3.0:1783441535.712684:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.13@tcp (source: 12345-192.168.201.13@tcp) 00000100:00100000:2.0:1783441535.712879:0:5787:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073673356160 00000100:00100000:2.0:1783441535.712893:0:5787:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073673356160 00000100:00100000:2.0:1783441535.712974:0:5787:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.13@tcp, seq: 150 00000100:00100000:2.0:1783441535.712986:0:5787:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a745903b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:65454767-383a-4679-a788-eba05c6e0989+35:11345:x1870073673356160:12345-192.168.201.13@tcp:34:lfs.0 00010000:00010000:2.0:1783441535.713085:0:5787:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff91a85f83da00/0xa2426164df2c81bc lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783441535.713105:0:5787:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91a85f83da00/0xa2426164df2c81bc lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783441535.713118:0:5787:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91a85f83da00/0xa2426164df2c81bc lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783441535.713135:0:5787:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff91a85f83c000/0xa2426164df2c81c3 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783441535.713143:0:5787:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91a85f83c000/0xa2426164df2c81c3 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783441535.713150:0:5787:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91a85f83c000/0xa2426164df2c81c3 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783441535.713277:0:5787:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff91a85f83c400/0xa2426164df2c81ca lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783441535.713309:0:5787:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91a85f83c400/0xa2426164df2c81ca lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783441535.713316:0:5787:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91a85f83c400/0xa2426164df2c81ca lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1783441535.713370:0:5787:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff91a85f83c400/0xa2426164df2c81ca lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783441535.713385:0:5787:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff91a85f83da00/0xa2426164df2c81bc lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783441535.713393:0:5787:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff91a85f83da00/0xa2426164df2c81bc lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783441535.713400:0:5787:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff91a85f83da00/0xa2426164df2c81bc lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783441535.713406:0:5787:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91a85f83da00 already unused, calling callback (ffffffffc1f9b4f0) 00010000:00010000:2.0:1783441535.713412:0:5787:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91a85f83da00/0xa2426164df2c81bc lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783441535.713420:0:5787:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91a85f83da00/0xa2426164df2c81bc lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783441535.713436:0:5787:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff91a8429bdc00) 00010000:00010000:2.0:1783441535.713439:0:5787:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1783441535.713446:0:5787:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff91a85f83da00/0xa2426164df2c81bc lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783441535.713453:0:5787:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91a85f83da00/0xa2426164df2c81bc lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783441535.713476:0:5787:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff91a85f83c000/0xa2426164df2c81c3 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783441535.713483:0:5787:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff91a85f83c000/0xa2426164df2c81c3 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783441535.713490:0:5787:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff91a85f83c000/0xa2426164df2c81c3 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783441535.713496:0:5787:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91a85f83c000 already unused, calling callback (ffffffffc1f9b4f0) 00010000:00010000:2.0:1783441535.713499:0:5787:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91a85f83c000/0xa2426164df2c81c3 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783441535.713507:0:5787:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91a85f83c000/0xa2426164df2c81c3 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783441535.713515:0:5787:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff91a8429bd900) 00010000:00010000:2.0:1783441535.713518:0:5787:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1783441535.713521:0:5787:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff91a85f83c000/0xa2426164df2c81c3 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783441535.713526:0:5787:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91a85f83c000/0xa2426164df2c81c3 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783441535.713542:0:5787:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff91a85f83c400/0xa2426164df2c81ca lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783441535.713549:0:5787:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff91a85f83c400/0xa2426164df2c81ca lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783441535.713556:0:5787:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff91a85f83c400/0xa2426164df2c81ca lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783441535.713566:0:5787:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91a85f83c400 already unused, calling callback (ffffffffc1f9b4f0) 00010000:00010000:2.0:1783441535.713570:0:5787:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91a85f83c400/0xa2426164df2c81ca lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783441535.713577:0:5787:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91a85f83c400/0xa2426164df2c81ca lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783441535.713585:0:5787:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff91a85faee000) 00010000:00010000:2.0:1783441535.713588:0:5787:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1783441535.713591:0:5787:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff91a85f83c400/0xa2426164df2c81ca lrc: 2/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783441535.713598:0:5787:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91a85f83c400/0xa2426164df2c81ca lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783441535.713728:0:5787:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a745903b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:65454767-383a-4679-a788-eba05c6e0989+35:11345:x1870073673356160:12345-192.168.201.13@tcp:34:lfs.0 Request processed in 743us (1058us total) trans 0 rc 0/0 00000100:00100000:2.0:1783441535.713738:0:5787:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.13@tcp, seq: 150 00000100:00100000:1.0:1783441535.718256:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.13@tcp (source: 12345-192.168.201.13@tcp) 00000100:00100000:2.0:1783441535.718349:0:5788:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073673356416 00000100:00100000:2.0:1783441535.718361:0:5788:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073673356416 00000100:00100000:2.0:1783441535.718438:0:5788:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.13@tcp, seq: 40 00000100:00100000:2.0:1783441535.718450:0:5788:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a8749a5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:65454767-383a-4679-a788-eba05c6e0989+35:11345:x1870073673356416:12345-192.168.201.13@tcp:35:lfs.0 00000100:00100000:2.0:1783441535.718896:0:5788:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a8749a5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:65454767-383a-4679-a788-eba05c6e0989+36:11345:x1870073673356416:12345-192.168.201.13@tcp:35:lfs.0 Request processed in 444us (652us total) trans 4294967436 rc 0/0 00000100:00100000:2.0:1783441535.718905:0:5788:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.13@tcp, seq: 40 00000100:00100000:1.0:1783441535.759811:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.13@tcp (source: 12345-192.168.201.13@tcp) 00000100:00100000:2.0:1783441535.759980:0:5786:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073673356672 00000100:00100000:2.0:1783441535.759995:0:5786:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073673356672 00000100:00100000:2.0:1783441535.760072:0:5786:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.13@tcp, seq: 151 00000100:00100000:2.0:1783441535.760101:0:5786:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a87d6a1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:65454767-383a-4679-a788-eba05c6e0989+36:11348:x1870073673356672:12345-192.168.201.13@tcp:101:lfs.0 00010000:00010000:2.0:1783441535.760136:0:5786:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1783441535.760164:0:5786:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91a85f83c400/0xa2426164df2c81d1 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x633a354aa4df4fa4 expref: -99 pid: 5786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783441535.760260:0:5786:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff91a85f83c000/0xa2426164df2c81d8 lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783441535.760275:0:5786:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91a85f83c000/0xa2426164df2c81d8 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783441535.760288:0:5786:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91a85f83c000/0xa2426164df2c81d8 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783441535.760302:0:5786:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff91a85f83da00/0xa2426164df2c81df lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783441535.760309:0:5786:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91a85f83da00/0xa2426164df2c81df lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783441535.760315:0:5786:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91a85f83da00/0xa2426164df2c81df lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783441535.760503:0:5786:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff91a85f83d600/0xa2426164df2c81e6 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783441535.760511:0:5786:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91a85f83d600/0xa2426164df2c81e6 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783441535.760518:0:5786:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91a85f83d600/0xa2426164df2c81e6 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1783441535.760541:0:5786:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 13 00010000:00010000:2.0:1783441535.760843:0:5786:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff91a85f83c000/0xa2426164df2c81d8 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783441535.760852:0:5786:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff91a85f83c000/0xa2426164df2c81d8 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783441535.760858:0:5786:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff91a85f83c000/0xa2426164df2c81d8 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783441535.760864:0:5786:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91a85f83c000 already unused, calling callback (ffffffffc1f9b4f0) 00010000:00010000:2.0:1783441535.760869:0:5786:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91a85f83c000/0xa2426164df2c81d8 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783441535.760876:0:5786:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91a85f83c000/0xa2426164df2c81d8 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783441535.760890:0:5786:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff91a8429bdc00) 00010000:00010000:2.0:1783441535.760893:0:5786:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1783441535.760898:0:5786:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff91a85f83c000/0xa2426164df2c81d8 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783441535.760904:0:5786:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91a85f83c000/0xa2426164df2c81d8 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783441535.760918:0:5786:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff91a85f83da00/0xa2426164df2c81df lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783441535.760923:0:5786:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff91a85f83da00/0xa2426164df2c81df lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783441535.760938:0:5786:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff91a85f83da00/0xa2426164df2c81df lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783441535.760943:0:5786:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91a85f83da00 already unused, calling callback (ffffffffc1f9b4f0) 00010000:00010000:2.0:1783441535.760946:0:5786:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91a85f83da00/0xa2426164df2c81df lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783441535.760952:0:5786:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91a85f83da00/0xa2426164df2c81df lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783441535.760961:0:5786:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff91a8429bd900) 00010000:00010000:2.0:1783441535.760964:0:5786:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1783441535.760967:0:5786:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff91a85f83da00/0xa2426164df2c81df lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783441535.760972:0:5786:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91a85f83da00/0xa2426164df2c81df lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783441535.761025:0:5786:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91a85f83c400/0xa2426164df2c81d1 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.13@tcp remote: 0x633a354aa4df4fa4 expref: 39 pid: 5786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783441535.761039:0:5786:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff91a85f83d600/0xa2426164df2c81e6 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.13@tcp remote: 0x633a354aa4df4fa4 expref: 38 pid: 5786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783441535.761046:0:5786:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff91a85faee000) 00010000:00010000:2.0:1783441535.761048:0:5786:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1783441535.761051:0:5786:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91a85f83d600, rc 0) 00000100:00100000:2.0:1783441535.761135:0:5786:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a87d6a1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:65454767-383a-4679-a788-eba05c6e0989+38:11348:x1870073673356672:12345-192.168.201.13@tcp:101:lfs.0 Request processed in 1035us (1340us total) trans 4294967437 rc 0/0 00000100:00100000:2.0:1783441535.761153:0:5786:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.13@tcp, seq: 151 00000100:00100000:3.0:1783441535.765443:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.13@tcp (source: 12345-192.168.201.13@tcp) 00000100:00100000:2.0:1783441535.765911:0:5787:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073673356800 00000100:00100000:2.0:1783441535.765924:0:5787:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073673356800 00000100:00100000:2.0:1783441535.766004:0:5787:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.13@tcp, seq: 152 00000100:00100000:2.0:1783441535.766017:0:5787:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a745901180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:65454767-383a-4679-a788-eba05c6e0989+38:11348:x1870073673356800:12345-192.168.201.13@tcp:54:lfs.0 00010000:00010000:2.0:1783441535.766151:0:5787:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff91a85eaa1a00/0xa2426164df2c81f4 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783441535.766175:0:5787:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91a85eaa1a00/0xa2426164df2c81f4 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783441535.766190:0:5787:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91a85eaa1a00/0xa2426164df2c81f4 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783441535.766226:0:5787:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff91a85eaa1a00/0xa2426164df2c81f4 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783441535.766234:0:5787:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff91a85eaa1a00/0xa2426164df2c81f4 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783441535.766242:0:5787:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff91a85eaa1a00/0xa2426164df2c81f4 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783441535.766249:0:5787:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91a85eaa1a00 already unused, calling callback (ffffffffc1f9b4f0) 00010000:00010000:2.0:1783441535.766255:0:5787:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91a85eaa1a00/0xa2426164df2c81f4 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783441535.766264:0:5787:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91a85eaa1a00/0xa2426164df2c81f4 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783441535.766280:0:5787:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff91a85faee000) 00010000:00010000:2.0:1783441535.766301:0:5787:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1783441535.766308:0:5787:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff91a85eaa1a00/0xa2426164df2c81f4 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783441535.766315:0:5787:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91a85eaa1a00/0xa2426164df2c81f4 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783441535.766436:0:5787:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a745901180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:65454767-383a-4679-a788-eba05c6e0989+38:11348:x1870073673356800:12345-192.168.201.13@tcp:54:lfs.0 Request processed in 422us (1009us total) trans 0 rc 0/0 00000100:00100000:2.0:1783441535.766445:0:5787:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.13@tcp, seq: 152 00000100:00100000:1.0:1783441535.771616:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.13@tcp (source: 12345-192.168.201.13@tcp) 00000100:00100000:2.0:1783441535.771807:0:5788:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073673357056 00000100:00100000:2.0:1783441535.771821:0:5788:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073673357056 00000100:00100000:2.0:1783441535.771900:0:5788:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.13@tcp, seq: 41 00000100:00100000:2.0:1783441535.771912:0:5788:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a87d6a3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:65454767-383a-4679-a788-eba05c6e0989+38:11348:x1870073673357056:12345-192.168.201.13@tcp:35:lfs.0 00000100:00100000:2.0:1783441535.772577:0:5788:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a87d6a3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:65454767-383a-4679-a788-eba05c6e0989+39:11348:x1870073673357056:12345-192.168.201.13@tcp:35:lfs.0 Request processed in 664us (979us total) trans 4294967438 rc 0/0 00000100:00100000:2.0:1783441535.772588:0:5788:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.13@tcp, seq: 41 00000100:00100000:3.0:1783441536.027604:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.13@tcp (source: 12345-192.168.201.13@tcp) 00000100:00100000:2.0:1783441536.027788:0:5786:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073673357312 00000100:00100000:2.0:1783441536.027802:0:5786:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073673357312 00000100:00100000:2.0:1783441536.027898:0:5786:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.13@tcp, seq: 153 00000100:00100000:2.0:1783441536.027912:0:5786:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a745902d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:65454767-383a-4679-a788-eba05c6e0989+39:11379:x1870073673357312:12345-192.168.201.13@tcp:101:cat.0 00010000:00010000:2.0:1783441536.027951:0:5786:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1783441536.027994:0:5786:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91a85eaa1a00/0xa2426164df2c81fb lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x633a354aa4df4fab expref: -99 pid: 5786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783441536.028134:0:5786:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff91a85eaa1200/0xa2426164df2c8202 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783441536.028152:0:5786:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91a85eaa1200/0xa2426164df2c8202 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783441536.028188:0:5786:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91a85eaa1200/0xa2426164df2c8202 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1783441536.028204:0:5786:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 13 00010000:00010000:2.0:1783441536.028384:0:5786:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91a85eaa1a00/0xa2426164df2c81fb lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.13@tcp remote: 0x633a354aa4df4fab expref: 42 pid: 5786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783441536.028408:0:5786:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff91a85eaa1200/0xa2426164df2c8202 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.13@tcp remote: 0x633a354aa4df4fab expref: 41 pid: 5786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783441536.028419:0:5786:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff91a85faee000) 00010000:00010000:2.0:1783441536.028423:0:5786:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1783441536.028427:0:5786:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91a85eaa1200, rc 0) 00000100:00100000:2.0:1783441536.028513:0:5786:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a745902d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:65454767-383a-4679-a788-eba05c6e0989+41:11379:x1870073673357312:12345-192.168.201.13@tcp:101:cat.0 Request processed in 605us (932us total) trans 4294967439 rc 0/0 00000100:00100000:2.0:1783441536.028521:0:5786:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.13@tcp, seq: 153 00000100:00080000:0.0:1783441536.028679:0:5781:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1783441536.035125:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.13@tcp (source: 12345-192.168.201.13@tcp) 00000100:00100000:3.0:1783441536.035204:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.13@tcp (source: 12345-192.168.201.13@tcp) 00000100:00100000:0.0:1783441536.035312:0:11015:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073673357440 00000100:00100000:0.0:1783441536.035326:0:11015:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073673357440 00000100:00100000:0.0:1783441536.035411:0:11015:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.13@tcp, seq: 10 00000100:00100000:0.0:1783441536.035422:0:11015:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a846f77450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:65454767-383a-4679-a788-eba05c6e0989+41:2354:x1870073673357440:12345-192.168.201.13@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1783441536.035443:0:11015:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1783441536.035478:0:11015:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91a85eaa1200/0xa2426164df2c8202 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.13@tcp remote: 0x633a354aa4df4fab expref: 41 pid: 5786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783441536.035505:0:11015:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff91a85faee000) 00010000:00010000:0.0:1783441536.035511:0:11015:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1783441536.035596:0:11015:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a846f77450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:65454767-383a-4679-a788-eba05c6e0989+40:2354:x1870073673357440:12345-192.168.201.13@tcp:103:ldlm_bl.0 Request processed in 176us (486us total) trans 0 rc 0/0 00000100:00100000:0.0:1783441536.035605:0:11015:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.13@tcp, seq: 10 00000100:00100000:1.0:1783441536.036002:0:5789:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073673357696 00000100:00100000:1.0:1783441536.036008:0:5789:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073673357696 00000100:00100000:1.0:1783441536.036065:0:5789:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.13@tcp, seq: 42 00000100:00100000:1.0:1783441536.036073:0:5789:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a745900a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:65454767-383a-4679-a788-eba05c6e0989+40:11379:x1870073673357696:12345-192.168.201.13@tcp:35:cat.0 00000100:00100000:1.0:1783441536.036365:0:5789:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a745900a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:65454767-383a-4679-a788-eba05c6e0989+41:11379:x1870073673357696:12345-192.168.201.13@tcp:35:cat.0 Request processed in 291us (1158us total) trans 4294967440 rc 0/0 00000100:00100000:1.0:1783441536.036373:0:5789:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.13@tcp, seq: 42 00000100:00100000:1.0:1783441536.094841:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.13@tcp (source: 12345-192.168.201.13@tcp) 00000100:00100000:2.0:1783441536.095034:0:5787:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073673357952 00000100:00100000:2.0:1783441536.095049:0:5787:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073673357952 00000100:00100000:2.0:1783441536.095133:0:5787:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.13@tcp, seq: 154 00000100:00100000:2.0:1783441536.095145:0:5787:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a87d6a2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:65454767-383a-4679-a788-eba05c6e0989+41:11385:x1870073673357952:12345-192.168.201.13@tcp:101:dd.0 00010000:00010000:2.0:1783441536.095178:0:5787:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1783441536.095183:0:5787:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:2.0:1783441536.095217:0:5787:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91a85f83d800/0xa2426164df2c8168 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.13@tcp remote: 0x633a354aa4df4f81 expref: 41 pid: 5786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783441536.095243:0:5787:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff91a8429bdc00) 00010000:00010000:2.0:1783441536.095267:0:5787:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1783441536.095284:0:5787:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91a85eaa1a00/0xa2426164df2c8210 lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x633a354aa4df4fb2 expref: -99 pid: 5787 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783441536.095413:0:5787:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff91a85eaa1400/0xa2426164df2c8217 lrc: 3/0,1 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783441536.095429:0:5787:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff91a85f83d600/0xa2426164df2c81e6 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.13@tcp remote: 0x633a354aa4df4fa4 expref: 41 pid: 5786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783441536.095439:0:5787:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff91a85eaa1400/0xa2426164df2c8217 lrc: 4/0,1 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783441536.095484:0:5787:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff91a85f83d600/0xa2426164df2c81e6 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.13@tcp remote: 0x633a354aa4df4fa4 expref: 41 pid: 5786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783441536.095499:0:5787:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff91a85f83d600/0xa2426164df2c81e6 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.13@tcp remote: 0x633a354aa4df4fa4 expref: 41 pid: 5786 timeout: 473 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783441536.095514:0:5787:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff91a875424700 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5787:1870073693286912:192.168.201.13@tcp:104: 00000100:00100000:2.0:1783441536.096027:0:5787:0:(client.c:2702:ptlrpc_set_wait()) set ffff91a8470669c0 going to sleep for 11 seconds 00000100:00100000:3.0:1783441536.100724:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.13@tcp (source: 12345-192.168.201.13@tcp) 00000100:00100000:0.0:1783441536.100934:0:11514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073673358080 00000100:00100000:0.0:1783441536.100946:0:11514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073673358080 00010000:00010000:0.0:1783441536.101005:0:11514:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff91a85f83d600/0xa2426164df2c81e6 lrc: 5/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.13@tcp remote: 0x633a354aa4df4fa4 expref: 42 pid: 5786 timeout: 473 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783441536.101048:0:11514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.13@tcp, seq: 66 00000100:00100000:0.0:1783441536.101058:0:11514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a745902a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:65454767-383a-4679-a788-eba05c6e0989+42:2355:x1870073673358080:12345-192.168.201.13@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1783441536.101075:0:11514:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1783441536.101082:0:11514:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff91a85f83d600/0xa2426164df2c81e6 lrc: 5/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.13@tcp remote: 0x633a354aa4df4fa4 expref: 42 pid: 5786 timeout: 473 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783441536.101118:0:11514:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff91a85f83d600/0xa2426164df2c81e6 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.13@tcp remote: 0x633a354aa4df4fa4 expref: 42 pid: 5786 timeout: 473 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783441536.101146:0:11514:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff91a85faee000) 00010000:00010000:0.0:1783441536.101152:0:11514:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff91a85eaa1400/0xa2426164df2c8217 lrc: 3/0,1 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783441536.101163:0:11514:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff91a85eaa1400/0xa2426164df2c8217 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783441536.101170:0:11514:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91a85eaa1400/0xa2426164df2c8217 lrc: 4/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783441536.101192:0:11514:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1783441536.101256:0:11514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a745902a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:65454767-383a-4679-a788-eba05c6e0989+42:2355:x1870073673358080:12345-192.168.201.13@tcp:103:ldlm_bl.0 Request processed in 199us (550us total) trans 0 rc 0/0 00000100:00100000:0.0:1783441536.101263:0:11514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.13@tcp, seq: 66 00010000:00010000:2.0:1783441536.102763:0:5787:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91a85f83d600/0xa2426164df2c81e6 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.13@tcp remote: 0x633a354aa4df4fa4 expref: 41 pid: 5786 timeout: 473 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783441536.102794:0:5787:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff91a875424700 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5787:1870073693286912:192.168.201.13@tcp:104: 00010000:00010000:2.0:1783441536.102823:0:5787:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff91a85eaa1400/0xa2426164df2c8217 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783441536.102835:0:5787:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff91a85eaa1400/0xa2426164df2c8217 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783441536.102861:0:5787:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91a85eaa1400/0xa2426164df2c8217 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1783441536.102887:0:5787:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 13 00010000:00010000:2.0:1783441536.103273:0:5787:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91a85eaa1a00/0xa2426164df2c8210 lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.13@tcp remote: 0x633a354aa4df4fb2 expref: 42 pid: 5787 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783441536.103292:0:5787:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff91a85eaa1400/0xa2426164df2c8217 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.13@tcp remote: 0x633a354aa4df4fb2 expref: 41 pid: 5787 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783441536.103302:0:5787:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff91a85faee000) 00010000:00010000:2.0:1783441536.103306:0:5787:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:2.0:1783441536.103309:0:5787:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91a85eaa1400, rc 0) 00000100:00100000:2.0:1783441536.103390:0:5787:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a87d6a2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:65454767-383a-4679-a788-eba05c6e0989+41:11385:x1870073673357952:12345-192.168.201.13@tcp:101:dd.0 Request processed in 8246us (8565us total) trans 4294967441 rc 0/0 00000100:00100000:2.0:1783441536.103399:0:5787:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.13@tcp, seq: 154 00000100:00100000:1.0:1783441536.106937:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.13@tcp (source: 12345-192.168.201.13@tcp) 00000100:00100000:2.0:1783441536.107211:0:5786:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073673358336 00000100:00100000:2.0:1783441536.107226:0:5786:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073673358336 00000100:00100000:2.0:1783441536.107340:0:5786:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.13@tcp, seq: 155 00000100:00100000:2.0:1783441536.107353:0:5786:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a87d6a0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:65454767-383a-4679-a788-eba05c6e0989+41:11385:x1870073673358336:12345-192.168.201.13@tcp:36:dd.0 00010000:00010000:2.0:1783441536.107794:0:5786:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff91a85eaa1c00/0xa2426164df2c8225 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783441536.107815:0:5786:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91a85eaa1c00/0xa2426164df2c8225 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783441536.107829:0:5786:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91a85eaa1c00/0xa2426164df2c8225 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1783441536.107903:0:5786:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967442 00000004:00010000:2.0:1783441536.107927:0:5786:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000a6bf7d42 reply state 000000008664c48a transno 4294967443 ns: mdt-lustre-MDT0000_UUID lock: ffff91a85eaa1c00/0xa2426164df2c8225 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783441536.107937:0:5786:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1783441536.108363:0:5786:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a87d6a0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:65454767-383a-4679-a788-eba05c6e0989+44:11385:x1870073673358336:12345-192.168.201.13@tcp:36:dd.0 Request processed in 1010us (1439us total) trans 4294967443 rc 0/0 00000100:00100000:2.0:1783441536.108373:0:5786:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.13@tcp, seq: 155 00000020:00080000:2.0:1783441536.108380:0:5786:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:3.0:1783441536.112412:0:3289:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff91a85eaa1c00/0xa2426164df2c8225 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783441536.112437:0:3289:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff91a85eaa1c00/0xa2426164df2c8225 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783441536.112446:0:3289:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff91a85eaa1c00/0xa2426164df2c8225 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783441536.112453:0:3289:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91a85eaa1c00 already unused, calling callback (ffffffffc1f9b4f0) 00010000:00010000:3.0:1783441536.112460:0:3289:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91a85eaa1c00/0xa2426164df2c8225 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783441536.112470:0:3289:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91a85eaa1c00/0xa2426164df2c8225 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783441536.112498:0:3289:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff91a85faee000) 00010000:00010000:3.0:1783441536.112502:0:3289:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1783441536.112509:0:3289:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff91a85eaa1c00/0xa2426164df2c8225 lrc: 2/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783441536.112540:0:3289:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91a85eaa1c00/0xa2426164df2c8225 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783441536.173082:0:5772:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1783441536.456890:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.13@tcp (source: 12345-192.168.201.13@tcp) 00000100:00100000:0.0:1783441536.463211:0:6605:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073673358464 00000100:00100000:0.0:1783441536.463235:0:6605:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073673358464 00000100:00100000:0.0:1783441536.463336:0:6605:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.13@tcp, seq: 156 00000100:00100000:0.0:1783441536.463348:0:6605:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a87d6a0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:65454767-383a-4679-a788-eba05c6e0989+43:11399:x1870073673358464:12345-192.168.201.13@tcp:101:stat.0 00010000:00010000:0.0:1783441536.463387:0:6605:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1783441536.463415:0:6605:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91a85fe58000/0xa2426164df2c822c lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x633a354aa4df4fb9 expref: -99 pid: 6605 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783441536.464774:0:6605:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff91a85fe59800/0xa2426164df2c8233 lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6605 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783441536.464818:0:6605:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91a85fe59800/0xa2426164df2c8233 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6605 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783441536.464834:0:6605:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91a85fe59800/0xa2426164df2c8233 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6605 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783441536.464855:0:6605:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff91a85fe59600/0xa2426164df2c823a lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6605 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783441536.464863:0:6605:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91a85fe59600/0xa2426164df2c823a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6605 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783441536.464870:0:6605:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91a85fe59600/0xa2426164df2c823a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6605 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783441536.465010:0:6605:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff91a85fe58600/0xa2426164df2c8241 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6605 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783441536.465026:0:6605:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff91a85eaa1400/0xa2426164df2c8217 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.13@tcp remote: 0x633a354aa4df4fb2 expref: 44 pid: 5787 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783441536.465036:0:6605:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff91a85fe58600/0xa2426164df2c8241 lrc: 4/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6605 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783441536.465082:0:6605:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff91a85eaa1400/0xa2426164df2c8217 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.13@tcp remote: 0x633a354aa4df4fb2 expref: 44 pid: 5787 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783441536.465102:0:6605:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff91a85eaa1400/0xa2426164df2c8217 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.13@tcp remote: 0x633a354aa4df4fb2 expref: 44 pid: 5787 timeout: 474 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783441536.465130:0:6605:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff91a87d645880 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:6605:1870073693287040:192.168.201.13@tcp:104: 00000100:00100000:0.0:1783441536.465278:0:6605:0:(client.c:2702:ptlrpc_set_wait()) set ffff91a85f2e5b40 going to sleep for 11 seconds 00000100:00100000:0.0:1783441536.470155:0:6605:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff91a87d645880 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:6605:1870073693287040:192.168.201.13@tcp:104: 00010000:00010000:0.0:1783441536.470198:0:6605:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff91a85fe58600/0xa2426164df2c8241 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6605 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783441536.471427:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.13@tcp (source: 12345-192.168.201.13@tcp) 00000100:00100000:0.0:1783441536.473306:0:5789:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073673358720 00000100:00100000:0.0:1783441536.473326:0:5789:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073673358720 00000100:00100000:0.0:1783441536.473848:0:5789:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.13@tcp, seq: 43 00000100:00100000:0.0:1783441536.473865:0:5789:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a87d6a1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:65454767-383a-4679-a788-eba05c6e0989+45:5569:x1870073673358720:12345-192.168.201.13@tcp:35:ldlm_bl.0 00000100:00100000:0.0:1783441536.474384:0:5789:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a87d6a1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:65454767-383a-4679-a788-eba05c6e0989+46:5569:x1870073673358720:12345-192.168.201.13@tcp:35:ldlm_bl.0 Request processed in 522us (2967us total) trans 4294967444 rc 0/0 00000100:00100000:0.0:1783441536.474393:0:5789:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.13@tcp, seq: 43 00000100:00100000:1.0:1783441536.481390:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.13@tcp (source: 12345-192.168.201.13@tcp) 00000100:00100000:2.0:1783441536.481894:0:5769:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073673358848 00000100:00100000:2.0:1783441536.481908:0:5769:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073673358848 00010000:00010000:2.0:1783441536.481966:0:5769:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff91a85eaa1400/0xa2426164df2c8217 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.13@tcp remote: 0x633a354aa4df4fb2 expref: 46 pid: 5787 timeout: 474 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783441536.482022:0:5769:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.13@tcp, seq: 67 00000100:00100000:2.0:1783441536.482036:0:5769:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a745904a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:65454767-383a-4679-a788-eba05c6e0989+46:2355:x1870073673358848:12345-192.168.201.13@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1783441536.482055:0:5769:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1783441536.482063:0:5769:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff91a85eaa1400/0xa2426164df2c8217 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.13@tcp remote: 0x633a354aa4df4fb2 expref: 46 pid: 5787 timeout: 474 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783441536.482079:0:5769:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff91a85eaa1400/0xa2426164df2c8217 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.13@tcp remote: 0x633a354aa4df4fb2 expref: 46 pid: 5787 timeout: 474 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783441536.482109:0:5769:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91a85eaa1400/0xa2426164df2c8217 lrc: 0/0,0 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.13@tcp remote: 0x633a354aa4df4fb2 expref: 46 pid: 5787 timeout: 474 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783441536.482132:0:5769:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff91a85faee000) 00010000:00010000:2.0:1783441536.482155:0:5769:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff91a85fe58600/0xa2426164df2c8241 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6605 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783441536.482167:0:5769:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff91a85fe58600/0xa2426164df2c8241 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 6605 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783441536.482175:0:5769:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91a85fe58600/0xa2426164df2c8241 lrc: 4/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 6605 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783441536.482221:0:5769:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1783441536.482297:0:5769:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a745904a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:65454767-383a-4679-a788-eba05c6e0989+45:2355:x1870073673358848:12345-192.168.201.13@tcp:103:ldlm_bl.0 Request processed in 264us (923us total) trans 0 rc 0/0 00000100:00100000:2.0:1783441536.482305:0:5769:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.13@tcp, seq: 67 00010000:00010000:1.0:1783441536.483022:0:6605:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff91a85fe58600/0xa2426164df2c8241 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6605 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783441536.483036:0:6605:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91a85fe58600/0xa2426164df2c8241 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6605 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1783441536.483101:0:6605:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 0 00000004:00200000:1.0:1783441536.483106:0:6605:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:1.0:1783441536.483135:0:6605:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff91a85fe58600/0xa2426164df2c8241 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6605 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783441536.483152:0:6605:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91a85fe58600/0xa2426164df2c8241 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6605 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783441536.483166:0:6605:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff91a85fe59800/0xa2426164df2c8233 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6605 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783441536.483173:0:6605:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff91a85fe59800/0xa2426164df2c8233 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6605 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783441536.483181:0:6605:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff91a85fe59800/0xa2426164df2c8233 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6605 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783441536.483202:0:6605:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91a85fe59800 already unused, calling callback (ffffffffc1f9b4f0) 00010000:00010000:1.0:1783441536.483208:0:6605:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91a85fe59800/0xa2426164df2c8233 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6605 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783441536.483217:0:6605:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91a85fe59800/0xa2426164df2c8233 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6605 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783441536.483233:0:6605:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff91a8429bdc00) 00010000:00010000:1.0:1783441536.483236:0:6605:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1783441536.483240:0:6605:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff91a85fe59800/0xa2426164df2c8233 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6605 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783441536.483247:0:6605:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91a85fe59800/0xa2426164df2c8233 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6605 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783441536.483265:0:6605:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff91a85fe59600/0xa2426164df2c823a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6605 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783441536.483271:0:6605:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff91a85fe59600/0xa2426164df2c823a lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6605 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783441536.483278:0:6605:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff91a85fe59600/0xa2426164df2c823a lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6605 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783441536.483283:0:6605:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91a85fe59600 already unused, calling callback (ffffffffc1f9b4f0) 00010000:00010000:1.0:1783441536.483286:0:6605:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91a85fe59600/0xa2426164df2c823a lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6605 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783441536.483292:0:6605:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91a85fe59600/0xa2426164df2c823a lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6605 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783441536.483311:0:6605:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff91a8439b0200) 00010000:00010000:1.0:1783441536.483313:0:6605:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1783441536.483317:0:6605:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff91a85fe59600/0xa2426164df2c823a lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6605 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783441536.483323:0:6605:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91a85fe59600/0xa2426164df2c823a lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6605 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783441536.483376:0:6605:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91a85fe58000/0xa2426164df2c822c lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.13@tcp remote: 0x633a354aa4df4fb9 expref: 45 pid: 6605 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783441536.483391:0:6605:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff91a85fe58600/0xa2426164df2c8241 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.13@tcp remote: 0x633a354aa4df4fb9 expref: 44 pid: 6605 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783441536.483398:0:6605:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff91a85faee000) 00010000:00010000:1.0:1783441536.483401:0:6605:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1783441536.483403:0:6605:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91a85fe58600, rc 0) 00000100:00100000:1.0:1783441536.483648:0:6605:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a87d6a0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:65454767-383a-4679-a788-eba05c6e0989+44:11399:x1870073673358464:12345-192.168.201.13@tcp:101:stat.0 Request processed in 20301us (26771us total) trans 0 rc 0/0 00000100:00100000:1.0:1783441536.483658:0:6605:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.13@tcp, seq: 156 00000100:00100000:3.0:1783441536.624437:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.13@tcp (source: 12345-192.168.201.13@tcp) 00000100:00100000:2.0:1783441536.625687:0:5785:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073673359104 00000100:00100000:2.0:1783441536.625704:0:5785:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073673359104 00000100:00100000:2.0:1783441536.625863:0:5785:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.13@tcp, seq: 157 00000100:00100000:2.0:1783441536.625876:0:5785:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a745901f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:65454767-383a-4679-a788-eba05c6e0989+44:11405:x1870073673359104:12345-192.168.201.13@tcp:36:truncate.0 00010000:00010000:2.0:1783441536.626103:0:5785:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1783441536.626144:0:5785:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91a85fe58600/0xa2426164df2c8241 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.13@tcp remote: 0x633a354aa4df4fb9 expref: 44 pid: 6605 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783441536.626177:0:5785:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff91a85faee000) 00010000:00010000:2.0:1783441536.626184:0:5785:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1783441536.626478:0:5785:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff91a85eaa1400/0xa2426164df2c8248 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783441536.626495:0:5785:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91a85eaa1400/0xa2426164df2c8248 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783441536.626507:0:5785:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91a85eaa1400/0xa2426164df2c8248 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1783441536.629912:0:5785:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967445 00000004:00010000:2.0:1783441536.629994:0:5785:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000259aa7e0 reply state 000000009cb14112 transno 4294967446 ns: mdt-lustre-MDT0000_UUID lock: ffff91a85eaa1400/0xa2426164df2c8248 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783441536.630010:0:5785:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1783441536.630175:0:5785:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a745901f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:65454767-383a-4679-a788-eba05c6e0989+46:11405:x1870073673359104:12345-192.168.201.13@tcp:36:truncate.0 Request processed in 4296us (5748us total) trans 4294967446 rc 0/0 00000100:00100000:2.0:1783441536.630185:0:5785:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.13@tcp, seq: 157 00000020:00080000:2.0:1783441536.630191:0:5785:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:0.0:1783441536.640001:0:3290:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff91a85eaa1400/0xa2426164df2c8248 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783441536.640023:0:3290:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff91a85eaa1400/0xa2426164df2c8248 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783441536.640031:0:3290:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff91a85eaa1400/0xa2426164df2c8248 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783441536.640038:0:3290:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91a85eaa1400 already unused, calling callback (ffffffffc1f9b4f0) 00010000:00010000:0.0:1783441536.640044:0:3290:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91a85eaa1400/0xa2426164df2c8248 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783441536.640052:0:3290:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91a85eaa1400/0xa2426164df2c8248 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783441536.640092:0:3290:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff91a85faee000) 00010000:00010000:0.0:1783441536.640095:0:3290:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1783441536.640101:0:3290:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff91a85eaa1400/0xa2426164df2c8248 lrc: 2/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783441536.640107:0:3290:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91a85eaa1400/0xa2426164df2c8248 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783441536.885384:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.13@tcp (source: 12345-192.168.201.13@tcp) 00000100:00100000:3.0:1783441536.885431:0:5787:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073673359232 00000100:00100000:3.0:1783441536.885440:0:5787:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073673359232 00000100:00100000:3.0:1783441536.885511:0:5787:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.13@tcp, seq: 158 00000100:00100000:3.0:1783441536.885521:0:5787:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a745900700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:65454767-383a-4679-a788-eba05c6e0989+45:11419:x1870073673359232:12345-192.168.201.13@tcp:101:stat.0 00010000:00010000:3.0:1783441536.885553:0:5787:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1783441536.885575:0:5787:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91a85eb3d200/0xa2426164df2c824f lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x633a354aa4df4fc0 expref: -99 pid: 5787 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783441536.885653:0:5787:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff91a85eb3d600/0xa2426164df2c8256 lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783441536.885668:0:5787:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91a85eb3d600/0xa2426164df2c8256 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783441536.885680:0:5787:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91a85eb3d600/0xa2426164df2c8256 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783441536.885709:0:5787:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff91a85eb3ce00/0xa2426164df2c825d lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783441536.885718:0:5787:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91a85eb3ce00/0xa2426164df2c825d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783441536.885728:0:5787:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91a85eb3ce00/0xa2426164df2c825d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783441536.892031:0:5787:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff91a85eaa1800/0xa2426164df2c8264 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783441536.892055:0:5787:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91a85eaa1800/0xa2426164df2c8264 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783441536.892067:0:5787:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91a85eaa1800/0xa2426164df2c8264 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1783441536.892122:0:5787:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 1234567 00000004:00200000:2.0:1783441536.892126:0:5787:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1783441536.892153:0:5787:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff91a85eaa1800/0xa2426164df2c8264 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783441536.892163:0:5787:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91a85eaa1800/0xa2426164df2c8264 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783441536.892171:0:5787:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff91a85eb3d600/0xa2426164df2c8256 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783441536.892175:0:5787:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff91a85eb3d600/0xa2426164df2c8256 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783441536.892200:0:5787:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff91a85eb3d600/0xa2426164df2c8256 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783441536.892204:0:5787:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91a85eb3d600 already unused, calling callback (ffffffffc1f9b4f0) 00010000:00010000:2.0:1783441536.892208:0:5787:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91a85eb3d600/0xa2426164df2c8256 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783441536.892213:0:5787:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91a85eb3d600/0xa2426164df2c8256 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783441536.892226:0:5787:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff91a8429bdc00) 00010000:00010000:2.0:1783441536.892229:0:5787:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1783441536.892232:0:5787:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff91a85eb3d600/0xa2426164df2c8256 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783441536.892236:0:5787:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91a85eb3d600/0xa2426164df2c8256 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783441536.892249:0:5787:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff91a85eb3ce00/0xa2426164df2c825d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783441536.892252:0:5787:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff91a85eb3ce00/0xa2426164df2c825d lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783441536.892255:0:5787:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff91a85eb3ce00/0xa2426164df2c825d lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783441536.892259:0:5787:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91a85eb3ce00 already unused, calling callback (ffffffffc1f9b4f0) 00010000:00010000:2.0:1783441536.892261:0:5787:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91a85eb3ce00/0xa2426164df2c825d lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783441536.892272:0:5787:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91a85eb3ce00/0xa2426164df2c825d lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783441536.892277:0:5787:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff91a85faee800) 00010000:00010000:2.0:1783441536.892279:0:5787:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1783441536.892280:0:5787:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff91a85eb3ce00/0xa2426164df2c825d lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783441536.892283:0:5787:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91a85eb3ce00/0xa2426164df2c825d lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783441536.892413:0:5787:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91a85eb3d200/0xa2426164df2c824f lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.13@tcp remote: 0x633a354aa4df4fc0 expref: 47 pid: 5787 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783441536.892425:0:5787:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff91a85eaa1800/0xa2426164df2c8264 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.13@tcp remote: 0x633a354aa4df4fc0 expref: 46 pid: 5787 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783441536.892430:0:5787:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff91a85faee000) 00010000:00010000:2.0:1783441536.892431:0:5787:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1783441536.892432:0:5787:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91a85eaa1800, rc 0) 00000100:00100000:2.0:1783441536.892765:0:5787:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a745900700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:65454767-383a-4679-a788-eba05c6e0989+46:11419:x1870073673359232:12345-192.168.201.13@tcp:101:stat.0 Request processed in 7218us (7363us total) trans 0 rc 0/0 00000100:00100000:2.0:1783441536.892776:0:5787:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.13@tcp, seq: 158 00000100:00100000:2.0:1783441536.989992:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.13@tcp (source: 12345-192.168.201.13@tcp) 00000100:00100000:3.0:1783441536.990885:0:5785:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073673359488 00000100:00100000:3.0:1783441536.990897:0:5785:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073673359488 00000100:00100000:3.0:1783441536.990974:0:5785:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.13@tcp, seq: 159 00000100:00100000:3.0:1783441536.990984:0:5785:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a875424700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:65454767-383a-4679-a788-eba05c6e0989+46:11429:x1870073673359488:12345-192.168.201.13@tcp:101:lfs.0 00010000:00010000:3.0:1783441536.991015:0:5785:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1783441536.991037:0:5785:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91a85eb3d000/0xa2426164df2c826b lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x633a354aa4df4fc7 expref: -99 pid: 5785 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1783441536.991153:0:5785:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xa:0x0]: returning size 512 00010000:00010000:3.0:1783441536.991269:0:5785:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff91a85eb3d000/0xa2426164df2c826b lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.13@tcp remote: 0x633a354aa4df4fc7 expref: 48 pid: 5785 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783441536.991284:0:5785:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff91a8429bd400) 00010000:00010000:3.0:1783441536.991287:0:5785:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1783441536.991292:0:5785:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91a85eb3d000/0xa2426164df2c826b lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.13@tcp remote: 0x633a354aa4df4fc7 expref: 48 pid: 5785 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783441536.991305:0:5785:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91a85eb3d000, rc 0) 00000100:00100000:3.0:1783441536.991365:0:5785:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a875424700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:65454767-383a-4679-a788-eba05c6e0989+47:11429:x1870073673359488:12345-192.168.201.13@tcp:101:lfs.0 Request processed in 382us (1384us total) trans 4294967447 rc 301/301 00000100:00100000:3.0:1783441536.991372:0:5785:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.13@tcp, seq: 159 00000100:00100000:0.0:1783441536.997113:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.13@tcp (source: 12345-192.168.201.13@tcp) 00000100:00100000:2.0:1783441537.002321:0:5788:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073673359744 00000100:00100000:2.0:1783441537.002336:0:5788:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073673359744 00000100:00100000:2.0:1783441537.002412:0:5788:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.13@tcp, seq: 44 00000100:00100000:2.0:1783441537.002422:0:5788:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a8468a9c50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:65454767-383a-4679-a788-eba05c6e0989+47:11429:x1870073673359744:12345-192.168.201.13@tcp:35:lfs.0 00000100:00100000:2.0:1783441537.002779:0:5788:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a8468a9c50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:65454767-383a-4679-a788-eba05c6e0989+48:11429:x1870073673359744:12345-192.168.201.13@tcp:35:lfs.0 Request processed in 358us (5678us total) trans 4294967448 rc 0/0 00000100:00100000:2.0:1783441537.002788:0:5788:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.13@tcp, seq: 44 00000001:00080000:3.0:1783441537.014060:0:7492:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967305 is committed 00000001:00080000:3.0:1783441537.014108:0:7492:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967306 is committed 00000100:00100000:2.0:1783441537.060136:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.13@tcp (source: 12345-192.168.201.13@tcp) 00000100:00100000:0.0:1783441537.060274:0:6605:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073673360000 00000100:00100000:0.0:1783441537.060287:0:6605:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073673360000 00000100:00100000:0.0:1783441537.060371:0:6605:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.13@tcp, seq: 160 00000100:00100000:0.0:1783441537.060383:0:6605:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a87d6a3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:65454767-383a-4679-a788-eba05c6e0989+48:11435:x1870073673360000:12345-192.168.201.13@tcp:101:bash.0 00010000:00010000:0.0:1783441537.060421:0:6605:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1783441537.060461:0:6605:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91a85fe59c00/0xa2426164df2c8279 lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x633a354aa4df4fce expref: -99 pid: 6605 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783441537.061938:0:6605:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff91a85eaa1a00/0xa2426164df2c8280 lrc: 3/0,1 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6605 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783441537.062028:0:6605:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff91a85eaa1800/0xa2426164df2c8264 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.13@tcp remote: 0x633a354aa4df4fc0 expref: 49 pid: 5787 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783441537.062039:0:6605:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff91a85eaa1a00/0xa2426164df2c8280 lrc: 4/0,1 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6605 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783441537.062094:0:6605:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff91a85eaa1800/0xa2426164df2c8264 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.13@tcp remote: 0x633a354aa4df4fc0 expref: 49 pid: 5787 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783441537.062114:0:6605:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff91a85eaa1800/0xa2426164df2c8264 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.13@tcp remote: 0x633a354aa4df4fc0 expref: 49 pid: 5787 timeout: 474 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783441537.062131:0:6605:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff91a87d6a1180 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:6605:1870073693287168:192.168.201.13@tcp:104: 00000100:00100000:2.0:1783441537.062340:0:6605:0:(client.c:2702:ptlrpc_set_wait()) set ffff91a8470669c0 going to sleep for 11 seconds 00000100:00100000:2.0:1783441537.080054:0:6605:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff91a87d6a1180 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:6605:1870073693287168:192.168.201.13@tcp:104: 00010000:00010000:2.0:1783441537.080101:0:6605:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff91a85eaa1a00/0xa2426164df2c8280 lrc: 3/0,1 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6605 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783441537.081404:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.13@tcp (source: 12345-192.168.201.13@tcp) 00000100:00100000:0.0:1783441537.081584:0:5771:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073673360128 00000100:00100000:0.0:1783441537.081611:0:5771:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073673360128 00010000:00010000:1.0:1783441537.083352:0:5771:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff91a85eaa1800/0xa2426164df2c8264 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.13@tcp remote: 0x633a354aa4df4fc0 expref: 50 pid: 5787 timeout: 474 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783441537.083481:0:5771:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.13@tcp, seq: 68 00000100:00100000:1.0:1783441537.083494:0:5771:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a87d6a1180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:65454767-383a-4679-a788-eba05c6e0989+50:2355:x1870073673360128:12345-192.168.201.13@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1783441537.083517:0:5771:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1783441537.083555:0:5771:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff91a85eaa1800/0xa2426164df2c8264 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.13@tcp remote: 0x633a354aa4df4fc0 expref: 50 pid: 5787 timeout: 474 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783441537.083572:0:5771:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff91a85eaa1800/0xa2426164df2c8264 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.13@tcp remote: 0x633a354aa4df4fc0 expref: 50 pid: 5787 timeout: 474 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783441537.083625:0:5771:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91a85eaa1800/0xa2426164df2c8264 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.13@tcp remote: 0x633a354aa4df4fc0 expref: 50 pid: 5787 timeout: 474 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783441537.083648:0:5771:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff91a85faee000) 00010000:00010000:1.0:1783441537.083654:0:5771:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff91a85eaa1a00/0xa2426164df2c8280 lrc: 3/0,1 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6605 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783441537.083665:0:5771:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff91a85eaa1a00/0xa2426164df2c8280 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 6605 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783441537.083674:0:5771:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91a85eaa1a00/0xa2426164df2c8280 lrc: 4/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 6605 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783441537.083713:0:5771:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1783441537.084047:0:5771:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a87d6a1180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:65454767-383a-4679-a788-eba05c6e0989+49:2355:x1870073673360128:12345-192.168.201.13@tcp:103:ldlm_bl.0 Request processed in 554us (2650us total) trans 0 rc 0/0 00000100:00100000:1.0:1783441537.084055:0:5771:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.13@tcp, seq: 68 00010000:00010000:2.0:1783441537.084415:0:6605:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff91a85eaa1a00/0xa2426164df2c8280 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6605 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783441537.084438:0:6605:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91a85eaa1a00/0xa2426164df2c8280 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6605 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1783441537.084466:0:6605:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 1234567 00010000:00010000:2.0:1783441537.084710:0:6605:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91a85fe59c00/0xa2426164df2c8279 lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.13@tcp remote: 0x633a354aa4df4fce expref: 50 pid: 6605 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783441537.084729:0:6605:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff91a85eaa1a00/0xa2426164df2c8280 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.13@tcp remote: 0x633a354aa4df4fce expref: 49 pid: 6605 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783441537.084736:0:6605:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff91a85faee000) 00010000:00010000:2.0:1783441537.084758:0:6605:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:2.0:1783441537.084760:0:6605:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91a85eaa1a00, rc 0) 00000100:00100000:2.0:1783441537.084791:0:6605:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a87d6a3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:65454767-383a-4679-a788-eba05c6e0989+49:11435:x1870073673360000:12345-192.168.201.13@tcp:101:bash.0 Request processed in 24412us (24672us total) trans 4294967449 rc 0/0 00000100:00100000:2.0:1783441537.084798:0:6605:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.13@tcp, seq: 160 00000100:00100000:3.0:1783441537.091212:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.13@tcp (source: 12345-192.168.201.13@tcp) 00000100:00100000:2.0:1783441537.091343:0:5785:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073673360384 00000100:00100000:2.0:1783441537.091357:0:5785:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073673360384 00000100:00100000:2.0:1783441537.091471:0:5785:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.13@tcp, seq: 161 00000100:00100000:2.0:1783441537.091482:0:5785:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a745901c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:65454767-383a-4679-a788-eba05c6e0989+49:11435:x1870073673360384:12345-192.168.201.13@tcp:36:bash.0 00010000:00010000:2.0:1783441537.091920:0:5785:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff91a85eaa1c00/0xa2426164df2c828e lrc: 3/0,1 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783441537.091942:0:5785:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91a85eaa1c00/0xa2426164df2c828e lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783441537.091956:0:5785:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91a85eaa1c00/0xa2426164df2c828e lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1783441537.092035:0:5785:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967450 00000004:00010000:2.0:1783441537.092061:0:5785:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 000000004941f2ea reply state 00000000b58577d0 transno 4294967451 ns: mdt-lustre-MDT0000_UUID lock: ffff91a85eaa1c00/0xa2426164df2c828e lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783441537.092072:0:5785:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1783441537.092191:0:5785:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a745901c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:65454767-383a-4679-a788-eba05c6e0989+52:11435:x1870073673360384:12345-192.168.201.13@tcp:36:bash.0 Request processed in 708us (993us total) trans 4294967451 rc 0/0 00000100:00100000:2.0:1783441537.092199:0:5785:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.13@tcp, seq: 161 00000020:00080000:2.0:1783441537.092205:0:5785:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:3.0:1783441537.094161:0:3289:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff91a85eaa1c00/0xa2426164df2c828e lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783441537.094210:0:3289:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff91a85eaa1c00/0xa2426164df2c828e lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783441537.094218:0:3289:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff91a85eaa1c00/0xa2426164df2c828e lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783441537.094226:0:3289:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91a85eaa1c00 already unused, calling callback (ffffffffc1f9b4f0) 00010000:00010000:3.0:1783441537.094233:0:3289:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91a85eaa1c00/0xa2426164df2c828e lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783441537.094241:0:3289:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91a85eaa1c00/0xa2426164df2c828e lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783441537.094264:0:3289:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff91a85faee000) 00010000:00010000:3.0:1783441537.094267:0:3289:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1783441537.094272:0:3289:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff91a85eaa1c00/0xa2426164df2c828e lrc: 2/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783441537.094278:0:3289:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91a85eaa1c00/0xa2426164df2c828e lrc: 0/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783441537.101106:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.13@tcp (source: 12345-192.168.201.13@tcp) 00000100:00100000:2.0:1783441537.101362:0:5787:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073673360512 00000100:00100000:2.0:1783441537.101376:0:5787:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073673360512 00000100:00100000:2.0:1783441537.101459:0:5787:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.13@tcp, seq: 162 00000100:00100000:2.0:1783441537.101470:0:5787:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a745902680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:65454767-383a-4679-a788-eba05c6e0989+51:11435:x1870073673360512:12345-192.168.201.13@tcp:101:bash.0 00010000:00010000:2.0:1783441537.101503:0:5787:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1783441537.101926:0:5787:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91a85eaa1200/0xa2426164df2c8295 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x633a354aa4df4fd5 expref: -99 pid: 5787 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783441537.102077:0:5787:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff91a85eaa1c00/0xa2426164df2c829c lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783441537.102094:0:5787:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff91a85eaa1a00/0xa2426164df2c8280 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.13@tcp remote: 0x633a354aa4df4fce expref: 52 pid: 6605 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783441537.102104:0:5787:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff91a85eaa1c00/0xa2426164df2c829c lrc: 4/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x8 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783441537.102157:0:5787:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff91a85eaa1a00/0xa2426164df2c8280 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.13@tcp remote: 0x633a354aa4df4fce expref: 52 pid: 6605 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783441537.102188:0:5787:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff91a85eaa1a00/0xa2426164df2c8280 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.13@tcp remote: 0x633a354aa4df4fce expref: 52 pid: 6605 timeout: 474 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783441537.102207:0:5787:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff91a8756a4000 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5787:1870073693287296:192.168.201.13@tcp:104: 00000100:00100000:2.0:1783441537.102333:0:5787:0:(client.c:2702:ptlrpc_set_wait()) set ffff91a847066180 going to sleep for 11 seconds 00000100:00100000:2.0:1783441537.108218:0:5787:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff91a8756a4000 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5787:1870073693287296:192.168.201.13@tcp:104: 00010000:00010000:2.0:1783441537.108262:0:5787:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff91a85eaa1c00/0xa2426164df2c829c lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x8 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783441537.108397:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.13@tcp (source: 12345-192.168.201.13@tcp) 00000100:00100000:3.0:1783441537.115641:0:5770:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073673360640 00000100:00100000:3.0:1783441537.115664:0:5770:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073673360640 00010000:00010000:3.0:1783441537.115734:0:5770:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff91a85eaa1a00/0xa2426164df2c8280 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.13@tcp remote: 0x633a354aa4df4fce expref: 53 pid: 6605 timeout: 474 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783441537.115885:0:5769:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.13@tcp, seq: 69 00000100:00100000:2.0:1783441537.115900:0:5769:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a87d645880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:65454767-383a-4679-a788-eba05c6e0989+53:2355:x1870073673360640:12345-192.168.201.13@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1783441537.115922:0:5769:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1783441537.115930:0:5769:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff91a85eaa1a00/0xa2426164df2c8280 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.13@tcp remote: 0x633a354aa4df4fce expref: 53 pid: 6605 timeout: 474 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783441537.115946:0:5769:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff91a85eaa1a00/0xa2426164df2c8280 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.13@tcp remote: 0x633a354aa4df4fce expref: 53 pid: 6605 timeout: 474 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783441537.115974:0:5769:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91a85eaa1a00/0xa2426164df2c8280 lrc: 0/0,0 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.13@tcp remote: 0x633a354aa4df4fce expref: 53 pid: 6605 timeout: 474 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783441537.115998:0:5769:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff91a85faee000) 00010000:00010000:2.0:1783441537.116004:0:5769:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff91a85eaa1c00/0xa2426164df2c829c lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x8 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783441537.116037:0:5769:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff91a85eaa1c00/0xa2426164df2c829c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783441537.116045:0:5769:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91a85eaa1c00/0xa2426164df2c829c lrc: 4/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783441537.116139:0:5769:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1783441537.116221:0:5769:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a87d645880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:65454767-383a-4679-a788-eba05c6e0989+52:2355:x1870073673360640:12345-192.168.201.13@tcp:103:ldlm_bl.0 Request processed in 324us (7825us total) trans 0 rc 0/0 00000100:00100000:2.0:1783441537.116229:0:5769:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.13@tcp, seq: 69 00010000:00010000:3.0:1783441537.117460:0:5787:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff91a85eaa1c00/0xa2426164df2c829c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783441537.117478:0:5787:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91a85eaa1c00/0xa2426164df2c829c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1783441537.117658:0:5787:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 0 00000004:00200000:2.0:1783441537.117665:0:5787:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1783441537.117694:0:5787:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff91a85eaa1c00/0xa2426164df2c829c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783441537.117767:0:5787:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91a85eaa1200/0xa2426164df2c8295 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.13@tcp remote: 0x633a354aa4df4fd5 expref: 52 pid: 5787 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783441537.117789:0:5787:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff91a85eaa1c00/0xa2426164df2c829c lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.13@tcp remote: 0x633a354aa4df4fd5 expref: 51 pid: 5787 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783441537.117799:0:5787:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff91a85faee000) 00010000:00010000:2.0:1783441537.117802:0:5787:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1783441537.117805:0:5787:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91a85eaa1c00, rc 0) 00000100:00100000:2.0:1783441537.117915:0:5787:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a745902680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:65454767-383a-4679-a788-eba05c6e0989+51:11435:x1870073673360512:12345-192.168.201.13@tcp:101:bash.0 Request processed in 16447us (16827us total) trans 0 rc 0/0 00000100:00100000:2.0:1783441537.117923:0:5787:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.13@tcp, seq: 162 00000100:00100000:0.0:1783441537.125731:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.13@tcp (source: 12345-192.168.201.13@tcp) 00000100:00100000:2.0:1783441537.125822:0:5788:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073673360896 00000100:00100000:2.0:1783441537.125852:0:5788:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073673360896 00000100:00100000:2.0:1783441537.125915:0:5788:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.13@tcp, seq: 45 00000100:00100000:2.0:1783441537.125923:0:5788:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a87d644380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:65454767-383a-4679-a788-eba05c6e0989+51:11435:x1870073673360896:12345-192.168.201.13@tcp:35:bash.0 00000100:00100000:2.0:1783441537.126204:0:5788:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a87d644380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:65454767-383a-4679-a788-eba05c6e0989+52:11435:x1870073673360896:12345-192.168.201.13@tcp:35:bash.0 Request processed in 281us (484us total) trans 4294967452 rc 0/0 00000100:00100000:2.0:1783441537.126211:0:5788:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.13@tcp, seq: 45 00010000:00010000:1.0:1783441537.197160:0:5773:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1783441537.211491:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.13@tcp (source: 12345-192.168.201.13@tcp) 00000100:00100000:1.0:1783441537.211726:0:5786:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073673361152 00000100:00100000:1.0:1783441537.211787:0:5786:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073673361152 00000100:00100000:1.0:1783441537.211870:0:5786:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.13@tcp, seq: 163 00000100:00100000:1.0:1783441537.211883:0:5786:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a8756a4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:65454767-383a-4679-a788-eba05c6e0989+52:11445:x1870073673361152:12345-192.168.201.13@tcp:101:lfs.0 00010000:00010000:1.0:1783441537.211917:0:5786:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1783441537.213144:0:5786:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91a87da47c00/0xa2426164df2c82a3 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x633a354aa4df4fdc expref: -99 pid: 5786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1783441537.213774:0:5786:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xa:0x0]: returning size 512 00010000:00010000:1.0:1783441537.214094:0:5786:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff91a87da47c00/0xa2426164df2c82a3 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.13@tcp remote: 0x633a354aa4df4fdc expref: 54 pid: 5786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783441537.214114:0:5786:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff91a8429bd400) 00010000:00010000:1.0:1783441537.214117:0:5786:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1783441537.214124:0:5786:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91a87da47c00/0xa2426164df2c82a3 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.13@tcp remote: 0x633a354aa4df4fdc expref: 54 pid: 5786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783441537.214146:0:5786:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91a87da47c00, rc 0) 00000100:00100000:1.0:1783441537.214326:0:5786:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a8756a4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:65454767-383a-4679-a788-eba05c6e0989+53:11445:x1870073673361152:12345-192.168.201.13@tcp:101:lfs.0 Request processed in 2445us (2852us total) trans 4294967453 rc 301/301 00000100:00100000:1.0:1783441537.214338:0:5786:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.13@tcp, seq: 163 00000100:00100000:1.0:1783441537.219453:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.13@tcp (source: 12345-192.168.201.13@tcp) 00000100:00100000:2.0:1783441537.219699:0:6605:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073673361280 00000100:00100000:2.0:1783441537.219714:0:6605:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073673361280 00000100:00100000:2.0:1783441537.220085:0:6605:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.13@tcp, seq: 164 00000100:00100000:2.0:1783441537.220099:0:6605:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a745904700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:65454767-383a-4679-a788-eba05c6e0989+53:11445:x1870073673361280:12345-192.168.201.13@tcp:34:lfs.0 00010000:00010000:2.0:1783441537.220202:0:6605:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff91a85eaa1200/0xa2426164df2c82b1 lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6605 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783441537.220221:0:6605:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91a85eaa1200/0xa2426164df2c82b1 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6605 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783441537.220234:0:6605:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91a85eaa1200/0xa2426164df2c82b1 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6605 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783441537.220250:0:6605:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff91a85eaa1a00/0xa2426164df2c82b8 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6605 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783441537.220257:0:6605:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91a85eaa1a00/0xa2426164df2c82b8 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6605 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783441537.220263:0:6605:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91a85eaa1a00/0xa2426164df2c82b8 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6605 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783441537.220403:0:6605:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff91a85eaa0200/0xa2426164df2c82bf lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6605 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783441537.220434:0:6605:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91a85eaa0200/0xa2426164df2c82bf lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6605 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783441537.220441:0:6605:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91a85eaa0200/0xa2426164df2c82bf lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6605 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1783441537.220498:0:6605:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff91a85eaa0200/0xa2426164df2c82bf lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6605 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783441537.220513:0:6605:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff91a85eaa1200/0xa2426164df2c82b1 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6605 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783441537.220530:0:6605:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff91a85eaa1200/0xa2426164df2c82b1 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6605 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783441537.220537:0:6605:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff91a85eaa1200/0xa2426164df2c82b1 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6605 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783441537.220544:0:6605:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91a85eaa1200 already unused, calling callback (ffffffffc1f9b4f0) 00010000:00010000:2.0:1783441537.220549:0:6605:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91a85eaa1200/0xa2426164df2c82b1 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6605 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783441537.220557:0:6605:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91a85eaa1200/0xa2426164df2c82b1 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6605 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783441537.220573:0:6605:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff91a8429bdc00) 00010000:00010000:2.0:1783441537.220577:0:6605:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1783441537.220582:0:6605:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff91a85eaa1200/0xa2426164df2c82b1 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6605 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783441537.220588:0:6605:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91a85eaa1200/0xa2426164df2c82b1 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6605 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783441537.220630:0:6605:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff91a85eaa1a00/0xa2426164df2c82b8 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6605 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783441537.220636:0:6605:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff91a85eaa1a00/0xa2426164df2c82b8 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6605 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783441537.220642:0:6605:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff91a85eaa1a00/0xa2426164df2c82b8 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6605 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783441537.220648:0:6605:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91a85eaa1a00 already unused, calling callback (ffffffffc1f9b4f0) 00010000:00010000:2.0:1783441537.220651:0:6605:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91a85eaa1a00/0xa2426164df2c82b8 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6605 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783441537.220658:0:6605:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91a85eaa1a00/0xa2426164df2c82b8 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6605 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783441537.220667:0:6605:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff91a8429bd900) 00010000:00010000:2.0:1783441537.220669:0:6605:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1783441537.220672:0:6605:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff91a85eaa1a00/0xa2426164df2c82b8 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6605 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783441537.220678:0:6605:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91a85eaa1a00/0xa2426164df2c82b8 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6605 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783441537.220695:0:6605:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff91a85eaa0200/0xa2426164df2c82bf lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6605 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783441537.220702:0:6605:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff91a85eaa0200/0xa2426164df2c82bf lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6605 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783441537.220708:0:6605:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff91a85eaa0200/0xa2426164df2c82bf lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6605 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783441537.220719:0:6605:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91a85eaa0200 already unused, calling callback (ffffffffc1f9b4f0) 00010000:00010000:2.0:1783441537.220722:0:6605:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91a85eaa0200/0xa2426164df2c82bf lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6605 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783441537.220729:0:6605:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91a85eaa0200/0xa2426164df2c82bf lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6605 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783441537.220738:0:6605:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff91a85faee000) 00010000:00010000:2.0:1783441537.221078:0:6605:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1783441537.221083:0:6605:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff91a85eaa0200/0xa2426164df2c82bf lrc: 2/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6605 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783441537.221090:0:6605:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91a85eaa0200/0xa2426164df2c82bf lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6605 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783441537.221199:0:6605:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a745904700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:65454767-383a-4679-a788-eba05c6e0989+53:11445:x1870073673361280:12345-192.168.201.13@tcp:34:lfs.0 Request processed in 1099us (1761us total) trans 0 rc 0/0 00000100:00100000:2.0:1783441537.221210:0:6605:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.13@tcp, seq: 164 00000100:00100000:1.0:1783441537.224011:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.13@tcp (source: 12345-192.168.201.13@tcp) 00000100:00100000:3.0:1783441537.224513:0:5788:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073673361536 00000100:00100000:3.0:1783441537.224537:0:5788:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073673361536 00000100:00100000:3.0:1783441537.224628:0:5788:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.13@tcp, seq: 46 00000100:00100000:3.0:1783441537.224641:0:5788:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a745904000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:65454767-383a-4679-a788-eba05c6e0989+53:11445:x1870073673361536:12345-192.168.201.13@tcp:35:lfs.0 00000100:00100000:3.0:1783441537.225226:0:5788:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a745904000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:65454767-383a-4679-a788-eba05c6e0989+54:11445:x1870073673361536:12345-192.168.201.13@tcp:35:lfs.0 Request processed in 585us (1224us total) trans 4294967454 rc 0/0 00000100:00100000:3.0:1783441537.225237:0:5788:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.13@tcp, seq: 46 00000100:00100000:3.0:1783441537.262820:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.13@tcp (source: 12345-192.168.201.13@tcp) 00000100:00100000:2.0:1783441537.262943:0:5785:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073673361792 00000100:00100000:2.0:1783441537.262968:0:5785:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073673361792 00000100:00100000:2.0:1783441537.263047:0:5785:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.13@tcp, seq: 165 00000100:00100000:2.0:1783441537.263058:0:5785:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a745900a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:65454767-383a-4679-a788-eba05c6e0989+54:11448:x1870073673361792:12345-192.168.201.13@tcp:101:lfs.0 00010000:00010000:2.0:1783441537.263090:0:5785:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1783441537.263117:0:5785:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91a85eaa0200/0xa2426164df2c82c6 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x633a354aa4df4fe3 expref: -99 pid: 5785 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783441537.263213:0:5785:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff91a85eaa1a00/0xa2426164df2c82cd lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783441537.263253:0:5785:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91a85eaa1a00/0xa2426164df2c82cd lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783441537.263266:0:5785:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91a85eaa1a00/0xa2426164df2c82cd lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783441537.263285:0:5785:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff91a85eaa1200/0xa2426164df2c82d4 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783441537.263293:0:5785:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91a85eaa1200/0xa2426164df2c82d4 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783441537.263300:0:5785:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91a85eaa1200/0xa2426164df2c82d4 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783441537.263472:0:5785:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff91a85eaa1400/0xa2426164df2c82db lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783441537.263481:0:5785:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91a85eaa1400/0xa2426164df2c82db lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783441537.263489:0:5785:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91a85eaa1400/0xa2426164df2c82db lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1783441537.263500:0:5785:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 0 00010000:00010000:2.0:1783441537.263635:0:5785:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff91a85eaa1a00/0xa2426164df2c82cd lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783441537.263643:0:5785:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff91a85eaa1a00/0xa2426164df2c82cd lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783441537.263650:0:5785:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff91a85eaa1a00/0xa2426164df2c82cd lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783441537.263664:0:5785:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91a85eaa1a00 already unused, calling callback (ffffffffc1f9b4f0) 00010000:00010000:2.0:1783441537.263670:0:5785:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91a85eaa1a00/0xa2426164df2c82cd lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783441537.263678:0:5785:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91a85eaa1a00/0xa2426164df2c82cd lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783441537.263693:0:5785:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff91a8429bdc00) 00010000:00010000:2.0:1783441537.263697:0:5785:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1783441537.263702:0:5785:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff91a85eaa1a00/0xa2426164df2c82cd lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783441537.263709:0:5785:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91a85eaa1a00/0xa2426164df2c82cd lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783441537.263727:0:5785:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff91a85eaa1200/0xa2426164df2c82d4 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783441537.263733:0:5785:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff91a85eaa1200/0xa2426164df2c82d4 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783441537.263806:0:5785:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff91a85eaa1200/0xa2426164df2c82d4 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783441537.263813:0:5785:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91a85eaa1200 already unused, calling callback (ffffffffc1f9b4f0) 00010000:00010000:2.0:1783441537.263816:0:5785:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91a85eaa1200/0xa2426164df2c82d4 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783441537.263823:0:5785:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91a85eaa1200/0xa2426164df2c82d4 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783441537.263843:0:5785:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff91a8429bd900) 00010000:00010000:2.0:1783441537.263846:0:5785:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1783441537.263849:0:5785:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff91a85eaa1200/0xa2426164df2c82d4 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783441537.263856:0:5785:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91a85eaa1200/0xa2426164df2c82d4 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783441537.263908:0:5785:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91a85eaa0200/0xa2426164df2c82c6 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.13@tcp remote: 0x633a354aa4df4fe3 expref: 57 pid: 5785 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783441537.263925:0:5785:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff91a85eaa1400/0xa2426164df2c82db lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.13@tcp remote: 0x633a354aa4df4fe3 expref: 56 pid: 5785 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783441537.263933:0:5785:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff91a85faee000) 00010000:00010000:2.0:1783441537.263936:0:5785:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1783441537.263939:0:5785:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91a85eaa1400, rc 0) 00000100:00100000:2.0:1783441537.264015:0:5785:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a745900a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:65454767-383a-4679-a788-eba05c6e0989+56:11448:x1870073673361792:12345-192.168.201.13@tcp:101:lfs.0 Request processed in 958us (1211us total) trans 4294967455 rc 0/0 00000100:00100000:2.0:1783441537.264024:0:5785:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.13@tcp, seq: 165 00000100:00100000:1.0:1783441537.268310:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.13@tcp (source: 12345-192.168.201.13@tcp) 00000100:00100000:0.0:1783441537.269212:0:5787:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073673361920 00000100:00100000:0.0:1783441537.269228:0:5787:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073673361920 00000100:00100000:0.0:1783441537.269371:0:5787:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.13@tcp, seq: 166 00000100:00100000:0.0:1783441537.269383:0:5787:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a745905500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:65454767-383a-4679-a788-eba05c6e0989+56:11448:x1870073673361920:12345-192.168.201.13@tcp:54:lfs.0 00010000:00010000:0.0:1783441537.269474:0:5787:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff91a85fe59000/0xa2426164df2c82e9 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783441537.269514:0:5787:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91a85fe59000/0xa2426164df2c82e9 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783441537.269538:0:5787:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91a85fe59000/0xa2426164df2c82e9 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783441537.269575:0:5787:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff91a85fe59000/0xa2426164df2c82e9 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783441537.269582:0:5787:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff91a85fe59000/0xa2426164df2c82e9 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783441537.269603:0:5787:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff91a85fe59000/0xa2426164df2c82e9 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783441537.269616:0:5787:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91a85fe59000 already unused, calling callback (ffffffffc1f9b4f0) 00010000:00010000:0.0:1783441537.269622:0:5787:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91a85fe59000/0xa2426164df2c82e9 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783441537.269631:0:5787:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91a85fe59000/0xa2426164df2c82e9 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783441537.269646:0:5787:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff91a85faee000) 00010000:00010000:0.0:1783441537.269649:0:5787:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1783441537.269654:0:5787:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff91a85fe59000/0xa2426164df2c82e9 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783441537.269661:0:5787:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91a85fe59000/0xa2426164df2c82e9 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783441537.269779:0:5787:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a745905500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:65454767-383a-4679-a788-eba05c6e0989+56:11448:x1870073673361920:12345-192.168.201.13@tcp:54:lfs.0 Request processed in 398us (1482us total) trans 0 rc 0/0 00000100:00100000:0.0:1783441537.269793:0:5787:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.13@tcp, seq: 166 00000100:00100000:0.0:1783441537.273280:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.13@tcp (source: 12345-192.168.201.13@tcp) 00000100:00100000:1.0:1783441537.273377:0:11015:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073673362048 00000100:00100000:1.0:1783441537.273390:0:11015:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073673362048 00000100:00100000:1.0:1783441537.273475:0:11015:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.13@tcp, seq: 11 00000100:00100000:1.0:1783441537.273488:0:11015:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a877fadc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:65454767-383a-4679-a788-eba05c6e0989+56:2354:x1870073673362048:12345-192.168.201.13@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1783441537.273509:0:11015:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1783441537.273553:0:11015:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91a85eaa1400/0xa2426164df2c82db lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.13@tcp remote: 0x633a354aa4df4fe3 expref: 56 pid: 5785 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783441537.273578:0:11015:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff91a85faee000) 00010000:00010000:1.0:1783441537.273854:0:11015:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1783441537.273922:0:11015:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a877fadc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:65454767-383a-4679-a788-eba05c6e0989+55:2354:x1870073673362048:12345-192.168.201.13@tcp:103:ldlm_bl.0 Request processed in 436us (656us total) trans 0 rc 0/0 00000100:00100000:1.0:1783441537.273931:0:11015:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.13@tcp, seq: 11 00000100:00100000:3.0:1783441537.277283:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.13@tcp (source: 12345-192.168.201.13@tcp) 00000100:00100000:2.0:1783441537.277381:0:5788:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073673362304 00000100:00100000:2.0:1783441537.277395:0:5788:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073673362304 00000100:00100000:2.0:1783441537.277463:0:5788:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.13@tcp, seq: 47 00000100:00100000:2.0:1783441537.277476:0:5788:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a745903800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:65454767-383a-4679-a788-eba05c6e0989+55:11448:x1870073673362304:12345-192.168.201.13@tcp:35:lfs.0 00000100:00100000:2.0:1783441537.277860:0:5788:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a745903800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:65454767-383a-4679-a788-eba05c6e0989+56:11448:x1870073673362304:12345-192.168.201.13@tcp:35:lfs.0 Request processed in 385us (590us total) trans 4294967456 rc 0/0 00000100:00100000:2.0:1783441537.277869:0:5788:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.13@tcp, seq: 47 00000100:00100000:3.0:1783441537.422184:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.13@tcp (source: 12345-192.168.201.13@tcp) 00000100:00100000:2.0:1783441537.422374:0:5785:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073673362560 00000100:00100000:2.0:1783441537.422388:0:5785:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073673362560 00000100:00100000:2.0:1783441537.422468:0:5785:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.13@tcp, seq: 167 00000100:00100000:2.0:1783441537.422480:0:5785:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a745900380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:65454767-383a-4679-a788-eba05c6e0989+56:11466:x1870073673362560:12345-192.168.201.13@tcp:101:cat.0 00010000:00010000:2.0:1783441537.422529:0:5785:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1783441537.422560:0:5785:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91a85eaa0200/0xa2426164df2c82f0 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x633a354aa4df4fea expref: -99 pid: 5785 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783441537.422712:0:5785:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff91a85eaa1200/0xa2426164df2c82f7 lrc: 3/1,0 mode: --/CR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783441537.422729:0:5785:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91a85eaa1200/0xa2426164df2c82f7 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xb:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783441537.422779:0:5785:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91a85eaa1200/0xa2426164df2c82f7 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xb:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1783441537.422794:0:5785:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 0 00010000:00010000:2.0:1783441537.422967:0:5785:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91a85eaa0200/0xa2426164df2c82f0 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.13@tcp remote: 0x633a354aa4df4fea expref: 59 pid: 5785 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783441537.422993:0:5785:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff91a85eaa1200/0xa2426164df2c82f7 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xb:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.13@tcp remote: 0x633a354aa4df4fea expref: 58 pid: 5785 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783441537.423002:0:5785:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff91a85faee000) 00010000:00010000:2.0:1783441537.423006:0:5785:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint d 00010000:00010000:2.0:1783441537.423009:0:5785:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91a85eaa1200, rc 0) 00000100:00100000:2.0:1783441537.423090:0:5785:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a745900380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:65454767-383a-4679-a788-eba05c6e0989+58:11466:x1870073673362560:12345-192.168.201.13@tcp:101:cat.0 Request processed in 611us (921us total) trans 4294967457 rc 0/0 00000100:00100000:2.0:1783441537.423121:0:5785:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.13@tcp, seq: 167 00000100:00100000:0.0:1783441537.449737:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.13@tcp (source: 12345-192.168.201.13@tcp) 00000100:00100000:2.0:1783441537.449968:0:6605:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073673362688 00000100:00100000:2.0:1783441537.449982:0:6605:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073673362688 00000100:00100000:2.0:1783441537.450060:0:6605:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.13@tcp, seq: 168 00000100:00100000:2.0:1783441537.450072:0:6605:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a8749a5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:65454767-383a-4679-a788-eba05c6e0989+58:11467:x1870073673362688:12345-192.168.201.13@tcp:101:lfs.0 00010000:00010000:2.0:1783441537.450107:0:6605:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1783441537.450136:0:6605:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91a85eaa0200/0xa2426164df2c8305 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x633a354aa4df4ff1 expref: -99 pid: 6605 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783441537.450226:0:6605:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff91a85eaa1a00/0xa2426164df2c830c lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6605 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783441537.450242:0:6605:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91a85eaa1a00/0xa2426164df2c830c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6605 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783441537.450254:0:6605:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91a85eaa1a00/0xa2426164df2c830c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6605 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1783441537.450340:0:6605:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xa:0x0]: returning size 512 00000004:00200000:2.0:1783441537.450345:0:6605:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 1 stripe count 1 MDT count 1 00000004:00010000:2.0:1783441537.450374:0:6605:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff91a85eaa1a00/0xa2426164df2c830c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6605 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783441537.450406:0:6605:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91a85eaa0200/0xa2426164df2c8305 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.13@tcp remote: 0x633a354aa4df4ff1 expref: 60 pid: 6605 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783441537.450429:0:6605:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff91a85eaa1a00/0xa2426164df2c830c lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.13@tcp remote: 0x633a354aa4df4ff1 expref: 59 pid: 6605 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783441537.450462:0:6605:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff91a8429bdc00) 00010000:00010000:2.0:1783441537.450465:0:6605:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1783441537.450469:0:6605:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91a85eaa1a00, rc 0) 00000100:00100000:2.0:1783441537.450557:0:6605:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a8749a5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:65454767-383a-4679-a788-eba05c6e0989+59:11467:x1870073673362688:12345-192.168.201.13@tcp:101:lfs.0 Request processed in 486us (835us total) trans 0 rc 0/0 00000100:00100000:2.0:1783441537.450565:0:6605:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.13@tcp, seq: 168 00000100:00100000:3.0:1783441537.457262:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.13@tcp (source: 12345-192.168.201.13@tcp) 00000100:00100000:2.0:1783441537.457378:0:5788:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073673363072 00000100:00100000:2.0:1783441537.457391:0:5788:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073673363072 00000100:00100000:2.0:1783441537.457470:0:5788:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.13@tcp, seq: 48 00000100:00100000:2.0:1783441537.457482:0:5788:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a745900000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:65454767-383a-4679-a788-eba05c6e0989+59:11467:x1870073673363072:12345-192.168.201.13@tcp:35:lfs.0 00000100:00100000:2.0:1783441537.457980:0:5788:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a745900000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:65454767-383a-4679-a788-eba05c6e0989+60:11467:x1870073673363072:12345-192.168.201.13@tcp:35:lfs.0 Request processed in 498us (732us total) trans 4294967458 rc 0/0 00000100:00100000:2.0:1783441537.457990:0:5788:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.13@tcp, seq: 48 00000100:00100000:3.0:1783441537.461192:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.13@tcp (source: 12345-192.168.201.13@tcp) 00000100:00100000:1.0:1783441537.461337:0:5771:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073673363200 00000100:00100000:1.0:1783441537.461350:0:5771:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073673363200 00000100:00100000:1.0:1783441537.461435:0:5771:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.13@tcp, seq: 12 00000100:00100000:1.0:1783441537.461447:0:5771:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a87d87d500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:65454767-383a-4679-a788-eba05c6e0989+60:11467:x1870073673363200:12345-192.168.201.13@tcp:103:lfs.0 00010000:00010000:1.0:1783441537.461468:0:5771:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 3 locks, starting at 0 00010000:00010000:1.0:1783441537.461501:0:5771:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91a85eaa1c00/0xa2426164df2c829c lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.13@tcp remote: 0x633a354aa4df4fd5 expref: 60 pid: 5787 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783441537.461541:0:5771:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91a85eaa1200/0xa2426164df2c82f7 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xb:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.13@tcp remote: 0x633a354aa4df4fea expref: 59 pid: 5785 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783441537.461557:0:5771:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91a85eb3da00/0xa2426164df2c81a7 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.13@tcp remote: 0x633a354aa4df4f96 expref: 58 pid: 5787 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783441537.461569:0:5771:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff91a85faee000) 00010000:00010000:1.0:1783441537.461584:0:5771:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1783441537.461669:0:5771:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a87d87d500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:65454767-383a-4679-a788-eba05c6e0989+57:11467:x1870073673363200:12345-192.168.201.13@tcp:103:lfs.0 Request processed in 224us (493us total) trans 0 rc 0/0 00000100:00100000:1.0:1783441537.461677:0:5771:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.13@tcp, seq: 12 00000100:00100000:0.0:1783441537.464612:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.13@tcp (source: 12345-192.168.201.13@tcp) 00000100:00100000:2.0:1783441537.464794:0:5785:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073673363328 00000100:00100000:2.0:1783441537.464808:0:5785:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073673363328 00000100:00100000:2.0:1783441537.464883:0:5785:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.13@tcp, seq: 169 00000100:00100000:2.0:1783441537.464895:0:5785:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a8749a4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:65454767-383a-4679-a788-eba05c6e0989+57:11467:x1870073673363328:12345-192.168.201.13@tcp:58:lfs.0 00010000:00010000:2.0:1783441537.465156:0:5785:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff91a85eaa0200/0xa2426164df2c8313 lrc: 3/0,1 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783441537.465177:0:5785:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91a85eaa0200/0xa2426164df2c8313 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783441537.465190:0:5785:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91a85eaa0200/0xa2426164df2c8313 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1783441537.465486:0:5785:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].4, 136 off8736 00000100:00100000:2.0:1783441537.465734:0:5785:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a8749a4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:65454767-383a-4679-a788-eba05c6e0989+57:11467:x1870073673363328:12345-192.168.201.13@tcp:58:lfs.0 Request processed in 839us (1147us total) trans 0 rc 0/0 00000100:00100000:2.0:1783441537.470371:0:5785:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.13@tcp, seq: 169 00000100:00100000:0.0:1783441537.497632:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.13@tcp (source: 12345-192.168.201.13@tcp) 00000100:00100000:2.0:1783441537.497787:0:6605:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073673363456 00000100:00100000:2.0:1783441537.497801:0:6605:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073673363456 00000100:00100000:2.0:1783441537.497873:0:6605:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.13@tcp, seq: 170 00000100:00100000:2.0:1783441537.497885:0:6605:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a87d80d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:65454767-383a-4679-a788-eba05c6e0989+57:11469:x1870073673363456:12345-192.168.201.13@tcp:101:lfs.0 00010000:00010000:2.0:1783441537.497916:0:6605:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1783441537.497948:0:6605:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91a85eaa1200/0xa2426164df2c831a lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x633a354aa4df4ff8 expref: -99 pid: 6605 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783441537.498053:0:6605:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff91a85eaa1c00/0xa2426164df2c8321 lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6605 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783441537.498071:0:6605:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91a85eaa1c00/0xa2426164df2c8321 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6605 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783441537.498085:0:6605:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91a85eaa1c00/0xa2426164df2c8321 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6605 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783441537.498103:0:6605:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff91a85eaa1400/0xa2426164df2c8328 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6605 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783441537.498112:0:6605:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91a85eaa1400/0xa2426164df2c8328 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6605 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783441537.498119:0:6605:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91a85eaa1400/0xa2426164df2c8328 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6605 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783441537.498268:0:6605:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff91a85eaa1800/0xa2426164df2c832f lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6605 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783441537.498278:0:6605:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91a85eaa1800/0xa2426164df2c832f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x53/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6605 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783441537.498283:0:6605:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91a85eaa1800/0xa2426164df2c832f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x53/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6605 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1783441537.498330:0:6605:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 0 00000004:00200000:2.0:1783441537.498335:0:6605:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1783441537.498358:0:6605:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff91a85eaa1800/0xa2426164df2c832f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x53/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6605 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783441537.498371:0:6605:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91a85eaa1800/0xa2426164df2c832f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6605 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783441537.498380:0:6605:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff91a85eaa1c00/0xa2426164df2c8321 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6605 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783441537.498387:0:6605:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff91a85eaa1c00/0xa2426164df2c8321 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6605 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783441537.498394:0:6605:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff91a85eaa1c00/0xa2426164df2c8321 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6605 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783441537.498400:0:6605:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91a85eaa1c00 already unused, calling callback (ffffffffc1f9b4f0) 00010000:00010000:2.0:1783441537.498405:0:6605:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91a85eaa1c00/0xa2426164df2c8321 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6605 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783441537.498413:0:6605:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91a85eaa1c00/0xa2426164df2c8321 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6605 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783441537.498436:0:6605:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff91a8429bdc00) 00010000:00010000:2.0:1783441537.498439:0:6605:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1783441537.498444:0:6605:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff91a85eaa1c00/0xa2426164df2c8321 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6605 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783441537.498452:0:6605:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91a85eaa1c00/0xa2426164df2c8321 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6605 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783441537.498469:0:6605:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff91a85eaa1400/0xa2426164df2c8328 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6605 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783441537.498476:0:6605:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff91a85eaa1400/0xa2426164df2c8328 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6605 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783441537.498482:0:6605:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff91a85eaa1400/0xa2426164df2c8328 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6605 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783441537.498488:0:6605:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91a85eaa1400 already unused, calling callback (ffffffffc1f9b4f0) 00010000:00010000:2.0:1783441537.498491:0:6605:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91a85eaa1400/0xa2426164df2c8328 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6605 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783441537.498497:0:6605:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91a85eaa1400/0xa2426164df2c8328 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6605 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783441537.498505:0:6605:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff91a8429bd200) 00010000:00010000:2.0:1783441537.498508:0:6605:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1783441537.498511:0:6605:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff91a85eaa1400/0xa2426164df2c8328 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6605 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783441537.498518:0:6605:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91a85eaa1400/0xa2426164df2c8328 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6605 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783441537.498568:0:6605:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91a85eaa1200/0xa2426164df2c831a lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.13@tcp remote: 0x633a354aa4df4ff8 expref: 59 pid: 6605 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783441537.498584:0:6605:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff91a85eaa1800/0xa2426164df2c832f lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.13@tcp remote: 0x633a354aa4df4ff8 expref: 58 pid: 6605 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783441537.498605:0:6605:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff91a8429bd900) 00010000:00010000:2.0:1783441537.498607:0:6605:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1783441537.498609:0:6605:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91a85eaa1800, rc 0) 00000100:00100000:2.0:1783441537.498705:0:6605:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a87d80d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:65454767-383a-4679-a788-eba05c6e0989+58:11469:x1870073673363456:12345-192.168.201.13@tcp:101:lfs.0 Request processed in 822us (1097us total) trans 0 rc 0/0 00000100:00100000:2.0:1783441537.498713:0:6605:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.13@tcp, seq: 170 00000040:00080000:2.0:1783441537.773042:0:11531:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:2.0:1783441537.773057:0:11531:0:(llog_cat.c:841:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1783441537.773137:0:11531:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 5 count 2 00000040:00080000:2.0:1783441537.773145:0:11531:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:2.0:1783441537.773326:0:11531:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff91a8756a5500 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:11531:1870073693287424:192.168.201.13@tcp:107:hsm_cdtr.0 00000100:00100000:2.0:1783441537.773456:0:11531:0:(client.c:2702:ptlrpc_set_wait()) set ffff91a847066e40 going to sleep for 11 seconds 00000100:00100000:2.0:1783441537.786001:0:11531:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff91a8756a5500 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:11531:1870073693287424:192.168.201.13@tcp:107:hsm_cdtr.0 00000100:00100000:1.0:1783441537.802729:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.13@tcp (source: 12345-192.168.201.13@tcp) 00000100:00100000:2.0:1783441537.802949:0:5786:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073673363584 00000100:00100000:2.0:1783441537.802975:0:5786:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073673363584 00000100:00100000:2.0:1783441537.803065:0:5786:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.13@tcp, seq: 171 00000100:00100000:2.0:1783441537.803078:0:5786:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a745904380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:65454767-383a-4679-a788-eba05c6e0989+58:11480:x1870073673363584:12345-192.168.201.13@tcp:53:lhsmtool_posix.0 00000004:00000080:2.0:1783441537.803137:0:5786:0:(mdt_handler.c:7960:mdt_fid2path()) path get [0x200000401:0xb:0x0] from 18446744073709551615 #0 00000100:00100000:2.0:1783441537.803308:0:5786:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a745904380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:65454767-383a-4679-a788-eba05c6e0989+58:11480:x1870073673363584:12345-192.168.201.13@tcp:53:lhsmtool_posix.0 Request processed in 231us (593us total) trans 0 rc 0/0 00000100:00100000:2.0:1783441537.803334:0:5786:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.13@tcp, seq: 171 00000100:00100000:3.0:1783441537.807549:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.13@tcp (source: 12345-192.168.201.13@tcp) 00000100:00100000:2.0:1783441537.807803:0:6605:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073673363712 00000100:00100000:2.0:1783441537.807816:0:6605:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073673363712 00000100:00100000:2.0:1783441537.807885:0:6605:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.13@tcp, seq: 172 00000100:00100000:2.0:1783441537.807896:0:6605:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a87d87ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:65454767-383a-4679-a788-eba05c6e0989+58:11480:x1870073673363712:12345-192.168.201.13@tcp:34:lhsmtool_posix.0 00010000:00010000:2.0:1783441537.808005:0:6605:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff91a85eaa1200/0xa2426164df2c8336 lrc: 3/1,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6605 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783441537.808028:0:6605:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91a85eaa1200/0xa2426164df2c8336 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6605 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783441537.808044:0:6605:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91a85eaa1200/0xa2426164df2c8336 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6605 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783441537.808897:0:6605:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff91a85eaa1400/0xa2426164df2c833d lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x19697575 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6605 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783441537.808925:0:6605:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91a85eaa1400/0xa2426164df2c833d lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x19697575 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6605 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783441537.808939:0:6605:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91a85eaa1400/0xa2426164df2c833d lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x19697575 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6605 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783441537.808977:0:6605:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff91a85eaa1c00/0xa2426164df2c8344 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6605 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783441537.808986:0:6605:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91a85eaa1c00/0xa2426164df2c8344 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6605 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783441537.808994:0:6605:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91a85eaa1c00/0xa2426164df2c8344 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6605 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1783441537.809070:0:6605:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 0 00000004:00200000:2.0:1783441537.811218:0:6605:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1783441537.811254:0:6605:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff91a85eaa1c00/0xa2426164df2c8344 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6605 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783441537.811276:0:6605:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff91a85eaa1200/0xa2426164df2c8336 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6605 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783441537.811283:0:6605:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff91a85eaa1200/0xa2426164df2c8336 lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6605 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783441537.811290:0:6605:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff91a85eaa1200/0xa2426164df2c8336 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6605 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783441537.811296:0:6605:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91a85eaa1200 already unused, calling callback (ffffffffc1f9b4f0) 00010000:00010000:2.0:1783441537.811300:0:6605:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91a85eaa1200/0xa2426164df2c8336 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6605 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783441537.811309:0:6605:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91a85eaa1200/0xa2426164df2c8336 lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6605 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783441537.811327:0:6605:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff91a858b90e00) 00010000:00010000:2.0:1783441537.811331:0:6605:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1783441537.811335:0:6605:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff91a85eaa1200/0xa2426164df2c8336 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6605 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783441537.811342:0:6605:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91a85eaa1200/0xa2426164df2c8336 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6605 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783441537.811360:0:6605:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff91a85eaa1400/0xa2426164df2c833d lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x19697575 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6605 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783441537.811388:0:6605:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff91a85eaa1400/0xa2426164df2c833d lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x19697575 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6605 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783441537.811394:0:6605:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff91a85eaa1400/0xa2426164df2c833d lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x19697575 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6605 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783441537.811399:0:6605:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91a85eaa1400 already unused, calling callback (ffffffffc1f9b4f0) 00010000:00010000:2.0:1783441537.811402:0:6605:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91a85eaa1400/0xa2426164df2c833d lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x19697575 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6605 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783441537.811409:0:6605:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91a85eaa1400/0xa2426164df2c833d lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x19697575 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6605 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783441537.811418:0:6605:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x19697575 (ffff91a8429bd200) 00010000:00010000:2.0:1783441537.811420:0:6605:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1783441537.811423:0:6605:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff91a85eaa1400/0xa2426164df2c833d lrc: 2/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x19697575 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6605 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783441537.811429:0:6605:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91a85eaa1400/0xa2426164df2c833d lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x19697575 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6605 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783441537.811448:0:6605:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff91a85eaa1c00/0xa2426164df2c8344 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6605 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783441537.811454:0:6605:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff91a85eaa1c00/0xa2426164df2c8344 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6605 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783441537.811460:0:6605:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff91a85eaa1c00/0xa2426164df2c8344 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6605 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783441537.811465:0:6605:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91a85eaa1c00 already unused, calling callback (ffffffffc1f9b4f0) 00010000:00010000:2.0:1783441537.811473:0:6605:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91a85eaa1c00/0xa2426164df2c8344 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6605 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783441537.811479:0:6605:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91a85eaa1c00/0xa2426164df2c8344 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6605 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783441537.811501:0:6605:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff91a8429bd900) 00010000:00010000:2.0:1783441537.811503:0:6605:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1783441537.811506:0:6605:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff91a85eaa1c00/0xa2426164df2c8344 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6605 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783441537.811511:0:6605:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91a85eaa1c00/0xa2426164df2c8344 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6605 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783441537.811627:0:6605:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a87d87ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:65454767-383a-4679-a788-eba05c6e0989+58:11480:x1870073673363712:12345-192.168.201.13@tcp:34:lhsmtool_posix.0 Request processed in 3727us (4098us total) trans 0 rc 0/0 00000100:00100000:2.0:1783441537.811638:0:6605:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.13@tcp, seq: 172 00000100:00100000:2.0:1783441537.818305:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.13@tcp (source: 12345-192.168.201.13@tcp) 00000100:00100000:0.0:1783441537.818426:0:5786:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073673363968 00000100:00100000:0.0:1783441537.818439:0:5786:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073673363968 00000100:00100000:0.0:1783441537.818579:0:5786:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.13@tcp, seq: 173 00000100:00100000:0.0:1783441537.818601:0:5786:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a8756a5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:65454767-383a-4679-a788-eba05c6e0989+58:11480:x1870073673363968:12345-192.168.201.13@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1783441537.818623:0:5786:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1783441537.818646:0:5786:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91a85fe59a00/0xa2426164df2c834b lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x633a354aa4df4fff expref: -99 pid: 5786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783441537.819180:0:5786:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff91a85fe58a00/0xa2426164df2c8352 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783441537.819200:0:5786:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91a85fe58a00/0xa2426164df2c8352 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783441537.819214:0:5786:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91a85fe58a00/0xa2426164df2c8352 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1783441537.819229:0:5786:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 0 00010000:00010000:0.0:1783441537.819342:0:5786:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff91a85fe58a00/0xa2426164df2c8352 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783441537.819351:0:5786:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff91a85fe58a00/0xa2426164df2c8352 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783441537.819374:0:5786:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff91a85fe58a00/0xa2426164df2c8352 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783441537.819379:0:5786:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91a85fe58a00 already unused, calling callback (ffffffffc1f9b4f0) 00010000:00010000:0.0:1783441537.819383:0:5786:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91a85fe58a00/0xa2426164df2c8352 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783441537.819391:0:5786:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91a85fe58a00/0xa2426164df2c8352 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783441537.819403:0:5786:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff91a8429bd900) 00010000:00010000:0.0:1783441537.819407:0:5786:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1783441537.819411:0:5786:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff91a85fe58a00/0xa2426164df2c8352 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783441537.819418:0:5786:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91a85fe58a00/0xa2426164df2c8352 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783441537.819463:0:5786:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff91a85fe59a00/0xa2426164df2c834b lrc: 1/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.13@tcp remote: 0x633a354aa4df4fff expref: 60 pid: 5786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783441537.819474:0:5786:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff91a858b90e00) 00010000:00010000:0.0:1783441537.819477:0:5786:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1783441537.821016:0:5786:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91a85fe59a00/0xa2426164df2c834b lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.13@tcp remote: 0x633a354aa4df4fff expref: 60 pid: 5786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783441537.821163:0:5786:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91a85fe59a00, rc 0) 00000100:00100000:0.0:1783441537.821238:0:5786:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a8756a5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:65454767-383a-4679-a788-eba05c6e0989+59:11480:x1870073673363968:12345-192.168.201.13@tcp:101:lhsmtool_posix.0 Request processed in 2636us (2942us total) trans 4294967459 rc 301/301 00000100:00100000:0.0:1783441537.821262:0:5786:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.13@tcp, seq: 173 00000100:00100000:2.0:1783441537.827634:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.13@tcp (source: 12345-192.168.201.13@tcp) 00000100:00100000:0.0:1783441537.828207:0:5787:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073673364096 00000100:00100000:0.0:1783441537.828217:0:5787:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073673364096 00000100:00100000:0.0:1783441537.828278:0:5787:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.13@tcp, seq: 174 00000100:00100000:0.0:1783441537.828289:0:5787:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a8756a7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:65454767-383a-4679-a788-eba05c6e0989+59:11480:x1870073673364096:12345-192.168.201.13@tcp:53:lhsmtool_posix.0 00000004:00000080:0.0:1783441537.828330:0:5787:0:(mdt_handler.c:7960:mdt_fid2path()) path get [0x200000401:0xb:0x0] from 18446744073709551615 #0 00000100:00100000:0.0:1783441537.828438:0:5787:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a8756a7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:65454767-383a-4679-a788-eba05c6e0989+59:11480:x1870073673364096:12345-192.168.201.13@tcp:53:lhsmtool_posix.0 Request processed in 150us (814us total) trans 0 rc 0/0 00000100:00100000:0.0:1783441537.828446:0:5787:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.13@tcp, seq: 174 00000100:00100000:3.0:1783441537.833452:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.13@tcp (source: 12345-192.168.201.13@tcp) 00000100:00100000:0.0:1783441537.833656:0:5785:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073673364352 00000100:00100000:0.0:1783441537.833666:0:5785:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073673364352 00000100:00100000:0.0:1783441537.833726:0:5785:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.13@tcp, seq: 175 00000100:00100000:0.0:1783441537.833736:0:5785:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a87d87fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:65454767-383a-4679-a788-eba05c6e0989+59:11480:x1870073673364352:12345-192.168.201.13@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1783441537.833777:0:5785:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1783441537.833780:0:5785:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:0.0:1783441537.833805:0:5785:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91a85eaa1a00/0xa2426164df2c830c lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.13@tcp remote: 0x633a354aa4df4ff1 expref: 59 pid: 6605 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783441537.833822:0:5785:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff91a8429bdc00) 00010000:00010000:0.0:1783441537.833827:0:5785:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1783441537.833840:0:5785:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91a85fe59a00/0xa2426164df2c8360 lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x633a354aa4df5006 expref: -99 pid: 5785 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:0.0:1783441537.836689:0:5785:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x5:0x0], index 0: 0 00010000:00010000:1.0:1783441537.840040:0:5785:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff91a87da47200/0xa2426164df2c8367 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xd:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783441537.840063:0:5785:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91a87da47200/0xa2426164df2c8367 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783441537.840085:0:5785:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91a87da47200/0xa2426164df2c8367 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783441537.840162:0:5785:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91a85fe59a00/0xa2426164df2c8360 lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.13@tcp remote: 0x633a354aa4df5006 expref: 61 pid: 5785 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783441537.840180:0:5785:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff91a87da47200/0xa2426164df2c8367 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.13@tcp remote: 0x633a354aa4df5006 expref: 60 pid: 5785 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783441537.840189:0:5785:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff91a858b90700) 00010000:00010000:1.0:1783441537.840192:0:5785:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1783441537.840196:0:5785:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91a87da47200, rc 0) 00000100:00100000:1.0:1783441537.840273:0:5785:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a87d87fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:65454767-383a-4679-a788-eba05c6e0989+60:11480:x1870073673364352:12345-192.168.201.13@tcp:101:lhsmtool_posix.0 Request processed in 6538us (6874us total) trans 4294967460 rc 0/0 00000100:00100000:1.0:1783441537.840283:0:5785:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.13@tcp, seq: 175 00000100:00100000:0.0:1783441537.846823:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.13@tcp (source: 12345-192.168.201.13@tcp) 00000100:00100000:1.0:1783441537.846916:0:5787:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073673364608 00000100:00100000:1.0:1783441537.846926:0:5787:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073673364608 00000100:00100000:1.0:1783441537.846979:0:5787:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.13@tcp, seq: 176 00000100:00100000:1.0:1783441537.846989:0:5787:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a87d80c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:65454767-383a-4679-a788-eba05c6e0989+60:11480:x1870073673364608:12345-192.168.201.13@tcp:36:lhsmtool_posix.0 00010000:00010000:1.0:1783441537.847050:0:5787:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1783441537.847091:0:5787:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91a87da47200/0xa2426164df2c8367 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xd:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.13@tcp remote: 0x633a354aa4df5006 expref: 60 pid: 5785 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783441537.847111:0:5787:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff91a858b90700) 00010000:00010000:1.0:1783441537.847122:0:5787:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1783441537.847144:0:5787:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff91a87da46000/0xa2426164df2c8375 lrc: 3/0,1 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783441537.847164:0:5787:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91a87da46000/0xa2426164df2c8375 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783441537.847174:0:5787:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91a87da46000/0xa2426164df2c8375 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783441537.847190:0:5787:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff91a87da47000/0xa2426164df2c837c lrc: 3/0,1 mode: --/PW res: [0x200000401:0xa:0x0].0x2f17e143 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783441537.847197:0:5787:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91a87da47000/0xa2426164df2c837c lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x2f17e143 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783441537.847203:0:5787:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91a87da47000/0xa2426164df2c837c lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x2f17e143 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783441537.847280:0:5787:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff91a87da46000/0xa2426164df2c8375 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783441537.847288:0:5787:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff91a87da46000/0xa2426164df2c8375 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783441537.847296:0:5787:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff91a87da46000/0xa2426164df2c8375 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783441537.847302:0:5787:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91a87da46000 already unused, calling callback (ffffffffc1f9b4f0) 00010000:00010000:1.0:1783441537.847306:0:5787:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91a87da46000/0xa2426164df2c8375 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783441537.847314:0:5787:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91a87da46000/0xa2426164df2c8375 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783441537.847323:0:5787:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff91a8429bdc00) 00010000:00010000:1.0:1783441537.847331:0:5787:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1783441537.847336:0:5787:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff91a87da46000/0xa2426164df2c8375 lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783441537.847342:0:5787:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91a87da46000/0xa2426164df2c8375 lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783441537.847353:0:5787:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff91a87da47000/0xa2426164df2c837c lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x2f17e143 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783441537.847359:0:5787:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff91a87da47000/0xa2426164df2c837c lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x2f17e143 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783441537.847365:0:5787:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff91a87da47000/0xa2426164df2c837c lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x2f17e143 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783441537.847370:0:5787:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91a87da47000 already unused, calling callback (ffffffffc1f9b4f0) 00010000:00010000:1.0:1783441537.847373:0:5787:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91a87da47000/0xa2426164df2c837c lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x2f17e143 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783441537.847379:0:5787:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91a87da47000/0xa2426164df2c837c lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x2f17e143 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783441537.847387:0:5787:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x2f17e143 (ffff91a858b90a00) 00010000:00010000:1.0:1783441537.847389:0:5787:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1783441537.847392:0:5787:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff91a87da47000/0xa2426164df2c837c lrc: 2/0,0 mode: --/PW res: [0x200000401:0xa:0x0].0x2f17e143 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783441537.847398:0:5787:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91a87da47000/0xa2426164df2c837c lrc: 0/0,0 mode: --/PW res: [0x200000401:0xa:0x0].0x2f17e143 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783441537.847496:0:5787:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a87d80c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:65454767-383a-4679-a788-eba05c6e0989+59:11480:x1870073673364608:12345-192.168.201.13@tcp:36:lhsmtool_posix.0 Request processed in 507us (683us total) trans 0 rc -2/-2 00000100:00100000:1.0:1783441537.847510:0:5787:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.13@tcp, seq: 176 00000100:00100000:3.0:1783441537.855735:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.13@tcp (source: 12345-192.168.201.13@tcp) 00000100:00100000:0.0:1783441537.855860:0:5786:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073673364736 00000100:00100000:0.0:1783441537.855883:0:5786:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073673364736 00000100:00100000:0.0:1783441537.855944:0:5786:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.13@tcp, seq: 177 00000100:00100000:0.0:1783441537.855953:0:5786:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a87d87d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:65454767-383a-4679-a788-eba05c6e0989+59:11480:x1870073673364736:12345-192.168.201.13@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1783441537.855973:0:5786:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1783441537.855997:0:5786:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91a85fe58400/0xa2426164df2c8383 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xd:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x633a354aa4df500d expref: -99 pid: 5786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783441537.856035:0:5786:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff91a85fe59200/0xa2426164df2c838a lrc: 3/1,0 mode: --/PR res: [0x200000401:0xd:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783441537.856048:0:5786:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91a85fe59200/0xa2426164df2c838a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783441537.856073:0:5786:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91a85fe59200/0xa2426164df2c838a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783441537.856168:0:5786:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91a85fe58400/0xa2426164df2c8383 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xd:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.13@tcp remote: 0x633a354aa4df500d expref: 61 pid: 5786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783441537.856186:0:5786:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff91a85fe59200/0xa2426164df2c838a lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.13@tcp remote: 0x633a354aa4df500d expref: 60 pid: 5786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783441537.856195:0:5786:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff91a8439b0900) 00010000:00010000:0.0:1783441537.856198:0:5786:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:0.0:1783441537.856201:0:5786:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91a85fe59200, rc 0) 00000100:00100000:0.0:1783441537.856259:0:5786:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a87d87d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:65454767-383a-4679-a788-eba05c6e0989+60:11480:x1870073673364736:12345-192.168.201.13@tcp:101:lhsmtool_posix.0 Request processed in 306us (536us total) trans 0 rc 0/0 00000100:00100000:0.0:1783441537.856266:0:5786:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.13@tcp, seq: 177 00000100:00100000:0.0:1783441537.861987:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.13@tcp (source: 12345-192.168.201.13@tcp) 00000100:00100000:1.0:1783441537.866278:0:5787:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073673364992 00000100:00100000:1.0:1783441537.866295:0:5787:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073673364992 00000100:00100000:1.0:1783441537.866486:0:5787:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.13@tcp, seq: 178 00000100:00100000:1.0:1783441537.866497:0:5787:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a8476b1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:65454767-383a-4679-a788-eba05c6e0989+60:11480:x1870073673364992:12345-192.168.201.13@tcp:36:lhsmtool_posix.0 00010000:00010000:1.0:1783441537.866597:0:5787:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff91a87da47000/0xa2426164df2c8391 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783441537.866613:0:5787:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91a87da47000/0xa2426164df2c8391 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783441537.866625:0:5787:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91a87da47000/0xa2426164df2c8391 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:1.0:1783441537.866926:0:5787:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].6, 88 off8648 00000004:00080000:1.0:1783441537.866936:0:5787:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 375741193960ns, next at 376741191990ns, rc = 0 00000004:00010000:1.0:1783441537.867014:0:5787:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000f804c991 reply state 000000005e00623e transno 4294967461 ns: mdt-lustre-MDT0000_UUID lock: ffff91a87da47000/0xa2426164df2c8391 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783441537.867025:0:5787:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1783441537.867400:0:5787:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a8476b1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:65454767-383a-4679-a788-eba05c6e0989+62:11480:x1870073673364992:12345-192.168.201.13@tcp:36:lhsmtool_posix.0 Request processed in 902us (5420us total) trans 4294967461 rc 0/0 00000100:00100000:1.0:1783441537.867408:0:5787:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.13@tcp, seq: 178 00010000:00010000:3.0:1783441537.869369:0:3290:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff91a87da47000/0xa2426164df2c8391 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783441537.869385:0:3290:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff91a87da47000/0xa2426164df2c8391 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783441537.869393:0:3290:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff91a87da47000/0xa2426164df2c8391 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783441537.869399:0:3290:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91a87da47000 already unused, calling callback (ffffffffc1f9b4f0) 00010000:00010000:3.0:1783441537.869404:0:3290:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91a87da47000/0xa2426164df2c8391 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783441537.869431:0:3290:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91a87da47000/0xa2426164df2c8391 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783441537.869447:0:3290:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff91a8439b0900) 00010000:00010000:3.0:1783441537.869450:0:3290:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:3.0:1783441537.869455:0:3290:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff91a87da47000/0xa2426164df2c8391 lrc: 2/0,0 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783441537.869462:0:3290:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91a87da47000/0xa2426164df2c8391 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783441537.870874:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.13@tcp (source: 12345-192.168.201.13@tcp) 00000100:00100000:2.0:1783441537.872458:0:6605:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073673365120 00000100:00100000:2.0:1783441537.872471:0:6605:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073673365120 00000100:00100000:2.0:1783441537.872912:0:6605:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.13@tcp, seq: 179 00000100:00100000:2.0:1783441537.872923:0:6605:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a8476b1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:65454767-383a-4679-a788-eba05c6e0989+61:11480:x1870073673365120:12345-192.168.201.13@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1783441537.872947:0:6605:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1783441537.872968:0:6605:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91a85eaa1400/0xa2426164df2c8398 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xd:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x633a354aa4df5014 expref: -99 pid: 6605 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783441537.873041:0:6605:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91a85eaa1400/0xa2426164df2c8398 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.201.13@tcp remote: 0x633a354aa4df5014 expref: 62 pid: 6605 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783441537.873081:0:6605:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff91a85eaa1400/0xa2426164df2c8398 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.13@tcp remote: 0x633a354aa4df5014 expref: 62 pid: 6605 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783441537.873103:0:6605:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff91a8439b0900) 00010000:00010000:2.0:1783441537.873106:0:6605:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1783441537.873110:0:6605:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91a85eaa1400, rc 0) 00000100:00100000:2.0:1783441537.873181:0:6605:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a8476b1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:65454767-383a-4679-a788-eba05c6e0989+62:11480:x1870073673365120:12345-192.168.201.13@tcp:101:lhsmtool_posix.0 Request processed in 260us (2316us total) trans 0 rc 0/0 00000100:00100000:2.0:1783441537.873189:0:6605:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.13@tcp, seq: 179 00000100:00100000:0.0:1783441537.876945:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.13@tcp (source: 12345-192.168.201.13@tcp) 00000100:00100000:1.0:1783441537.877291:0:8557:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073673365248 00000100:00100000:1.0:1783441537.877301:0:8557:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073673365248 00000100:00100000:1.0:1783441537.877388:0:8557:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.13@tcp, seq: 51 00000100:00100000:1.0:1783441537.877400:0:8557:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a8476b1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:65454767-383a-4679-a788-eba05c6e0989+6:2354:x1870073673365248:12345-192.168.201.13@tcp:2:lhsmtool_posix.0 00000100:00100000:1.0:1783441537.877819:0:8557:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a8476b1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:65454767-383a-4679-a788-eba05c6e0989+7:2354:x1870073673365248:12345-192.168.201.13@tcp:2:lhsmtool_posix.0 Request processed in 420us (882us total) trans 4294967313 rc 0/0 00000100:00100000:1.0:1783441537.877841:0:8557:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.13@tcp, seq: 51 00000100:00080000:2.0:1783441537.878014:0:5781:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1783441537.898752:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.13@tcp (source: 12345-192.168.201.13@tcp) 00000100:00100000:1.0:1783441537.898800:0:5788:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073673365504 00000100:00100000:1.0:1783441537.898810:0:5788:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073673365504 00000100:00100000:1.0:1783441537.898876:0:5788:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.13@tcp, seq: 49 00000100:00100000:1.0:1783441537.898886:0:5788:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a8476b0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:65454767-383a-4679-a788-eba05c6e0989+62:11480:x1870073673365504:12345-192.168.201.13@tcp:35:lhsmtool_posix.0 00000100:00100000:1.0:1783441537.899399:0:5788:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a8476b0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:65454767-383a-4679-a788-eba05c6e0989+63:11480:x1870073673365504:12345-192.168.201.13@tcp:35:lhsmtool_posix.0 Request processed in 512us (667us total) trans 4294967462 rc 0/0 00000100:00100000:1.0:1783441537.899408:0:5788:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.13@tcp, seq: 49 00000100:00100000:0.0:1783441537.904577:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.13@tcp (source: 12345-192.168.201.13@tcp) 00000100:00100000:1.0:1783441537.906482:0:5787:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073673365760 00000100:00100000:1.0:1783441537.906498:0:5787:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073673365760 00000100:00100000:1.0:1783441537.906571:0:5787:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.13@tcp, seq: 180 00000100:00100000:1.0:1783441537.906591:0:5787:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a8476b3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:65454767-383a-4679-a788-eba05c6e0989+63:11480:x1870073673365760:12345-192.168.201.13@tcp:57:lhsmtool_posix.0 00000100:00100000:1.0:1783441537.906700:0:5787:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a8476b3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:65454767-383a-4679-a788-eba05c6e0989+63:11480:x1870073673365760:12345-192.168.201.13@tcp:57:lhsmtool_posix.0 Request processed in 120us (2131us total) trans 0 rc 0/0 00000100:00100000:1.0:1783441537.906707:0:5787:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.13@tcp, seq: 180 00000100:00100000:0.0:1783441537.912139:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.13@tcp (source: 12345-192.168.201.13@tcp) 00000100:00100000:3.0:1783441537.912269:0:6605:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073673365888 00000100:00100000:3.0:1783441537.912280:0:6605:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073673365888 00000100:00100000:3.0:1783441537.912343:0:6605:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.13@tcp, seq: 181 00000100:00100000:3.0:1783441537.912353:0:6605:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a87d804700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:65454767-383a-4679-a788-eba05c6e0989+63:11480:x1870073673365888:12345-192.168.201.13@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1783441537.912374:0:6605:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1783441537.912396:0:6605:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91a85eb3c200/0xa2426164df2c839f lrc: 2/0,0 mode: --/CR res: [0x200000401:0xd:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x633a354aa4df501b expref: -99 pid: 6605 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783441537.912496:0:6605:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff91a85eb3d000/0xa2426164df2c83a6 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xd:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6605 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783441537.912510:0:6605:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91a85eb3d000/0xa2426164df2c83a6 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6605 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783441537.912522:0:6605:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91a85eb3d000/0xa2426164df2c83a6 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6605 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1783441537.912560:0:6605:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:3.0:1783441537.912600:0:6605:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff91a85eb3d000/0xa2426164df2c83a6 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6605 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783441537.912633:0:6605:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91a85eb3c200/0xa2426164df2c839f lrc: 0/0,0 mode: --/CR res: [0x200000401:0xd:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.13@tcp remote: 0x633a354aa4df501b expref: 65 pid: 6605 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783441537.912653:0:6605:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff91a85eb3d000/0xa2426164df2c83a6 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.13@tcp remote: 0x633a354aa4df501b expref: 64 pid: 6605 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783441537.912663:0:6605:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff91a8439b0900) 00010000:00010000:3.0:1783441537.912666:0:6605:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:3.0:1783441537.912670:0:6605:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91a85eb3d000, rc 0) 00000100:00100000:3.0:1783441537.912727:0:6605:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a87d804700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:65454767-383a-4679-a788-eba05c6e0989+64:11480:x1870073673365888:12345-192.168.201.13@tcp:101:lhsmtool_posix.0 Request processed in 375us (600us total) trans 0 rc 0/0 00000100:00100000:3.0:1783441537.912734:0:6605:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.13@tcp, seq: 181 00000100:00100000:2.0:1783441537.916484:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.13@tcp (source: 12345-192.168.201.13@tcp) 00000100:00100000:3.0:1783441537.916568:0:6583:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073673366016 00000100:00100000:3.0:1783441537.916579:0:6583:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073673366016 00000100:00100000:3.0:1783441537.916648:0:6583:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.13@tcp, seq: 52 00000100:00100000:3.0:1783441537.916659:0:6583:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a8756a6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:65454767-383a-4679-a788-eba05c6e0989+7:2355:x1870073673366016:12345-192.168.201.13@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1783441537.916678:0:6583:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1783441537.916699:0:6583:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000a1fbf00b/0xa2426164df2c83ad lrc: 2/0,0 mode: --/PR res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x633a354aa4df5022 expref: -99 pid: 6583 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1783441537.916727:0:6583:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x5:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x6a4d2882, blocks: 0x1 00010000:00010000:3.0:1783441537.916766:0:6583:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=375s v=(0 0) 00010000:00010000:3.0:1783441537.916771:0:6583:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1783441537.916780:0:6583:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000a1fbf00b/0xa2426164df2c83ad lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.13@tcp remote: 0x633a354aa4df5022 expref: 8 pid: 6583 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783441537.916811:0:6583:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000a1fbf00b/0xa2426164df2c83ad lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.13@tcp remote: 0x633a354aa4df5022 expref: 8 pid: 6583 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783441537.916824:0:6583:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91a85eb3da00, rc 0) 00000100:00100000:3.0:1783441537.916887:0:6583:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a8756a6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:65454767-383a-4679-a788-eba05c6e0989+8:2355:x1870073673366016:12345-192.168.201.13@tcp:101:lhsmtool_posix.0 Request processed in 230us (413us total) trans 0 rc 0/0 00000100:00100000:3.0:1783441537.916893:0:6583:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.13@tcp, seq: 52 00000100:00100000:0.0:1783441537.923845:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.13@tcp (source: 12345-192.168.201.13@tcp) 00000100:00100000:3.0:1783441537.924177:0:5787:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073673366272 00000100:00100000:3.0:1783441537.924189:0:5787:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073673366272 00000100:00100000:3.0:1783441537.924251:0:5787:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.13@tcp, seq: 182 00000100:00100000:3.0:1783441537.924261:0:5787:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a87d806300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:65454767-383a-4679-a788-eba05c6e0989+64:11480:x1870073673366272:12345-192.168.201.13@tcp:57:lhsmtool_posix.0 00000100:00100000:3.0:1783441537.924381:0:5787:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a87d806300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:65454767-383a-4679-a788-eba05c6e0989+64:11480:x1870073673366272:12345-192.168.201.13@tcp:57:lhsmtool_posix.0 Request processed in 120us (549us total) trans 0 rc 0/0 00000100:00100000:3.0:1783441537.924389:0:5787:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.13@tcp, seq: 182 00000100:00100000:0.0:1783441537.933892:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.13@tcp (source: 12345-192.168.201.13@tcp) 00000100:00100000:3.0:1783441537.938490:0:6582:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073673366400 00000100:00100000:3.0:1783441537.938504:0:6582:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073673366400 00000100:00100000:3.0:1783441537.938571:0:6582:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.13@tcp, seq: 53 00000100:00100000:3.0:1783441537.938580:0:6582:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a87d805180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:65454767-383a-4679-a788-eba05c6e0989+8:11480:x1870073673366400:12345-192.168.201.13@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1783441537.938606:0:6582:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1783441537.938624:0:6582:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000008550020f/0xa2426164df2c83b4 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x633a354aa4df5029 expref: -99 pid: 6582 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783441537.938654:0:6582:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000a1fbf00b/0xa2426164df2c83ad lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.13@tcp remote: 0x633a354aa4df5022 expref: 9 pid: 6583 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783441537.938676:0:6582:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1783441537.938681:0:6582:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1783441537.938687:0:6582:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000008550020f/0xa2426164df2c83b4 lrc: 4/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.201.13@tcp remote: 0x633a354aa4df5029 expref: 9 pid: 6582 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783441537.938718:0:6582:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000a1fbf00b/0xa2426164df2c83ad lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.201.13@tcp remote: 0x633a354aa4df5022 expref: 9 pid: 6583 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783441537.938732:0:6582:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000a1fbf00b/0xa2426164df2c83ad lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.201.13@tcp remote: 0x633a354aa4df5022 expref: 9 pid: 6583 timeout: 475 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783441537.938759:0:6582:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff91a87d87e300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:6582:1870073693287552:192.168.201.13@tcp:104: 00000100:00100000:3.0:1783441537.938843:0:6582:0:(client.c:2702:ptlrpc_set_wait()) set ffff91a8655d4cc0 going to sleep for 11 seconds 00000100:00100000:2.0:1783441537.962388:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.13@tcp (source: 12345-192.168.201.13@tcp) 00000100:00100000:3.0:1783441537.962615:0:6582:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff91a87d87e300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:6582:1870073693287552:192.168.201.13@tcp:104: 00010000:00010000:3.0:1783441537.962650:0:6582:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000008550020f/0xa2426164df2c83b4 lrc: 3/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.201.13@tcp remote: 0x633a354aa4df5029 expref: 9 pid: 6582 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783441537.962672:0:6582:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91a85eb3c200, rc 0) 00000100:00100000:3.0:1783441537.962727:0:6582:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a87d805180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:65454767-383a-4679-a788-eba05c6e0989+9:11480:x1870073673366400:12345-192.168.201.13@tcp:101:lhsmtool_posix.0 Request processed in 24147us (28843us total) trans 0 rc 0/0 00000100:00100000:3.0:1783441537.962736:0:6582:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.13@tcp, seq: 53 00000100:00100000:0.0:1783441537.966950:0:5770:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073673366528 00000100:00100000:0.0:1783441537.966965:0:5770:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073673366528 00010000:00010000:0.0:1783441537.967012:0:5770:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000a1fbf00b/0xa2426164df2c83ad lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.201.13@tcp remote: 0x633a354aa4df5022 expref: 9 pid: 6583 timeout: 475 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783441537.967079:0:5770:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.13@tcp, seq: 70 00000100:00100000:0.0:1783441537.967089:0:5770:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a846f75c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:65454767-383a-4679-a788-eba05c6e0989+9:2354:x1870073673366528:12345-192.168.201.13@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1783441537.967103:0:5770:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1783441537.967126:0:5770:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000a1fbf00b/0xa2426164df2c83ad lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.201.13@tcp remote: 0x633a354aa4df5022 expref: 9 pid: 6583 timeout: 475 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783441537.967141:0:5770:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000a1fbf00b/0xa2426164df2c83ad lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.201.13@tcp remote: 0x633a354aa4df5022 expref: 9 pid: 6583 timeout: 475 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783441537.967166:0:5770:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000a1fbf00b/0xa2426164df2c83ad lrc: 0/0,0 mode: --/PR res: [0x240000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.201.13@tcp remote: 0x633a354aa4df5022 expref: 9 pid: 6583 timeout: 475 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783441537.967181:0:5770:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1783441537.967185:0:5770:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1783441537.967194:0:5770:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000008550020f/0xa2426164df2c83b4 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.201.13@tcp remote: 0x633a354aa4df5029 expref: 8 pid: 6582 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783441537.967230:0:5770:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000008550020f/0xa2426164df2c83b4 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.201.13@tcp remote: 0x633a354aa4df5029 expref: 8 pid: 6582 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783441537.967274:0:5770:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: 000000008550020f/0xa2426164df2c83b4 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.201.13@tcp remote: 0x633a354aa4df5029 expref: 8 pid: 6582 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783441537.967290:0:5770:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff91a87531e300 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:5770:1870073693287680:192.168.201.13@tcp:105: 00000100:00100000:0.0:1783441537.967377:0:5770:0:(client.c:2702:ptlrpc_set_wait()) set ffff91a87d800000 going to sleep for 11 seconds 00000100:00100000:3.0:1783441537.975199:0:5770:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff91a87531e300 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:5770:1870073693287680:192.168.201.13@tcp:105: 00010000:00010000:3.0:1783441537.975240:0:5770:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1783441537.975321:0:5770:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a846f75c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:65454767-383a-4679-a788-eba05c6e0989+8:2354:x1870073673366528:12345-192.168.201.13@tcp:103:ldlm_bl.0 Request processed in 8232us (12941us total) trans 0 rc 0/0 00000100:00100000:3.0:1783441537.975333:0:5770:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.13@tcp, seq: 70 00000100:00100000:1.0:1783441537.977865:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.13@tcp (source: 12345-192.168.201.13@tcp) 00000100:00100000:2.0:1783441537.977977:0:6586:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073673366656 00000100:00100000:2.0:1783441537.977985:0:6586:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073673366656 00002000:00100000:2.0:1783441537.978043:0:6586:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x5:0x0] (0->8) req@ffff91a745907100 x1870073673366656/t0(0) o4->65454767-383a-4679-a788-eba05c6e0989@192.168.201.13@tcp:178/0 lens 504/0 e 0 to 0 dl 1783441548 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1783441537.978062:0:6586:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff91a745907100 with x1870073673366656 ext(0->8) 00002000:00010000:2.0:1783441537.978069:0:6586:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff91a745907100 00000100:00100000:2.0:1783441537.978103:0:6586:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.13@tcp, seq: 4 00000100:00100000:2.0:1783441537.978112:0:6586:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a745907100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:65454767-383a-4679-a788-eba05c6e0989+8:2354:x1870073673366656:12345-192.168.201.13@tcp:4:lhsmtool_posix.0 00000100:00100000:2.0:1783441537.978593:0:6586:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a745907100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:65454767-383a-4679-a788-eba05c6e0989+10:2354:x1870073673366656:12345-192.168.201.13@tcp:4:lhsmtool_posix.0 Request processed in 469us (726us total) trans 4294967314 rc 0/0 00000100:00100000:2.0:1783441537.978603:0:6586:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.13@tcp, seq: 4 00002000:00100000:2.0:1783441537.978611:0:6586:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x5:0x0] (0->8) req@ffff91a745907100 x1870073673366656/t4294967314(0) o4->65454767-383a-4679-a788-eba05c6e0989@192.168.201.13@tcp:178/0 lens 504/448 e 0 to 0 dl 1783441548 ref 1 fl Complete:/600/0 rc 0/0 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1783441537.978624:0:6586:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff91a745907100 with x1870073673366656 ext(0->8) 00002000:00010000:2.0:1783441537.978627:0:6586:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff91a745907100 00000100:00100000:3.0:1783441537.986346:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.13@tcp (source: 12345-192.168.201.13@tcp) 00000100:00100000:2.0:1783441537.986478:0:6605:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073673366784 00000100:00100000:2.0:1783441537.986490:0:6605:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073673366784 00000100:00100000:2.0:1783441537.986563:0:6605:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.13@tcp, seq: 183 00000100:00100000:2.0:1783441537.986576:0:6605:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a87d87d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:65454767-383a-4679-a788-eba05c6e0989+64:11480:x1870073673366784:12345-192.168.201.13@tcp:44:lhsmtool_posix.0 00000100:00100000:2.0:1783441538.063205:0:6605:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a87d87d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:65454767-383a-4679-a788-eba05c6e0989+64:11480:x1870073673366784:12345-192.168.201.13@tcp:44:lhsmtool_posix.0 Request processed in 76621us (76859us total) trans 0 rc 0/0 00000100:00100000:2.0:1783441538.063220:0:6605:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.13@tcp, seq: 183 00000001:00080000:2.0:1783441538.063281:0:5807:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967460 is committed 00000001:00080000:2.0:1783441538.063326:0:5807:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967462 is committed 00000004:00080000:2.0:1783441538.063334:0:5807:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 7 committed 00000004:00080000:2.0:1783441538.063360:0:5807:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 5 committed 00000020:00080000:2.0:1783441538.063383:0:5807:0:(update_trans.c:60:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff91a848630540 refcount 2 committed 0 result 0 batchid 5 00000020:00080000:2.0:1783441538.063387:0:5807:0:(update_trans.c:68:top_multiple_thandle_dump()) st ffff91a844de5800 obd lustre-OST0001-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff91a848630cc0 00000020:00080000:2.0:1783441538.063390:0:5807:0:(update_trans.c:68:top_multiple_thandle_dump()) st ffff91a844de5c00 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff91a843349800 00000100:00100000:2.0:1783441538.063690:0:3303:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1783441538.063707:0:3303:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff91a87d4eb800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3303:1870073693287808:0@lo:2:osp-syn-0-0.0 00000100:00100000:2.0:1783441538.063807:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783441538.063868:0:3305:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff91a87d4eb100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3305:1870073693287936:0@lo:6:osp-syn-1-0.0 00000100:00100000:2.0:1783441538.063899:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783441538.063969:0:6583:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073693287808 00000100:00100000:2.0:1783441538.063976:0:6583:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073693287808 00000100:00100000:2.0:1783441538.064043:0:6583:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073693287936 00000100:00100000:2.0:1783441538.064048:0:6583:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073693287936 00000100:00100000:2.0:1783441538.064096:0:6583:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 54 00000100:00100000:2.0:1783441538.064108:0:6583:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a87d4e8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3303:x1870073693287808:12345-0@lo:2:osp-syn-0-0.0 00002000:00010000:2.0:1783441538.064294:0:6583:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb size from disk: 0 -> 9 00002000:00010000:2.0:1783441538.064299:0:6583:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb mtime from disk: 0 -> 1783441538 00002000:00010000:2.0:1783441538.064302:0:6583:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:2.0:1783441538.064304:0:6583:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb ctime from disk: 1783441538 -> 1783441538 00002000:00010000:2.0:1783441538.064307:0:6583:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb blocks from disk: 1 -> 1 00000100:00100000:2.0:1783441538.064352:0:6583:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a87d4e8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:3303:x1870073693287808:12345-0@lo:2:osp-syn-0-0.0 Request processed in 248us (545us total) trans 4294967315 rc 0/0 00000100:00100000:2.0:1783441538.064359:0:6583:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 54 00000100:00100000:2.0:1783441538.064372:0:6583:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 55 00000100:00100000:2.0:1783441538.064382:0:6583:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a87d4ded80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3305:x1870073693287936:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:2.0:1783441538.064399:0:6583:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x280000400:4 count 1 00002000:00010000:2.0:1783441538.064430:0:6583:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x4:0x0] initial LVB size: 13, mtime: 0x6a4d2880, atime: 0x6a4d2880, ctime: 0x6a4d2880, blocks: 0xb 00010000:00010000:2.0:1783441538.064439:0:6583:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000ba5ebf5a/0xa2426164df2c83bb lrc: 3/0,1 mode: --/PW res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6583 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783441538.064457:0:6583:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x4:0x0].0x0 since=375s v=(0 0) 00010000:00010000:2.0:1783441538.064462:0:6583:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1783441538.064471:0:6583:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000ba5ebf5a/0xa2426164df2c83bb lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6583 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783441538.064487:0:6583:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000ba5ebf5a/0xa2426164df2c83bb lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6583 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783441538.064499:0:6583:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000ba5ebf5a/0xa2426164df2c83bb lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6583 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783441538.064522:0:6583:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000ba5ebf5a/0xa2426164df2c83bb lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 6583 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783441538.064543:0:6583:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:2.0:1783441538.065262:0:6583:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a87d4ded80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:3305:x1870073693287936:12345-0@lo:6:osp-syn-1-0.0 Request processed in 880us (1359us total) trans 4294967307 rc 0/0 00000100:00100000:2.0:1783441538.065271:0:6583:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 55 00000100:00080000:2.0:1783441538.065303:0:5781:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1783441538.065308:0:5781:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1783441538.065343:0:3305:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967306 gen 2 00000004:00080000:2.0:1783441538.065350:0:3305:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967306 committed transno 4294967306 00000100:00100000:2.0:1783441538.065378:0:3305:0:(client.c:3156:ptlrpc_free_committed()) @@@ stopping search req@ffff91a87d4eb100 x1870073693287936/t4294967307(4294967307) o6->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 544/432 e 0 to 0 dl 1783441554 ref 2 fl Rpc:RQU/204/0 rc 0/0 job:'osp-syn-1-0.0' uid:0 gid:0 projid:4294967295 00000004:00080000:2.0:1783441538.065391:0:3305:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff91a87d4eb100/2, rc 0, transno 4294967307 00000100:00100000:2.0:1783441538.065396:0:3305:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff91a87d4eb100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3305:1870073693287936:0@lo:6:osp-syn-1-0.0 00000004:00080000:2.0:1783441538.065422:0:3303:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff91a87d4eb800/2, rc 0, transno 4294967315 00000100:00100000:2.0:1783441538.065427:0:3303:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff91a87d4eb800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3303:1870073693287808:0@lo:2:osp-syn-0-0.0 00000020:00080000:2.0:1783441538.066107:0:5818:0:(update_trans.c:1581:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 5 committed batchid 4 00010000:00010000:0.0:1783441538.066616:0:5772:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1783441538.066627:0:5772:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000ba5ebf5a/0xa2426164df2c83bb lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6583 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783441538.066641:0:5772:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91a85eaa1c00 already unused, calling callback (ffffffffc155ff90) 00010000:00010000:0.0:1783441538.066646:0:5772:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000ba5ebf5a/0xa2426164df2c83bb lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6583 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783441538.066656:0:5772:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000ba5ebf5a/0xa2426164df2c83bb lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 6583 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783441538.066677:0:5772:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000ba5ebf5a/0xa2426164df2c83bb lrc: 1/0,0 mode: --/PW res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6583 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783441538.066684:0:5772:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000ba5ebf5a/0xa2426164df2c83bb lrc: 0/0,0 mode: --/PW res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6583 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783441538.066726:0:5772:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783441538.066728:0:5772:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783441538.066729:0:5772:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00080000:2.0:1783441538.066872:0:5818:0:(update_trans.c:1581:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 4 00000100:00100000:3.0:1783441538.074080:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.13@tcp (source: 12345-192.168.201.13@tcp) 00000100:00100000:2.0:1783441538.074147:0:6583:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073673366912 00000100:00100000:2.0:1783441538.074161:0:6583:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073673366912 00000100:00100000:2.0:1783441538.074229:0:6583:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.13@tcp, seq: 56 00000100:00100000:2.0:1783441538.074326:0:6583:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a87d87e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:65454767-383a-4679-a788-eba05c6e0989+10:2355:x1870073673366912:12345-192.168.201.13@tcp:16:lhsmtool_posix.0 00000001:00080000:1.0:1783441538.130384:0:6613:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967313 is committed 00000001:00080000:1.0:1783441538.130658:0:6613:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967315 is committed 00000001:00080000:1.0:1783441538.130668:0:6613:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967314 is committed 00000100:00100000:2.0:1783441538.131196:0:6583:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a87d87e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:65454767-383a-4679-a788-eba05c6e0989+7:2355:x1870073673366912:12345-192.168.201.13@tcp:16:lhsmtool_posix.0 Request processed in 56864us (57448us total) trans 0 rc 0/0 00000100:00100000:2.0:1783441538.131227:0:6583:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.13@tcp, seq: 56 00000100:00100000:0.0:1783441538.138248:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.13@tcp (source: 12345-192.168.201.13@tcp) 00000100:00100000:3.0:1783441538.138804:0:5787:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073673367168 00000100:00100000:3.0:1783441538.138820:0:5787:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073673367168 00000100:00100000:3.0:1783441538.139059:0:5787:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.13@tcp, seq: 184 00000100:00100000:3.0:1783441538.139071:0:5787:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a87531e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:65454767-383a-4679-a788-eba05c6e0989+19:11480:x1870073673367168:12345-192.168.201.13@tcp:36:lhsmtool_posix.0 00010000:00010000:3.0:1783441538.139136:0:5787:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1783441538.139169:0:5787:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91a85eb3d000/0xa2426164df2c83a6 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xd:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.13@tcp remote: 0x633a354aa4df501b expref: 19 pid: 6605 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783441538.139186:0:5787:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff91a8439b0900) 00010000:00010000:3.0:1783441538.139191:0:5787:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1783441538.139223:0:5787:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff91a85eb3d200/0xa2426164df2c83c2 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783441538.139236:0:5787:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91a85eb3d200/0xa2426164df2c83c2 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783441538.139244:0:5787:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91a85eb3d200/0xa2426164df2c83c2 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1783441538.139552:0:5787:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000888d4f13 reply state 00000000656f8e96 transno 4294967463 ns: mdt-lustre-MDT0000_UUID lock: ffff91a85eb3d200/0xa2426164df2c83c2 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783441538.139563:0:5787:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1783441538.139714:0:5787:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a87531e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:65454767-383a-4679-a788-eba05c6e0989+20:11480:x1870073673367168:12345-192.168.201.13@tcp:36:lhsmtool_posix.0 Request processed in 643us (1474us total) trans 4294967463 rc 0/0 00000100:00100000:3.0:1783441538.139791:0:5787:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.13@tcp, seq: 184 00000100:00080000:0.0:1783441538.139869:0:5781:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1783441538.153840:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.13@tcp (source: 12345-192.168.201.13@tcp) 00000100:00100000:0.0:1783441538.154000:0:6582:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073673367296 00000100:00100000:0.0:1783441538.154015:0:6582:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073673367296 00000100:00100000:0.0:1783441538.154093:0:6582:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.13@tcp, seq: 57 00000100:00100000:0.0:1783441538.154105:0:6582:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a745904a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:65454767-383a-4679-a788-eba05c6e0989+7:2354:x1870073673367296:12345-192.168.201.13@tcp:2:lhsmtool_posix.0 00002000:00010000:0.0:1783441538.154484:0:6582:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb size from disk: 9 -> 9 00002000:00010000:0.0:1783441538.154489:0:6582:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb mtime from disk: 1783441538 -> 1783441538 00002000:00010000:0.0:1783441538.154491:0:6582:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb atime from disk: 0 -> 1783441536 00002000:00010000:0.0:1783441538.154494:0:6582:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb ctime from disk: 1783441538 -> 1783441538 00002000:00010000:0.0:1783441538.154496:0:6582:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb blocks from disk: 1 -> 11 00000100:00100000:0.0:1783441538.154587:0:6582:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a745904a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:65454767-383a-4679-a788-eba05c6e0989+8:2354:x1870073673367296:12345-192.168.201.13@tcp:2:lhsmtool_posix.0 Request processed in 474us (753us total) trans 4294967316 rc 0/0 00000100:00100000:0.0:1783441538.154596:0:6582:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.13@tcp, seq: 57 00010000:00010000:3.0:1783441538.154888:0:3289:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff91a85eb3d200/0xa2426164df2c83c2 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783441538.154901:0:3289:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff91a85eb3d200/0xa2426164df2c83c2 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783441538.154909:0:3289:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff91a85eb3d200/0xa2426164df2c83c2 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783441538.154916:0:3289:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91a85eb3d200 already unused, calling callback (ffffffffc1f9b4f0) 00010000:00010000:3.0:1783441538.154922:0:3289:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91a85eb3d200/0xa2426164df2c83c2 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783441538.154930:0:3289:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91a85eb3d200/0xa2426164df2c83c2 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783441538.154953:0:3289:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff91a8439b0900) 00010000:00010000:3.0:1783441538.154956:0:3289:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1783441538.154961:0:3289:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff91a85eb3d200/0xa2426164df2c83c2 lrc: 2/0,0 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783441538.154968:0:3289:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91a85eb3d200/0xa2426164df2c83c2 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783441538.157658:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.13@tcp (source: 12345-192.168.201.13@tcp) 00000100:00100000:3.0:1783441538.157827:0:5786:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073673367552 00000100:00100000:3.0:1783441538.157841:0:5786:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073673367552 00000100:00100000:3.0:1783441538.157920:0:5786:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.13@tcp, seq: 185 00000100:00100000:3.0:1783441538.157931:0:5786:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a87d4de300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:65454767-383a-4679-a788-eba05c6e0989+19:11480:x1870073673367552:12345-192.168.201.13@tcp:55:lhsmtool_posix.0 00010000:00010000:3.0:1783441538.158027:0:5786:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff91a85eb3d000/0xa2426164df2c83c9 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783441538.158065:0:5786:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff91a85fe59200/0xa2426164df2c838a lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.13@tcp remote: 0x633a354aa4df500d expref: 19 pid: 5786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783441538.158074:0:5786:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff91a85eb3d000/0xa2426164df2c83c9 lrc: 4/0,1 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783441538.158119:0:5786:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff91a85fe59200/0xa2426164df2c838a lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.13@tcp remote: 0x633a354aa4df500d expref: 19 pid: 5786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783441538.158133:0:5786:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff91a85fe59200/0xa2426164df2c838a lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.13@tcp remote: 0x633a354aa4df500d expref: 19 pid: 5786 timeout: 476 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783441538.158150:0:5786:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff91a87d87ca80 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5786:1870073693288064:192.168.201.13@tcp:104: 00000100:00100000:3.0:1783441538.158277:0:5786:0:(client.c:2702:ptlrpc_set_wait()) set ffff91a848632480 going to sleep for 11 seconds 00000100:00100000:3.0:1783441538.165044:0:5786:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff91a87d87ca80 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5786:1870073693288064:192.168.201.13@tcp:104: 00010000:00010000:3.0:1783441538.165096:0:5786:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff91a85eb3d000/0xa2426164df2c83c9 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783441538.165271:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.13@tcp (source: 12345-192.168.201.13@tcp) 00000100:00100000:0.0:1783441538.165369:0:11514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073673367680 00000100:00100000:0.0:1783441538.165378:0:11514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073673367680 00010000:00010000:0.0:1783441538.165428:0:11514:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff91a85fe59200/0xa2426164df2c838a lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.13@tcp remote: 0x633a354aa4df500d expref: 20 pid: 5786 timeout: 476 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783441538.165687:0:11514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.13@tcp, seq: 71 00000100:00100000:0.0:1783441538.165700:0:11514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a87d4df800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:65454767-383a-4679-a788-eba05c6e0989+20:2355:x1870073673367680:12345-192.168.201.13@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1783441538.165722:0:11514:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1783441538.165804:0:11514:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff91a85fe59200/0xa2426164df2c838a lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.13@tcp remote: 0x633a354aa4df500d expref: 20 pid: 5786 timeout: 476 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783441538.165819:0:11514:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff91a85fe59200/0xa2426164df2c838a lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.13@tcp remote: 0x633a354aa4df500d expref: 20 pid: 5786 timeout: 476 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783441538.165846:0:11514:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91a85fe59200/0xa2426164df2c838a lrc: 0/0,0 mode: --/PR res: [0x200000401:0xd:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.13@tcp remote: 0x633a354aa4df500d expref: 20 pid: 5786 timeout: 476 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783441538.165865:0:11514:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff91a8439b0900) 00010000:00010000:0.0:1783441538.165870:0:11514:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff91a85eb3d000/0xa2426164df2c83c9 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783441538.165881:0:11514:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff91a85eb3d000/0xa2426164df2c83c9 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783441538.165888:0:11514:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91a85eb3d000/0xa2426164df2c83c9 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783441538.165921:0:11514:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1783441538.165991:0:11514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a87d4df800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:65454767-383a-4679-a788-eba05c6e0989+19:2355:x1870073673367680:12345-192.168.201.13@tcp:103:ldlm_bl.0 Request processed in 293us (721us total) trans 0 rc 0/0 00000100:00100000:0.0:1783441538.165998:0:11514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.13@tcp, seq: 71 00010000:00010000:3.0:1783441538.166190:0:5786:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff91a85eb3d000/0xa2426164df2c83c9 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783441538.166199:0:5786:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91a85eb3d000/0xa2426164df2c83c9 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783441538.166236:0:5786:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff91a85eb3d000/0xa2426164df2c83c9 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783441538.166245:0:5786:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff91a85eb3d000/0xa2426164df2c83c9 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783441538.166260:0:5786:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff91a85eb3d000/0xa2426164df2c83c9 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783441538.166267:0:5786:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91a85eb3d000 already unused, calling callback (ffffffffc1f9b4f0) 00010000:00010000:3.0:1783441538.166272:0:5786:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91a85eb3d000/0xa2426164df2c83c9 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783441538.166281:0:5786:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91a85eb3d000/0xa2426164df2c83c9 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783441538.166290:0:5786:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff91a8439b0900) 00010000:00010000:3.0:1783441538.166408:0:5786:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 21 00010000:00010000:3.0:1783441538.166413:0:5786:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff91a85eb3d000/0xa2426164df2c83c9 lrc: 2/0,0 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783441538.166420:0:5786:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91a85eb3d000/0xa2426164df2c83c9 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783441538.166497:0:5786:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a87d4de300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:65454767-383a-4679-a788-eba05c6e0989+18:11480:x1870073673367552:12345-192.168.201.13@tcp:55:lhsmtool_posix.0 Request processed in 8567us (8854us total) trans 0 rc -22/-22 00000100:00100000:3.0:1783441538.166507:0:5786:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.13@tcp, seq: 185 00000100:00100000:0.0:1783441538.171907:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.13@tcp (source: 12345-192.168.201.13@tcp) 00000100:00100000:3.0:1783441538.172034:0:8557:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073673367808 00000100:00100000:3.0:1783441538.172049:0:8557:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073673367808 00000100:00100000:3.0:1783441538.172137:0:8557:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.13@tcp, seq: 58 00000100:00100000:3.0:1783441538.172149:0:8557:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a859085880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:65454767-383a-4679-a788-eba05c6e0989+8:2354:x1870073673367808:12345-192.168.201.13@tcp:1:lhsmtool_posix.0 00010000:00010000:3.0:1783441538.172212:0:8557:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000c5d6d16a/0xa2426164df2c83d0 lrc: 3/1,0 mode: --/PR res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8557 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783441538.172238:0:8557:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000008550020f/0xa2426164df2c83b4 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.201.13@tcp remote: 0x633a354aa4df5029 expref: 8 pid: 6582 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783441538.172259:0:8557:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x240000400:0x5:0x0].0x0 since=1s v=(0 0) 00010000:00010000:3.0:1783441538.172264:0:8557:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1783441538.172269:0:8557:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000c5d6d16a/0xa2426164df2c83d0 lrc: 4/1,0 mode: --/PR res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8557 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783441538.172389:0:8557:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 000000008550020f/0xa2426164df2c83b4 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.201.13@tcp remote: 0x633a354aa4df5029 expref: 8 pid: 6582 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783441538.172406:0:8557:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 000000008550020f/0xa2426164df2c83b4 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.201.13@tcp remote: 0x633a354aa4df5029 expref: 8 pid: 6582 timeout: 476 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783441538.172426:0:8557:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff91a87d87ca80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:8557:1870073693288192:192.168.201.13@tcp:104: 00000100:00100000:3.0:1783441538.172543:0:8557:0:(client.c:2702:ptlrpc_set_wait()) set ffff91a848632480 going to sleep for 11 seconds 00000100:00100000:2.0:1783441538.177722:0:8557:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff91a87d87ca80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:8557:1870073693288192:192.168.201.13@tcp:104: 00010000:00010000:2.0:1783441538.177801:0:8557:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000c5d6d16a/0xa2426164df2c83d0 lrc: 3/1,0 mode: --/PR res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8557 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783441538.189180:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.13@tcp (source: 12345-192.168.201.13@tcp) 00000100:00100000:3.0:1783441538.189231:0:5769:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073673367936 00000100:00100000:3.0:1783441538.189243:0:5769:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073673367936 00010000:00010000:3.0:1783441538.200799:0:5769:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 000000008550020f/0xa2426164df2c83b4 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.201.13@tcp remote: 0x633a354aa4df5029 expref: 9 pid: 6582 timeout: 476 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783441538.201012:0:11015:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.13@tcp, seq: 72 00000100:00100000:3.0:1783441538.201033:0:11015:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a859084a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:65454767-383a-4679-a788-eba05c6e0989+9:2354:x1870073673367936:12345-192.168.201.13@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1783441538.201054:0:11015:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1783441538.201084:0:11015:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 000000008550020f/0xa2426164df2c83b4 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.201.13@tcp remote: 0x633a354aa4df5029 expref: 9 pid: 6582 timeout: 476 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783441538.201113:0:11015:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 000000008550020f/0xa2426164df2c83b4 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.201.13@tcp remote: 0x633a354aa4df5029 expref: 9 pid: 6582 timeout: 476 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783441538.201145:0:11015:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000008550020f/0xa2426164df2c83b4 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.201.13@tcp remote: 0x633a354aa4df5029 expref: 9 pid: 6582 timeout: 476 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783441538.201164:0:11015:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1783441538.201169:0:11015:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1783441538.201176:0:11015:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000c5d6d16a/0xa2426164df2c83d0 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 8557 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783441538.201186:0:11015:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000c5d6d16a/0xa2426164df2c83d0 lrc: 4/1,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 8557 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783441538.201219:0:11015:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1783441538.201356:0:11015:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a859084a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:65454767-383a-4679-a788-eba05c6e0989+8:2354:x1870073673367936:12345-192.168.201.13@tcp:103:ldlm_bl.0 Request processed in 333us (12190us total) trans 0 rc 0/0 00000100:00100000:3.0:1783441538.201364:0:11015:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.13@tcp, seq: 72 00010000:00010000:3.0:1783441538.201399:0:8557:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000c5d6d16a/0xa2426164df2c83d0 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8557 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783441538.201408:0:8557:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000c5d6d16a/0xa2426164df2c83d0 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8557 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783441538.201436:0:8557:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000c5d6d16a/0xa2426164df2c83d0 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8557 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783441538.201539:0:8557:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000c5d6d16a/0xa2426164df2c83d0 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8557 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783441538.201547:0:8557:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000c5d6d16a/0xa2426164df2c83d0 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8557 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783441538.201555:0:8557:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91a85eb3d200 already unused, calling callback (ffffffffc155ff90) 00010000:00010000:3.0:1783441538.201559:0:8557:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000c5d6d16a/0xa2426164df2c83d0 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8557 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783441538.201569:0:8557:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000c5d6d16a/0xa2426164df2c83d0 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8557 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783441538.201590:0:8557:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000c5d6d16a/0xa2426164df2c83d0 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8557 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783441538.201660:0:8557:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000c5d6d16a/0xa2426164df2c83d0 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8557 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783441538.201719:0:8557:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a859085880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:65454767-383a-4679-a788-eba05c6e0989+7:2354:x1870073673367808:12345-192.168.201.13@tcp:1:lhsmtool_posix.0 Request processed in 29573us (29830us total) trans 0 rc 0/0 00000100:00100000:3.0:1783441538.201729:0:8557:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.13@tcp, seq: 58 00000100:00100000:2.0:1783441538.209944:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.13@tcp (source: 12345-192.168.201.13@tcp) 00000100:00100000:3.0:1783441538.212657:0:5785:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073673368192 00000100:00100000:3.0:1783441538.212680:0:5785:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073673368192 00000100:00100000:3.0:1783441538.212785:0:5785:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.13@tcp, seq: 186 00000100:00100000:3.0:1783441538.212807:0:5785:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a87d4dc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:65454767-383a-4679-a788-eba05c6e0989+18:11480:x1870073673368192:12345-192.168.201.13@tcp:57:lhsmtool_posix.0 00010000:00010000:3.0:1783441538.212920:0:5785:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff91a85eb3d000/0xa2426164df2c83d7 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783441538.212942:0:5785:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91a85eb3d000/0xa2426164df2c83d7 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783441538.212954:0:5785:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91a85eb3d000/0xa2426164df2c83d7 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783441538.213203:0:5785:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff91a85eb3ce00/0xa2426164df2c83de lrc: 3/0,1 mode: --/EX res: [0x200000401:0xd:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783441538.213212:0:5785:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff91a85eaa1400/0xa2426164df2c8398 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.13@tcp remote: 0x633a354aa4df5014 expref: 19 pid: 6605 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783441538.213219:0:5785:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff91a85eb3ce00/0xa2426164df2c83de lrc: 4/0,1 mode: --/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783441538.213256:0:5785:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff91a85eaa1400/0xa2426164df2c8398 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.201.13@tcp remote: 0x633a354aa4df5014 expref: 19 pid: 6605 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783441538.213269:0:5785:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff91a85eaa1400/0xa2426164df2c8398 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.201.13@tcp remote: 0x633a354aa4df5014 expref: 19 pid: 6605 timeout: 476 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783441538.215140:0:5785:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff91a87d87ce00 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5785:1870073693288320:192.168.201.13@tcp:104: 00000100:00100000:2.0:1783441538.217027:0:5785:0:(client.c:2702:ptlrpc_set_wait()) set ffff91a848632000 going to sleep for 11 seconds 00000100:00100000:2.0:1783441538.220784:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.13@tcp (source: 12345-192.168.201.13@tcp) 00000100:00100000:3.0:1783441538.221037:0:5770:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073673368320 00000100:00100000:3.0:1783441538.221050:0:5770:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073673368320 00010000:00010000:3.0:1783441538.221100:0:5770:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff91a85eaa1400/0xa2426164df2c8398 lrc: 5/0,0 mode: CR/CR res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.201.13@tcp remote: 0x633a354aa4df5014 expref: 20 pid: 6605 timeout: 476 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783441538.221166:0:5770:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.13@tcp, seq: 73 00000100:00100000:3.0:1783441538.221177:0:5770:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a87d4dd500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:65454767-383a-4679-a788-eba05c6e0989+20:2354:x1870073673368320:12345-192.168.201.13@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1783441538.222127:0:5770:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1783441538.222153:0:5770:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff91a85eaa1400/0xa2426164df2c8398 lrc: 5/0,0 mode: CR/CR res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.201.13@tcp remote: 0x633a354aa4df5014 expref: 20 pid: 6605 timeout: 476 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783441538.222171:0:5770:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff91a85eaa1400/0xa2426164df2c8398 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.201.13@tcp remote: 0x633a354aa4df5014 expref: 20 pid: 6605 timeout: 476 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783441538.222203:0:5770:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff91a8439b0900) 00010000:00010000:3.0:1783441538.222210:0:5770:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff91a85eb3ce00/0xa2426164df2c83de lrc: 3/0,1 mode: --/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783441538.222223:0:5770:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff91a85eb3ce00/0xa2426164df2c83de lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50290000000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783441538.222231:0:5770:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91a85eb3ce00/0xa2426164df2c83de lrc: 4/0,1 mode: EX/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50290000000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783441538.222260:0:5770:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1783441538.222379:0:5770:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a87d4dd500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:65454767-383a-4679-a788-eba05c6e0989+20:2354:x1870073673368320:12345-192.168.201.13@tcp:103:ldlm_bl.0 Request processed in 1202us (1655us total) trans 0 rc 0/0 00010000:00010000:2.0:1783441538.223439:0:5773:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783441538.223855:0:5785:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91a85eaa1400/0xa2426164df2c8398 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.201.13@tcp remote: 0x633a354aa4df5014 expref: 20 pid: 6605 timeout: 476 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783441538.223881:0:5785:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff91a87d87ce00 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5785:1870073693288320:192.168.201.13@tcp:104: 00010000:00010000:2.0:1783441538.223918:0:5785:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff91a85eb3ce00/0xa2426164df2c83de lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783441538.223929:0:5785:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff91a85eb3ce00/0xa2426164df2c83de lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783441538.223935:0:5785:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91a85eb3ce00/0xa2426164df2c83de lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1783441538.224210:0:5785:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967464 00000001:00080000:2.0:1783441538.224396:0:5785:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967465 00000001:00080000:2.0:1783441538.224445:0:5785:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967466 00000100:00100000:2.0:1783441538.224588:0:5785:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff91a87d4dd180 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-mdtlov_UUID:5785:1870073693288448:0@lo:1000:mdt00_000.0 00000100:00100000:2.0:1783441538.224679:0:5785:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783441538.224724:0:5785:0:(client.c:2702:ptlrpc_set_wait()) set ffff91a867cffc00 going to sleep for 11 seconds 00000100:00100000:3.0:1783441538.225421:0:5770:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.13@tcp, seq: 73 00000100:00100000:3.0:1783441538.225482:0:5790:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073693288448 00000100:00100000:3.0:1783441538.225490:0:5790:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073693288448 00000100:00100000:2.0:1783441538.226021:0:5791:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:2.0:1783441538.226035:0:5791:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a867cd6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:5785:x1870073693288448:12345-0@lo:1000:mdt00_000.0 00000100:00100000:2.0:1783441538.226167:0:5791:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a867cd6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:5785:x1870073693288448:12345-0@lo:1000:mdt00_000.0 Request processed in 135us (1487us total) trans 0 rc 0/0 00000100:00100000:2.0:1783441538.226173:0:5791:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:3.0:1783441538.226256:0:5785:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967315 gen 2 00000004:00080000:3.0:1783441538.226264:0:5785:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff91a87d4eb800, transno 4294967315 00000100:00100000:3.0:1783441538.226291:0:5785:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff91a87d4dd180 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-mdtlov_UUID:5785:1870073693288448:0@lo:1000:mdt00_000.0 00000001:00080000:3.0:1783441538.227483:0:5785:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967467 00000100:00100000:2.0:1783441538.228011:0:5785:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff91a87d87dc00 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-mdtlov_UUID:5785:1870073693288576:0@lo:1000:mdt00_000.0 00000100:00100000:2.0:1783441538.228095:0:5785:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783441538.228178:0:5785:0:(client.c:2702:ptlrpc_set_wait()) set ffff91a8431f3000 going to sleep for 11 seconds 00000100:00100000:3.0:1783441538.228222:0:5791:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073693288576 00000100:00100000:3.0:1783441538.228229:0:5791:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073693288576 00000100:00100000:3.0:1783441538.228317:0:5791:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:3.0:1783441538.228328:0:5791:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a87d4eb800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:5785:x1870073693288576:12345-0@lo:1000:mdt00_000.0 00000100:00100000:3.0:1783441538.228610:0:5791:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a87d4eb800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:5785:x1870073693288576:12345-0@lo:1000:mdt00_000.0 Request processed in 282us (514us total) trans 4294967317 rc 0/0 00000100:00100000:3.0:1783441538.228620:0:5791:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:3.0:1783441538.229155:0:5785:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff91a87d87dc00 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-mdtlov_UUID:5785:1870073693288576:0@lo:1000:mdt00_000.0 00010000:00010000:3.0:1783441538.229205:0:5785:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff91a85eb3ce00/0xa2426164df2c83de lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783441538.229216:0:5785:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff91a85eb3ce00/0xa2426164df2c83de lrc: 2/0,0 mode: EX/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783441538.229224:0:5785:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff91a85eb3ce00/0xa2426164df2c83de lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783441538.229232:0:5785:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91a85eb3ce00 already unused, calling callback (ffffffffc1f9b4f0) 00010000:00010000:3.0:1783441538.229237:0:5785:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91a85eb3ce00/0xa2426164df2c83de lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783441538.229246:0:5785:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91a85eb3ce00/0xa2426164df2c83de lrc: 4/0,0 mode: EX/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783441538.229266:0:5785:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff91a8439b0900) 00010000:00010000:3.0:1783441538.229269:0:5785:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1783441538.229275:0:5785:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff91a85eb3ce00/0xa2426164df2c83de lrc: 2/0,0 mode: --/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783441538.229288:0:5785:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91a85eb3ce00/0xa2426164df2c83de lrc: 0/0,0 mode: --/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783441538.229324:0:5785:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff91a85eaa0200/0xa2426164df2c8313 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783441538.229330:0:5785:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff91a85eaa0200/0xa2426164df2c8313 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783441538.229337:0:5785:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff91a85eaa0200/0xa2426164df2c8313 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783441538.229343:0:5785:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91a85eaa0200 already unused, calling callback (ffffffffc1f9b4f0) 00010000:00010000:3.0:1783441538.229346:0:5785:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91a85eaa0200/0xa2426164df2c8313 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783441538.229351:0:5785:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91a85eaa0200/0xa2426164df2c8313 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783441538.229358:0:5785:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff91a8429bd900) 00010000:00010000:3.0:1783441538.229360:0:5785:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1783441538.229363:0:5785:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff91a85eaa0200/0xa2426164df2c8313 lrc: 2/0,0 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783441538.229368:0:5785:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91a85eaa0200/0xa2426164df2c8313 lrc: 0/0,0 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783441538.229395:0:5785:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff91a85eb3d200/0xa2426164df2c83e5 lrc: 3/0,1 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783441538.229411:0:5785:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff91a85eaa1800/0xa2426164df2c832f lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.13@tcp remote: 0x633a354aa4df4ff8 expref: 22 pid: 6605 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783441538.229425:0:5785:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff91a85eb3d200/0xa2426164df2c83e5 lrc: 4/0,1 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783441538.229462:0:5785:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff91a85eaa1800/0xa2426164df2c832f lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.13@tcp remote: 0x633a354aa4df4ff8 expref: 22 pid: 6605 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783441538.229479:0:5785:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff91a85eaa1800/0xa2426164df2c832f lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.13@tcp remote: 0x633a354aa4df4ff8 expref: 22 pid: 6605 timeout: 476 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783441538.229493:0:5785:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff91a87d87ce00 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5785:1870073693288704:192.168.201.13@tcp:104: 00000100:00100000:3.0:1783441538.230034:0:5785:0:(client.c:2702:ptlrpc_set_wait()) set ffff91a848897600 going to sleep for 11 seconds 00000100:00100000:2.0:1783441538.237591:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.13@tcp (source: 12345-192.168.201.13@tcp) 00000100:00100000:0.0:1783441538.237846:0:11514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073673368448 00000100:00100000:0.0:1783441538.237859:0:11514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073673368448 00010000:00010000:0.0:1783441538.237912:0:11514:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff91a85eaa1800/0xa2426164df2c832f lrc: 5/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.13@tcp remote: 0x633a354aa4df4ff8 expref: 23 pid: 6605 timeout: 476 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783441538.237972:0:11514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.13@tcp, seq: 74 00000100:00100000:0.0:1783441538.237984:0:11514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a846f24a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:65454767-383a-4679-a788-eba05c6e0989+23:2355:x1870073673368448:12345-192.168.201.13@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1783441538.238003:0:11514:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1783441538.238010:0:11514:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff91a85eaa1800/0xa2426164df2c832f lrc: 5/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.13@tcp remote: 0x633a354aa4df4ff8 expref: 23 pid: 6605 timeout: 476 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783441538.238025:0:11514:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff91a85eaa1800/0xa2426164df2c832f lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.13@tcp remote: 0x633a354aa4df4ff8 expref: 23 pid: 6605 timeout: 476 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783441538.238054:0:11514:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff91a8429bd900) 00010000:00010000:0.0:1783441538.238060:0:11514:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff91a85eb3d200/0xa2426164df2c83e5 lrc: 3/0,1 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783441538.238071:0:11514:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff91a85eb3d200/0xa2426164df2c83e5 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783441538.238079:0:11514:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91a85eb3d200/0xa2426164df2c83e5 lrc: 4/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783441538.238102:0:11514:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1783441538.238168:0:11514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a846f24a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:65454767-383a-4679-a788-eba05c6e0989+23:2355:x1870073673368448:12345-192.168.201.13@tcp:103:ldlm_bl.0 Request processed in 187us (606us total) trans 0 rc 0/0 00000100:00100000:0.0:1783441538.238177:0:11514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.13@tcp, seq: 74 00010000:00010000:3.0:1783441538.239557:0:5785:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91a85eaa1800/0xa2426164df2c832f lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.13@tcp remote: 0x633a354aa4df4ff8 expref: 22 pid: 6605 timeout: 476 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783441538.239591:0:5785:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff91a87d87ce00 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5785:1870073693288704:192.168.201.13@tcp:104: 00010000:00010000:3.0:1783441538.239754:0:5785:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff91a85eb3d200/0xa2426164df2c83e5 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783441538.239881:0:5785:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff91a85eb3d200/0xa2426164df2c83e5 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783441538.239890:0:5785:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91a85eb3d200/0xa2426164df2c83e5 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783441538.239906:0:5785:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff91a85eb3d200/0xa2426164df2c83e5 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783441538.239922:0:5785:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff91a85eb3d200/0xa2426164df2c83e5 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783441538.239929:0:5785:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff91a85eb3d200/0xa2426164df2c83e5 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783441538.239936:0:5785:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91a85eb3d200 already unused, calling callback (ffffffffc1f9b4f0) 00010000:00010000:2.0:1783441538.239941:0:5785:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91a85eb3d200/0xa2426164df2c83e5 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783441538.239960:0:5785:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91a85eb3d200/0xa2426164df2c83e5 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783441538.239977:0:5785:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff91a8429bd900) 00010000:00010000:2.0:1783441538.239981:0:5785:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1783441538.239986:0:5785:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff91a85eb3d200/0xa2426164df2c83e5 lrc: 2/0,0 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783441538.239992:0:5785:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91a85eb3d200/0xa2426164df2c83e5 lrc: 0/0,0 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783441538.240004:0:5785:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff91a85eb3d000/0xa2426164df2c83d7 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783441538.240010:0:5785:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff91a85eb3d000/0xa2426164df2c83d7 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783441538.240017:0:5785:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff91a85eb3d000/0xa2426164df2c83d7 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783441538.240022:0:5785:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91a85eb3d000 already unused, calling callback (ffffffffc1f9b4f0) 00010000:00010000:2.0:1783441538.240025:0:5785:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91a85eb3d000/0xa2426164df2c83d7 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783441538.240031:0:5785:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91a85eb3d000/0xa2426164df2c83d7 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783441538.240038:0:5785:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff91a8429bd900) 00010000:00010000:2.0:1783441538.240040:0:5785:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:2.0:1783441538.240043:0:5785:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff91a85eb3d000/0xa2426164df2c83d7 lrc: 2/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783441538.240058:0:5785:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91a85eb3d000/0xa2426164df2c83d7 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783441538.240377:0:5785:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a87d4dc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:65454767-383a-4679-a788-eba05c6e0989+21:11480:x1870073673368192:12345-192.168.201.13@tcp:57:lhsmtool_posix.0 Request processed in 27569us (30446us total) trans 4294967468 rc 0/0 00000100:00100000:2.0:1783441538.240388:0:5785:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.13@tcp, seq: 186 00000020:00080000:2.0:1783441538.240395:0:5785:0:(tgt_main.c:784:tgt_ses_key_exit()) total 5 transactions per RPC 00000040:00080000:3.0:1783441538.243522:0:11531:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:3.0:1783441538.243536:0:11531:0:(llog_cat.c:841:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000100:00100000:0.0:1783441538.245038:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.13@tcp (source: 12345-192.168.201.13@tcp) 00000040:00080000:3.0:1783441538.245148:0:11531:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 64768 count 2 00000040:00080000:3.0:1783441538.245162:0:11531:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:2.0:1783441538.246124:0:5789:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073673368704 00000100:00100000:2.0:1783441538.246140:0:5789:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073673368704 00000100:00100000:2.0:1783441538.246225:0:5789:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.13@tcp, seq: 50 00000100:00100000:2.0:1783441538.246237:0:5789:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a846866850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:65454767-383a-4679-a788-eba05c6e0989+21:11480:x1870073673368704:12345-192.168.201.13@tcp:35:lhsmtool_posix.0 00000004:00080000:2.0:1783441538.248255:0:5789:0:(mdd_object.c:4010:mdd_close()) Object [0x200000401:0xd:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000001:00080000:2.0:1783441538.248399:0:5789:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967469 00010000:00010000:2.0:1783441538.248484:0:5789:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff91a85eaa1400/0xa2426164df2c83ec lrc: 3/0,1 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5789 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783441538.249145:0:5789:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91a85eaa1400/0xa2426164df2c83ec lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010080000000 pid: 5789 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783441538.249164:0:5789:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91a85eaa1400/0xa2426164df2c83ec lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010080000000 pid: 5789 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783441538.249175:0:5789:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff91a85eaa1400/0xa2426164df2c83ec lrc: 4/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010080000000 pid: 5789 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783441538.249182:0:5789:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff91a85eaa1400/0xa2426164df2c83ec lrc: 4/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010480000000 pid: 5789 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783441538.249189:0:5789:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff91a85eaa1400/0xa2426164df2c83ec lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010480000000 pid: 5789 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783441538.249230:0:5789:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1783441538.249372:0:5772:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1783441538.249381:0:5772:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff91a85eaa1400/0xa2426164df2c83ec lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5789 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783441538.249387:0:5789:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a846866850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:65454767-383a-4679-a788-eba05c6e0989+23:11480:x1870073673368704:12345-192.168.201.13@tcp:35:lhsmtool_posix.0 Request processed in 3145us (4352us total) trans 4294967470 rc 0/0 00010000:00010000:1.0:1783441538.249389:0:5772:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91a85eaa1400 already unused, calling callback (ffffffffc155ff90) 00010000:00010000:1.0:1783441538.249394:0:5772:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91a85eaa1400/0xa2426164df2c83ec lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5789 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783441538.249399:0:5789:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.13@tcp, seq: 50 00000020:00080000:2.0:1783441538.249406:0:5789:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:1.0:1783441538.249408:0:5772:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91a85eaa1400/0xa2426164df2c83ec lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 5789 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783441538.249425:0:5772:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff91a8429bd900) 00010000:00010000:1.0:1783441538.249428:0:5772:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:1.0:1783441538.249433:0:5772:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff91a85eaa1400/0xa2426164df2c83ec lrc: 1/0,0 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5789 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783441538.249439:0:5772:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91a85eaa1400/0xa2426164df2c83ec lrc: 0/0,0 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5789 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783441538.249457:0:5772:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783441538.249459:0:5772:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783441538.249460:0:5772:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:2.0:1783441538.411647:0:12305:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:2.0:1783441538.411659:0:12305:0:(llog_cat.c:841:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1783441538.411723:0:12305:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 5 count 2 00000040:00080000:2.0:1783441538.411730:0:12305:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:3.0:1783441538.416392:0:3306:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff91a87d87ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:6c1ddb50-5795-40c6-a2b6-8f58add9da62:3306:1870073693288832:0@lo:400:kworker.0 00000100:00100000:3.0:1783441538.416497:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783441538.416566:0:3306:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff91a745900000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3306:1870073693289344:0@lo:400:kworker.0 00000100:00100000:3.0:1783441538.418398:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783441538.418468:0:3306:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1783441538.418480:0:3306:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff91a745903800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3306:1870073693289216:0@lo:400:kworker.0 00000100:00100000:1.0:1783441538.418976:0:6582:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073693289344 00000100:00100000:1.0:1783441538.418988:0:6582:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073693289344 00000100:00100000:1.0:1783441538.419056:0:6582:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 96 00000100:00100000:1.0:1783441538.419069:0:6582:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a745902a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:3306:x1870073693289344:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1783441538.419738:0:3303:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff91a87d87ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3303:1870073693288960:0@lo:400:kworker.0 00000100:00100000:1.0:1783441538.424666:0:6582:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a745902a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:3306:x1870073693289344:12345-0@lo:400:kworker.0 Request processed in 5586us (6257us total) trans 0 rc 0/0 00000100:00100000:1.0:1783441538.424698:0:6582:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 96 00000100:00100000:2.0:1783441538.428229:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783441538.428309:0:3303:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1783441538.428325:0:3303:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff91a87d4dd180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3303:1870073693289088:0@lo:400:kworker.0 00000100:00100000:2.0:1783441538.428508:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783441538.428587:0:6605:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073693288960 00000100:00100000:2.0:1783441538.428597:0:6605:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073693288960 00000100:00100000:2.0:1783441538.428656:0:6605:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073693289088 00000100:00100000:2.0:1783441538.428659:0:6605:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073693289088 00000100:00080000:0.0:1783441538.428698:0:5781:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1783441538.428703:0:6605:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 169 00000100:00100000:2.0:1783441538.428713:0:6605:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a846f24700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3303:x1870073693288960:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1783441538.428817:0:6605:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a846f24700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3303:x1870073693288960:12345-0@lo:400:kworker.0 Request processed in 105us (599us total) trans 0 rc 0/0 00000100:00100000:2.0:1783441538.428825:0:6605:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 169 00000100:00100000:2.0:1783441538.428845:0:6605:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 170 00000100:00100000:2.0:1783441538.428851:0:6605:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a846f26680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3303:x1870073693289088:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1783441538.428879:0:6605:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a846f26680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3303:x1870073693289088:12345-0@lo:400:kworker.0 Request processed in 28us (371us total) trans 0 rc 0/0 00000100:00100000:2.0:1783441538.428892:0:6605:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 170 00000100:00100000:2.0:1783441538.429089:0:3303:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff91a87d4dd180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3303:1870073693289088:0@lo:400:kworker.0 00000100:00100000:2.0:1783441538.429102:0:3303:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff91a87d87ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3303:1870073693288960:0@lo:400:kworker.0 00000100:00100000:2.0:1783441538.429175:0:5778:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073693288832 00000100:00100000:2.0:1783441538.429180:0:5778:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073693288832 00000100:00100000:2.0:1783441538.429208:0:5778:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 298 00000100:00100000:2.0:1783441538.429214:0:5778:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a848f36850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6c1ddb50-5795-40c6-a2b6-8f58add9da62+19:3306:x1870073693288832:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1783441538.429265:0:5778:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a848f36850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6c1ddb50-5795-40c6-a2b6-8f58add9da62+19:3306:x1870073693288832:12345-0@lo:400:kworker.0 Request processed in 51us (12768us total) trans 0 rc 0/0 00000100:00100000:2.0:1783441538.429271:0:5778:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 298 00000100:00100000:3.0:1783441538.436932:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783441538.437035:0:3306:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff91a87d87ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:6c1ddb50-5795-40c6-a2b6-8f58add9da62:3306:1870073693288832:0@lo:400:kworker.0 00000100:00100000:3.0:1783441538.437059:0:3306:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff91a745900000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3306:1870073693289344:0@lo:400:kworker.0 00000100:00100000:0.0:1783441538.438126:0:6605:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073693289216 00000100:00100000:0.0:1783441538.438142:0:6605:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073693289216 00000100:00080000:1.0:1783441538.438252:0:5781:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1783441538.438263:0:6605:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 171 00000100:00100000:0.0:1783441538.438274:0:6605:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a87d6a1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3306:x1870073693289216:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1783441538.438943:0:6605:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a87d6a1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3306:x1870073693289216:12345-0@lo:400:kworker.0 Request processed in 669us (2019us total) trans 0 rc 0/0 00000100:00100000:0.0:1783441538.438952:0:6605:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 171 00000100:00100000:1.0:1783441538.442200:0:3306:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff91a745903800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3306:1870073693289216:0@lo:400:kworker.0 00000100:00100000:1.0:1783441538.569651:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.13@tcp (source: 12345-192.168.201.13@tcp) 00000100:00100000:3.0:1783441538.569888:0:5785:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073673368960 00000100:00100000:3.0:1783441538.569902:0:5785:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073673368960 00000100:00100000:3.0:1783441538.569981:0:5785:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.13@tcp, seq: 187 00000100:00100000:3.0:1783441538.569994:0:5785:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a745904000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:65454767-383a-4679-a788-eba05c6e0989+23:11490:x1870073673368960:12345-192.168.201.13@tcp:101:lfs.0 00010000:00010000:3.0:1783441538.570031:0:5785:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1783441538.570060:0:5785:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91a85eb3ce00/0xa2426164df2c83f3 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x633a354aa4df5030 expref: -99 pid: 5785 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783441538.570514:0:5785:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff91a85eb3c200/0xa2426164df2c83fa lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783441538.570530:0:5785:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91a85eb3c200/0xa2426164df2c83fa lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783441538.570543:0:5785:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91a85eb3c200/0xa2426164df2c83fa lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1783441538.570555:0:5785:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xa:0x0]: returning size 7680 00010000:00010000:3.0:1783441538.570894:0:5785:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91a85eb3ce00/0xa2426164df2c83f3 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.13@tcp remote: 0x633a354aa4df5030 expref: 26 pid: 5785 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783441538.570916:0:5785:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff91a85eb3c200/0xa2426164df2c83fa lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.13@tcp remote: 0x633a354aa4df5030 expref: 25 pid: 5785 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783441538.570935:0:5785:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff91a8429bdc00) 00010000:00010000:3.0:1783441538.570939:0:5785:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:3.0:1783441538.570943:0:5785:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91a85eb3c200, rc 0) 00000100:00100000:3.0:1783441538.571066:0:5785:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a745904000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:65454767-383a-4679-a788-eba05c6e0989+25:11490:x1870073673368960:12345-192.168.201.13@tcp:101:lfs.0 Request processed in 1074us (1429us total) trans 4294967471 rc 0/0 00000100:00100000:3.0:1783441538.571074:0:5785:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.13@tcp, seq: 187 00000100:00100000:0.0:1783441538.580043:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.13@tcp (source: 12345-192.168.201.13@tcp) 00000100:00100000:3.0:1783441538.580148:0:5787:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073673369088 00000100:00100000:3.0:1783441538.580161:0:5787:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073673369088 00000100:00100000:3.0:1783441538.580237:0:5787:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.13@tcp, seq: 188 00000100:00100000:3.0:1783441538.580257:0:5787:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a859085180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:65454767-383a-4679-a788-eba05c6e0989+25:11490:x1870073673369088:12345-192.168.201.13@tcp:34:lfs.0 00010000:00010000:3.0:1783441538.580362:0:5787:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff91a85eb3d600/0xa2426164df2c8408 lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783441538.580384:0:5787:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91a85eb3d600/0xa2426164df2c8408 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783441538.580517:0:5787:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91a85eb3d600/0xa2426164df2c8408 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783441538.580538:0:5787:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff91a85eb3d000/0xa2426164df2c840f lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783441538.580547:0:5787:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91a85eb3d000/0xa2426164df2c840f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783441538.580554:0:5787:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91a85eb3d000/0xa2426164df2c840f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783441538.580966:0:5787:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff91a85eb3d200/0xa2426164df2c8416 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783441538.580976:0:5787:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91a85eb3d200/0xa2426164df2c8416 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783441538.580983:0:5787:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91a85eb3d200/0xa2426164df2c8416 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1783441538.581032:0:5787:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff91a85eb3d200/0xa2426164df2c8416 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783441538.581047:0:5787:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff91a85eb3d600/0xa2426164df2c8408 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783441538.581320:0:5787:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff91a85eb3d600/0xa2426164df2c8408 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783441538.581330:0:5787:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff91a85eb3d600/0xa2426164df2c8408 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783441538.581337:0:5787:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91a85eb3d600 already unused, calling callback (ffffffffc1f9b4f0) 00010000:00010000:3.0:1783441538.581342:0:5787:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91a85eb3d600/0xa2426164df2c8408 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783441538.581351:0:5787:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91a85eb3d600/0xa2426164df2c8408 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783441538.581366:0:5787:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff91a8429bdc00) 00010000:00010000:3.0:1783441538.581369:0:5787:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1783441538.581375:0:5787:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff91a85eb3d600/0xa2426164df2c8408 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783441538.582322:0:5787:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91a85eb3d600/0xa2426164df2c8408 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783441538.582345:0:5787:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff91a85eb3d000/0xa2426164df2c840f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783441538.582351:0:5787:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff91a85eb3d000/0xa2426164df2c840f lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783441538.582358:0:5787:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff91a85eb3d000/0xa2426164df2c840f lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783441538.582364:0:5787:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91a85eb3d000 already unused, calling callback (ffffffffc1f9b4f0) 00010000:00010000:3.0:1783441538.582367:0:5787:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91a85eb3d000/0xa2426164df2c840f lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783441538.582374:0:5787:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91a85eb3d000/0xa2426164df2c840f lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783441538.582387:0:5787:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff91a85faeec00) 00010000:00010000:3.0:1783441538.582464:0:5787:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1783441538.582469:0:5787:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff91a85eb3d000/0xa2426164df2c840f lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783441538.582476:0:5787:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91a85eb3d000/0xa2426164df2c840f lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783441538.582495:0:5787:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff91a85eb3d200/0xa2426164df2c8416 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783441538.582500:0:5787:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff91a85eb3d200/0xa2426164df2c8416 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783441538.582511:0:5787:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff91a85eb3d200/0xa2426164df2c8416 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783441538.582517:0:5787:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91a85eb3d200 already unused, calling callback (ffffffffc1f9b4f0) 00010000:00010000:3.0:1783441538.582520:0:5787:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91a85eb3d200/0xa2426164df2c8416 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783441538.582526:0:5787:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91a85eb3d200/0xa2426164df2c8416 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783441538.582534:0:5787:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff91a85faee600) 00010000:00010000:3.0:1783441538.582537:0:5787:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1783441538.582539:0:5787:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff91a85eb3d200/0xa2426164df2c8416 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783441538.582546:0:5787:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91a85eb3d200/0xa2426164df2c8416 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783441538.582672:0:5787:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a859085180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:65454767-383a-4679-a788-eba05c6e0989+25:11490:x1870073673369088:12345-192.168.201.13@tcp:34:lfs.0 Request processed in 2419us (2636us total) trans 0 rc 0/0 00000100:00100000:3.0:1783441538.582685:0:5787:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.13@tcp, seq: 188 00000100:00100000:1.0:1783441538.640202:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.13@tcp (source: 12345-192.168.201.13@tcp) 00000100:00100000:3.0:1783441538.640400:0:5786:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073673369344 00000100:00100000:3.0:1783441538.640415:0:5786:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073673369344 00000100:00100000:3.0:1783441538.640484:0:5786:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.13@tcp, seq: 189 00000100:00100000:3.0:1783441538.640495:0:5786:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a87d6f0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:65454767-383a-4679-a788-eba05c6e0989+25:11493:x1870073673369344:12345-192.168.201.13@tcp:101:lfs.0 00010000:00010000:3.0:1783441538.640523:0:5786:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1783441538.640548:0:5786:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91a85eb3da00/0xa2426164df2c841d lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x633a354aa4df5037 expref: -99 pid: 5786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783441538.640673:0:5786:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff91a85eb3d200/0xa2426164df2c8424 lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783441538.640692:0:5786:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91a85eb3d200/0xa2426164df2c8424 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783441538.640705:0:5786:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91a85eb3d200/0xa2426164df2c8424 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783441538.640720:0:5786:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff91a85eb3d000/0xa2426164df2c842b lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783441538.640727:0:5786:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91a85eb3d000/0xa2426164df2c842b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783441538.640733:0:5786:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91a85eb3d000/0xa2426164df2c842b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783441538.641448:0:5786:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff91a85eb3d600/0xa2426164df2c8432 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783441538.641460:0:5786:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91a85eb3d600/0xa2426164df2c8432 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783441538.641470:0:5786:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91a85eb3d600/0xa2426164df2c8432 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1783441538.641482:0:5786:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 9 00010000:00010000:3.0:1783441538.641605:0:5786:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff91a85eb3d200/0xa2426164df2c8424 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783441538.641613:0:5786:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff91a85eb3d200/0xa2426164df2c8424 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783441538.641626:0:5786:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff91a85eb3d200/0xa2426164df2c8424 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783441538.641633:0:5786:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91a85eb3d200 already unused, calling callback (ffffffffc1f9b4f0) 00010000:00010000:3.0:1783441538.641638:0:5786:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91a85eb3d200/0xa2426164df2c8424 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783441538.641647:0:5786:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91a85eb3d200/0xa2426164df2c8424 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783441538.641662:0:5786:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff91a8429bdc00) 00010000:00010000:3.0:1783441538.641665:0:5786:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1783441538.641670:0:5786:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff91a85eb3d200/0xa2426164df2c8424 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783441538.641676:0:5786:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91a85eb3d200/0xa2426164df2c8424 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783441538.641687:0:5786:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff91a85eb3d000/0xa2426164df2c842b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783441538.641694:0:5786:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff91a85eb3d000/0xa2426164df2c842b lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783441538.641699:0:5786:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff91a85eb3d000/0xa2426164df2c842b lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783441538.641703:0:5786:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91a85eb3d000 already unused, calling callback (ffffffffc1f9b4f0) 00010000:00010000:3.0:1783441538.641706:0:5786:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91a85eb3d000/0xa2426164df2c842b lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783441538.641720:0:5786:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91a85eb3d000/0xa2426164df2c842b lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783441538.641728:0:5786:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff91a85faee600) 00010000:00010000:3.0:1783441538.641730:0:5786:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1783441538.641733:0:5786:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff91a85eb3d000/0xa2426164df2c842b lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783441538.641817:0:5786:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91a85eb3d000/0xa2426164df2c842b lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783441538.641873:0:5786:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91a85eb3da00/0xa2426164df2c841d lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.13@tcp remote: 0x633a354aa4df5037 expref: 28 pid: 5786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783441538.641888:0:5786:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff91a85eb3d600/0xa2426164df2c8432 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.13@tcp remote: 0x633a354aa4df5037 expref: 27 pid: 5786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783441538.641896:0:5786:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff91a85faeec00) 00010000:00010000:3.0:1783441538.641898:0:5786:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1783441538.641900:0:5786:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91a85eb3d600, rc 0) 00000100:00100000:3.0:1783441538.641982:0:5786:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a87d6f0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:65454767-383a-4679-a788-eba05c6e0989+27:11493:x1870073673369344:12345-192.168.201.13@tcp:101:lfs.0 Request processed in 1489us (1791us total) trans 4294967472 rc 0/0 00000100:00100000:3.0:1783441538.641991:0:5786:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.13@tcp, seq: 189 00000100:00100000:3.0:1783441538.646642:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.13@tcp (source: 12345-192.168.201.13@tcp) 00000100:00100000:0.0:1783441538.646735:0:5787:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073673369472 00000100:00100000:0.0:1783441538.646765:0:5787:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073673369472 00000100:00100000:0.0:1783441538.646842:0:5787:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.13@tcp, seq: 190 00000100:00100000:0.0:1783441538.646852:0:5787:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a745903800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:65454767-383a-4679-a788-eba05c6e0989+27:11493:x1870073673369472:12345-192.168.201.13@tcp:54:lfs.0 00010000:00010000:0.0:1783441538.646945:0:5787:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff91a85fe58e00/0xa2426164df2c8440 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783441538.646975:0:5787:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91a85fe58e00/0xa2426164df2c8440 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783441538.646990:0:5787:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91a85fe58e00/0xa2426164df2c8440 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783441538.647022:0:5787:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff91a85fe58e00/0xa2426164df2c8440 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783441538.647029:0:5787:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff91a85fe58e00/0xa2426164df2c8440 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783441538.647036:0:5787:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff91a85fe58e00/0xa2426164df2c8440 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783441538.647041:0:5787:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91a85fe58e00 already unused, calling callback (ffffffffc1f9b4f0) 00010000:00010000:0.0:1783441538.647046:0:5787:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91a85fe58e00/0xa2426164df2c8440 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783441538.647075:0:5787:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91a85fe58e00/0xa2426164df2c8440 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783441538.647090:0:5787:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff91a85faeec00) 00010000:00010000:0.0:1783441538.647093:0:5787:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1783441538.647097:0:5787:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff91a85fe58e00/0xa2426164df2c8440 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783441538.647103:0:5787:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91a85fe58e00/0xa2426164df2c8440 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783441538.647191:0:5787:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a745903800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:65454767-383a-4679-a788-eba05c6e0989+27:11493:x1870073673369472:12345-192.168.201.13@tcp:54:lfs.0 Request processed in 340us (564us total) trans 0 rc 0/0 00000100:00100000:0.0:1783441538.647200:0:5787:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.13@tcp, seq: 190 00000100:00100000:3.0:1783441538.657001:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.13@tcp (source: 12345-192.168.201.13@tcp) 00000100:00100000:3.0:1783441538.657056:0:5788:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073673369728 00000100:00100000:3.0:1783441538.657069:0:5788:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073673369728 00000100:00100000:3.0:1783441538.657142:0:5788:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.13@tcp, seq: 51 00000100:00100000:3.0:1783441538.657167:0:5788:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a745900000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:65454767-383a-4679-a788-eba05c6e0989+27:11493:x1870073673369728:12345-192.168.201.13@tcp:35:lfs.0 00000100:00100000:3.0:1783441538.657487:0:5788:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a745900000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:65454767-383a-4679-a788-eba05c6e0989+28:11493:x1870073673369728:12345-192.168.201.13@tcp:35:lfs.0 Request processed in 322us (500us total) trans 4294967473 rc 0/0 00000100:00100000:3.0:1783441538.657496:0:5788:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.13@tcp, seq: 51 00000100:00100000:2.0:1783441538.705625:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.13@tcp (source: 12345-192.168.201.13@tcp) 00000100:00100000:0.0:1783441538.705776:0:5785:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073673369984 00000100:00100000:0.0:1783441538.705792:0:5785:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073673369984 00000100:00100000:0.0:1783441538.705878:0:5785:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.13@tcp, seq: 191 00000100:00100000:0.0:1783441538.705889:0:5785:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a846f27480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:65454767-383a-4679-a788-eba05c6e0989+28:11028:x1870073673369984:12345-192.168.201.13@tcp:101:bash.0 00010000:00010000:0.0:1783441538.705924:0:5785:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1783441538.705962:0:5785:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91a85fe58e00/0xa2426164df2c8447 lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x633a354aa4df503e expref: -99 pid: 5785 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783441538.706098:0:5785:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff91a85fe58800/0xa2426164df2c844e lrc: 3/0,1 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783441538.706114:0:5785:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff91a85eb3d600/0xa2426164df2c8432 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.13@tcp remote: 0x633a354aa4df5037 expref: 29 pid: 5786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783441538.706123:0:5785:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff91a85fe58800/0xa2426164df2c844e lrc: 4/0,1 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783441538.706180:0:5785:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff91a85eb3d600/0xa2426164df2c8432 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.13@tcp remote: 0x633a354aa4df5037 expref: 29 pid: 5786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783441538.706194:0:5785:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff91a85eb3d600/0xa2426164df2c8432 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.13@tcp remote: 0x633a354aa4df5037 expref: 29 pid: 5786 timeout: 476 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783441538.706209:0:5785:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff91a859086a00 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5785:1870073693289472:192.168.201.13@tcp:104: 00000100:00100000:0.0:1783441538.706319:0:5785:0:(client.c:2702:ptlrpc_set_wait()) set ffff91a87d800000 going to sleep for 11 seconds 00000100:00100000:0.0:1783441538.711795:0:5785:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff91a859086a00 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5785:1870073693289472:192.168.201.13@tcp:104: 00010000:00010000:0.0:1783441538.711839:0:5785:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff91a85fe58800/0xa2426164df2c844e lrc: 3/0,1 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783441538.713438:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.13@tcp (source: 12345-192.168.201.13@tcp) 00000100:00100000:3.0:1783441538.713716:0:5769:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073673370112 00000100:00100000:3.0:1783441538.713728:0:5769:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073673370112 00010000:00010000:3.0:1783441538.713831:0:5769:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff91a85eb3d600/0xa2426164df2c8432 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.13@tcp remote: 0x633a354aa4df5037 expref: 30 pid: 5786 timeout: 476 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783441538.713875:0:5769:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.13@tcp, seq: 75 00000100:00100000:3.0:1783441538.713888:0:5769:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a846f27100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:65454767-383a-4679-a788-eba05c6e0989+30:2354:x1870073673370112:12345-192.168.201.13@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1783441538.713906:0:5769:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1783441538.713914:0:5769:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff91a85eb3d600/0xa2426164df2c8432 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.13@tcp remote: 0x633a354aa4df5037 expref: 30 pid: 5786 timeout: 476 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783441538.713929:0:5769:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff91a85eb3d600/0xa2426164df2c8432 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.13@tcp remote: 0x633a354aa4df5037 expref: 30 pid: 5786 timeout: 476 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783441538.713957:0:5769:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91a85eb3d600/0xa2426164df2c8432 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.13@tcp remote: 0x633a354aa4df5037 expref: 30 pid: 5786 timeout: 476 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783441538.713978:0:5769:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff91a85faeec00) 00010000:00010000:3.0:1783441538.713984:0:5769:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff91a85fe58800/0xa2426164df2c844e lrc: 3/0,1 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783441538.713995:0:5769:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff91a85fe58800/0xa2426164df2c844e lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783441538.714026:0:5769:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91a85fe58800/0xa2426164df2c844e lrc: 4/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783441538.714054:0:5769:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1783441538.714124:0:5769:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a846f27100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:65454767-383a-4679-a788-eba05c6e0989+29:2354:x1870073673370112:12345-192.168.201.13@tcp:103:ldlm_bl.0 Request processed in 238us (695us total) trans 0 rc 0/0 00000100:00100000:3.0:1783441538.714132:0:5769:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.13@tcp, seq: 75 00010000:00010000:0.0:1783441538.714327:0:5785:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff91a85fe58800/0xa2426164df2c844e lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783441538.714338:0:5785:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91a85fe58800/0xa2426164df2c844e lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1783441538.714365:0:5785:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 9 00010000:00010000:0.0:1783441538.714591:0:5785:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91a85fe58e00/0xa2426164df2c8447 lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.13@tcp remote: 0x633a354aa4df503e expref: 30 pid: 5785 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783441538.714611:0:5785:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff91a85fe58800/0xa2426164df2c844e lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.13@tcp remote: 0x633a354aa4df503e expref: 29 pid: 5785 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783441538.714618:0:5785:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff91a85faeec00) 00010000:00010000:0.0:1783441538.714621:0:5785:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:0.0:1783441538.714631:0:5785:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91a85fe58800, rc 0) 00000100:00100000:0.0:1783441538.714669:0:5785:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a846f27480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:65454767-383a-4679-a788-eba05c6e0989+29:11028:x1870073673369984:12345-192.168.201.13@tcp:101:bash.0 Request processed in 8782us (9059us total) trans 4294967474 rc 0/0 00000100:00100000:0.0:1783441538.714677:0:5785:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.13@tcp, seq: 191 00000100:00100000:2.0:1783441538.720492:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.13@tcp (source: 12345-192.168.201.13@tcp) 00000100:00100000:0.0:1783441538.720553:0:5787:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073673370368 00000100:00100000:0.0:1783441538.720568:0:5787:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073673370368 00000100:00100000:0.0:1783441538.720660:0:5787:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.13@tcp, seq: 192 00000100:00100000:0.0:1783441538.720673:0:5787:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a87d87ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:65454767-383a-4679-a788-eba05c6e0989+29:11028:x1870073673370368:12345-192.168.201.13@tcp:36:bash.0 00010000:00010000:0.0:1783441538.721258:0:5787:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff91a85fe59000/0xa2426164df2c845c lrc: 3/0,1 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783441538.721282:0:5787:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91a85fe59000/0xa2426164df2c845c lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783441538.721297:0:5787:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91a85fe59000/0xa2426164df2c845c lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1783441538.721361:0:5787:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967475 00000004:00010000:0.0:1783441538.721390:0:5787:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 000000002f2969e9 reply state 000000009f8eee9d transno 4294967476 ns: mdt-lustre-MDT0000_UUID lock: ffff91a85fe59000/0xa2426164df2c845c lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783441538.721399:0:5787:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000001:00080000:0.0:1783441538.721454:0:5787:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967476 00000100:00100000:0.0:1783441538.721856:0:5787:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a87d87ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:65454767-383a-4679-a788-eba05c6e0989+33:11028:x1870073673370368:12345-192.168.201.13@tcp:36:bash.0 Request processed in 1183us (1376us total) trans 4294967477 rc 0/0 00000100:00100000:0.0:1783441538.721867:0:5787:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.13@tcp, seq: 192 00000020:00080000:0.0:1783441538.721873:0:5787:0:(tgt_main.c:784:tgt_ses_key_exit()) total 3 transactions per RPC 00000100:00100000:3.0:1783441538.724408:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.13@tcp (source: 12345-192.168.201.13@tcp) 00010000:00010000:0.0:1783441538.724660:0:3290:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff91a85fe59000/0xa2426164df2c845c lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783441538.724675:0:3290:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff91a85fe59000/0xa2426164df2c845c lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783441538.724703:0:3290:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff91a85fe59000/0xa2426164df2c845c lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783441538.724710:0:3290:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91a85fe59000 already unused, calling callback (ffffffffc1f9b4f0) 00010000:00010000:0.0:1783441538.724717:0:3290:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91a85fe59000/0xa2426164df2c845c lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783441538.724726:0:3290:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91a85fe59000/0xa2426164df2c845c lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783441538.724770:0:3290:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff91a85faeec00) 00010000:00010000:0.0:1783441538.724775:0:3290:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1783441538.724781:0:3290:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff91a85fe59000/0xa2426164df2c845c lrc: 2/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783441538.724789:0:3290:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91a85fe59000/0xa2426164df2c845c lrc: 0/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783441538.725171:0:5786:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073673370496 00000100:00100000:2.0:1783441538.725184:0:5786:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073673370496 00000100:00100000:3.0:1783441538.725366:0:5786:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.13@tcp, seq: 193 00000100:00100000:3.0:1783441538.725378:0:5786:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a87d644380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:65454767-383a-4679-a788-eba05c6e0989+32:11028:x1870073673370496:12345-192.168.201.13@tcp:101:bash.0 00010000:00010000:3.0:1783441538.725412:0:5786:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1783441538.725436:0:5786:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91a85eb3d000/0xa2426164df2c8463 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x633a354aa4df5045 expref: -99 pid: 5786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783441538.725517:0:5786:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91a85eb3d000/0xa2426164df2c8463 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.201.13@tcp remote: 0x633a354aa4df5045 expref: 33 pid: 5786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783441538.725532:0:5786:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff91a85eb3d000/0xa2426164df2c8463 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.13@tcp remote: 0x633a354aa4df5045 expref: 33 pid: 5786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783441538.725554:0:5786:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff91a85faeec00) 00010000:00010000:3.0:1783441538.725557:0:5786:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1783441538.725560:0:5786:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91a85eb3d000, rc 0) 00000100:00100000:3.0:1783441538.725697:0:5786:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a87d644380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:65454767-383a-4679-a788-eba05c6e0989+33:11028:x1870073673370496:12345-192.168.201.13@tcp:101:bash.0 Request processed in 320us (1302us total) trans 0 rc 0/0 00000100:00100000:3.0:1783441538.725706:0:5786:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.13@tcp, seq: 193 00000100:00100000:3.0:1783441538.729300:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.13@tcp (source: 12345-192.168.201.13@tcp) 00000100:00100000:0.0:1783441538.732394:0:6583:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073673370624 00000100:00100000:0.0:1783441538.732423:0:6583:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073673370624 00000100:00100000:0.0:1783441538.733109:0:6583:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.13@tcp, seq: 59 00000100:00100000:0.0:1783441538.733125:0:6583:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a87d645880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:65454767-383a-4679-a788-eba05c6e0989+7:11028:x1870073673370624:12345-192.168.201.13@tcp:101:bash.0 00010000:00010000:0.0:1783441538.733154:0:6583:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1783441538.733314:0:6583:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000004bc0e53c/0xa2426164df2c846a lrc: 2/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x633a354aa4df504c expref: -99 pid: 6583 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1783441538.733353:0:6583:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x5:0x0] initial LVB size: 9, mtime: 0x6a4d2882, atime: 0x6a4d2880, ctime: 0x6a4d2882, blocks: 0xb 00010000:00010000:0.0:1783441538.733384:0:6583:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=376s v=(0 0) 00010000:00010000:0.0:1783441538.733389:0:6583:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1783441538.733419:0:6583:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000004bc0e53c/0xa2426164df2c846a lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080000000 nid: 192.168.201.13@tcp remote: 0x633a354aa4df504c expref: 8 pid: 6583 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783441538.733441:0:6583:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000004bc0e53c/0xa2426164df2c846a lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.201.13@tcp remote: 0x633a354aa4df504c expref: 8 pid: 6583 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783441538.733458:0:6583:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91a85fe58e00, rc 0) 00000100:00100000:0.0:1783441538.733824:0:6583:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a87d645880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:65454767-383a-4679-a788-eba05c6e0989+8:11028:x1870073673370624:12345-192.168.201.13@tcp:101:bash.0 Request processed in 702us (4546us total) trans 0 rc 0/0 00000100:00100000:0.0:1783441538.733834:0:6583:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.13@tcp, seq: 59 00000100:00100000:2.0:1783441538.746427:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.13@tcp (source: 12345-192.168.201.13@tcp) 00000100:00100000:0.0:1783441538.746551:0:6587:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073673370752 00000100:00100000:0.0:1783441538.746564:0:6587:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073673370752 00002000:00010000:0.0:1783441538.746662:0:6587:0:(ofd_dev.c:2825:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 9663677440/5 (0->18446744073709551615) 00002000:00100000:0.0:1783441538.746668:0:6587:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff91a87d87ca80 with x1870073673370752 ext(0->18446744073709551615) 00002000:00010000:0.0:1783441538.746857:0:6587:0:(ofd_dev.c:2830:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff91a87d87ca80. 00000100:00100000:0.0:1783441538.747089:0:6587:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.13@tcp, seq: 5 00000100:00100000:3.0:1783441538.747324:0:6587:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a87d87ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:65454767-383a-4679-a788-eba05c6e0989+8:2355:x1870073673370752:12345-192.168.201.13@tcp:10:bash.0 00002000:00010000:3.0:1783441538.747821:0:6587:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb size from disk: 9 -> 0 00002000:00010000:3.0:1783441538.747826:0:6587:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb mtime from disk: 1783441538 -> 1783441539 00002000:00010000:3.0:1783441538.747829:0:6587:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb atime from disk: 1783441536 -> 1783441536 00002000:00010000:3.0:1783441538.747831:0:6587:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb ctime from disk: 1783441538 -> 1783441539 00002000:00010000:3.0:1783441538.747834:0:6587:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb blocks from disk: 11 -> 11 00000100:00100000:3.0:1783441538.748070:0:6587:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a87d87ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:65454767-383a-4679-a788-eba05c6e0989+9:2355:x1870073673370752:12345-192.168.201.13@tcp:10:bash.0 Request processed in 966us (1651us total) trans 4294967318 rc 0/0 00000100:00100000:3.0:1783441538.749054:0:6587:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.13@tcp, seq: 5 00002000:00010000:3.0:1783441538.749065:0:6587:0:(ofd_dev.c:2825:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 9663677440/5 (0->18446744073709551615) 00002000:00100000:3.0:1783441538.749070:0:6587:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff91a87d87ca80 with x1870073673370752 ext(0->18446744073709551615) 00002000:00010000:3.0:1783441538.749083:0:6587:0:(ofd_dev.c:2830:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff91a87d87ca80. 00000100:00100000:3.0:1783441538.826931:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.13@tcp (source: 12345-192.168.201.13@tcp) 00000100:00100000:1.0:1783441538.827137:0:6605:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073673370880 00000100:00100000:1.0:1783441538.827152:0:6605:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073673370880 00000100:00100000:1.0:1783441538.827228:0:6605:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.13@tcp, seq: 194 00000100:00100000:1.0:1783441538.827258:0:6605:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a877fadc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:65454767-383a-4679-a788-eba05c6e0989+33:11507:x1870073673370880:12345-192.168.201.13@tcp:34:lfs.0 00010000:00010000:1.0:1783441538.827361:0:6605:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff91a87da47c00/0xa2426164df2c8471 lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6605 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783441538.827384:0:6605:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91a87da47c00/0xa2426164df2c8471 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6605 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783441538.827399:0:6605:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91a87da47c00/0xa2426164df2c8471 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6605 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783441538.827418:0:6605:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff91a87da47200/0xa2426164df2c8478 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6605 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783441538.827425:0:6605:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91a87da47200/0xa2426164df2c8478 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6605 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783441538.827432:0:6605:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91a87da47200/0xa2426164df2c8478 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6605 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783441538.829385:0:6605:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff91a87da46000/0xa2426164df2c847f lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6605 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783441538.829405:0:6605:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91a87da46000/0xa2426164df2c847f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6605 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783441538.829417:0:6605:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91a87da46000/0xa2426164df2c847f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6605 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1783441538.829472:0:6605:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff91a87da46000/0xa2426164df2c847f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6605 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783441538.829486:0:6605:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff91a87da47c00/0xa2426164df2c8471 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6605 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783441538.829501:0:6605:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff91a87da47c00/0xa2426164df2c8471 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6605 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783441538.829508:0:6605:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff91a87da47c00/0xa2426164df2c8471 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6605 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783441538.829515:0:6605:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91a87da47c00 already unused, calling callback (ffffffffc1f9b4f0) 00010000:00010000:1.0:1783441538.829520:0:6605:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91a87da47c00/0xa2426164df2c8471 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6605 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783441538.829529:0:6605:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91a87da47c00/0xa2426164df2c8471 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6605 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783441538.829546:0:6605:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff91a8429bdc00) 00010000:00010000:1.0:1783441538.829550:0:6605:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1783441538.829555:0:6605:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff91a87da47c00/0xa2426164df2c8471 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6605 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783441538.829562:0:6605:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91a87da47c00/0xa2426164df2c8471 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6605 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783441538.831098:0:6605:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff91a87da47200/0xa2426164df2c8478 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6605 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783441538.831124:0:6605:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff91a87da47200/0xa2426164df2c8478 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6605 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783441538.831132:0:6605:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff91a87da47200/0xa2426164df2c8478 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6605 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783441538.831138:0:6605:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91a87da47200 already unused, calling callback (ffffffffc1f9b4f0) 00010000:00010000:1.0:1783441538.831163:0:6605:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91a87da47200/0xa2426164df2c8478 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6605 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783441538.831172:0:6605:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91a87da47200/0xa2426164df2c8478 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6605 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783441538.831188:0:6605:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff91a858b90400) 00010000:00010000:1.0:1783441538.831190:0:6605:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1783441538.831194:0:6605:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff91a87da47200/0xa2426164df2c8478 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6605 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783441538.831199:0:6605:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91a87da47200/0xa2426164df2c8478 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6605 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783441538.831226:0:6605:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff91a87da46000/0xa2426164df2c847f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6605 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783441538.831230:0:6605:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff91a87da46000/0xa2426164df2c847f lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6605 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783441538.831234:0:6605:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff91a87da46000/0xa2426164df2c847f lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6605 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783441538.831237:0:6605:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91a87da46000 already unused, calling callback (ffffffffc1f9b4f0) 00010000:00010000:1.0:1783441538.831238:0:6605:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91a87da46000/0xa2426164df2c847f lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6605 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783441538.831241:0:6605:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91a87da46000/0xa2426164df2c847f lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6605 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783441538.831245:0:6605:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff91a85faeec00) 00010000:00010000:1.0:1783441538.831247:0:6605:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1783441538.831253:0:6605:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff91a87da46000/0xa2426164df2c847f lrc: 2/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6605 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783441538.831257:0:6605:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91a87da46000/0xa2426164df2c847f lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6605 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783441538.831385:0:6605:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a877fadc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:65454767-383a-4679-a788-eba05c6e0989+33:11507:x1870073673370880:12345-192.168.201.13@tcp:34:lfs.0 Request processed in 4122us (4462us total) trans 0 rc 0/0 00000100:00100000:1.0:1783441538.831396:0:6605:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.13@tcp, seq: 194 00000100:00100000:0.0:1783441538.893439:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.13@tcp (source: 12345-192.168.201.13@tcp) 00000100:00100000:2.0:1783441538.894196:0:5785:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073673371136 00000100:00100000:2.0:1783441538.894212:0:5785:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073673371136 00000100:00100000:2.0:1783441538.894358:0:5785:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.13@tcp, seq: 195 00000100:00100000:2.0:1783441538.894371:0:5785:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a859086a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:65454767-383a-4679-a788-eba05c6e0989+33:11510:x1870073673371136:12345-192.168.201.13@tcp:101:lfs.0 00010000:00010000:2.0:1783441538.894399:0:5785:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1783441538.894429:0:5785:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91a85eaa1200/0xa2426164df2c8486 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x633a354aa4df5053 expref: -99 pid: 5785 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783441538.894543:0:5785:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff91a85eaa1a00/0xa2426164df2c848d lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783441538.894592:0:5785:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91a85eaa1a00/0xa2426164df2c848d lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783441538.894613:0:5785:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91a85eaa1a00/0xa2426164df2c848d lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783441538.894632:0:5785:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff91a85eaa1c00/0xa2426164df2c8494 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783441538.894939:0:5785:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91a85eaa1c00/0xa2426164df2c8494 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783441538.894947:0:5785:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91a85eaa1c00/0xa2426164df2c8494 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783441538.895428:0:5785:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff91a85eaa0200/0xa2426164df2c849b lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783441538.895439:0:5785:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91a85eaa0200/0xa2426164df2c849b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783441538.895448:0:5785:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91a85eaa0200/0xa2426164df2c849b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1783441538.895460:0:5785:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 0 00010000:00010000:2.0:1783441538.895920:0:5785:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff91a85eaa1a00/0xa2426164df2c848d lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783441538.895930:0:5785:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff91a85eaa1a00/0xa2426164df2c848d lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783441538.895936:0:5785:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff91a85eaa1a00/0xa2426164df2c848d lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783441538.895952:0:5785:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91a85eaa1a00 already unused, calling callback (ffffffffc1f9b4f0) 00010000:00010000:2.0:1783441538.895957:0:5785:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91a85eaa1a00/0xa2426164df2c848d lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783441538.895966:0:5785:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91a85eaa1a00/0xa2426164df2c848d lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783441538.895983:0:5785:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff91a8429bdc00) 00010000:00010000:2.0:1783441538.895987:0:5785:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1783441538.895993:0:5785:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff91a85eaa1a00/0xa2426164df2c848d lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783441538.895999:0:5785:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91a85eaa1a00/0xa2426164df2c848d lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783441538.896017:0:5785:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff91a85eaa1c00/0xa2426164df2c8494 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783441538.896023:0:5785:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff91a85eaa1c00/0xa2426164df2c8494 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783441538.896029:0:5785:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff91a85eaa1c00/0xa2426164df2c8494 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783441538.896035:0:5785:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91a85eaa1c00 already unused, calling callback (ffffffffc1f9b4f0) 00010000:00010000:2.0:1783441538.896038:0:5785:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91a85eaa1c00/0xa2426164df2c8494 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783441538.896044:0:5785:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91a85eaa1c00/0xa2426164df2c8494 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783441538.896064:0:5785:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff91a8429bdf00) 00010000:00010000:2.0:1783441538.896067:0:5785:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1783441538.896069:0:5785:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff91a85eaa1c00/0xa2426164df2c8494 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783441538.896077:0:5785:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91a85eaa1c00/0xa2426164df2c8494 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783441538.896135:0:5785:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91a85eaa1200/0xa2426164df2c8486 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.13@tcp remote: 0x633a354aa4df5053 expref: 36 pid: 5785 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783441538.896150:0:5785:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff91a85eaa0200/0xa2426164df2c849b lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.13@tcp remote: 0x633a354aa4df5053 expref: 35 pid: 5785 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783441538.896158:0:5785:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff91a85faeec00) 00010000:00010000:2.0:1783441538.896160:0:5785:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:2.0:1783441538.896162:0:5785:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91a85eaa0200, rc 0) 00000100:00100000:2.0:1783441538.896249:0:5785:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a859086a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:65454767-383a-4679-a788-eba05c6e0989+35:11510:x1870073673371136:12345-192.168.201.13@tcp:101:lfs.0 Request processed in 1880us (2824us total) trans 4294967478 rc 0/0 00000100:00100000:2.0:1783441538.896258:0:5785:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.13@tcp, seq: 195 00000100:00100000:2.0:1783441538.905117:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.13@tcp (source: 12345-192.168.201.13@tcp) 00000100:00100000:0.0:1783441538.905191:0:5787:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073673371264 00000100:00100000:0.0:1783441538.905205:0:5787:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073673371264 00000100:00100000:0.0:1783441538.905343:0:5787:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.13@tcp, seq: 196 00000100:00100000:0.0:1783441538.905358:0:5787:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a87d4dd180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:65454767-383a-4679-a788-eba05c6e0989+35:11510:x1870073673371264:12345-192.168.201.13@tcp:54:lfs.0 00010000:00010000:0.0:1783441538.905454:0:5787:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff91a85fe59a00/0xa2426164df2c84a9 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783441538.905486:0:5787:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff91a85fe58800/0xa2426164df2c844e lrc: 2/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.13@tcp remote: 0x633a354aa4df503e expref: 35 pid: 5785 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783441538.905497:0:5787:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff91a85fe59a00/0xa2426164df2c84a9 lrc: 4/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783441538.905561:0:5787:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff91a85fe58800/0xa2426164df2c844e lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.13@tcp remote: 0x633a354aa4df503e expref: 35 pid: 5785 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783441538.905602:0:5787:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff91a85fe58800/0xa2426164df2c844e lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.13@tcp remote: 0x633a354aa4df503e expref: 35 pid: 5785 timeout: 476 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783441538.905622:0:5787:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff91a859087480 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5787:1870073693289600:192.168.201.13@tcp:104: 00000100:00100000:0.0:1783441538.905788:0:5787:0:(client.c:2702:ptlrpc_set_wait()) set ffff91a87d800d80 going to sleep for 11 seconds 00000100:00100000:0.0:1783441538.917862:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.13@tcp (source: 12345-192.168.201.13@tcp) 00000100:00100000:1.0:1783441538.918198:0:5788:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073673371520 00000100:00100000:1.0:1783441538.918210:0:5788:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073673371520 00000100:00100000:1.0:1783441538.918281:0:5788:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.13@tcp, seq: 52 00000100:00100000:1.0:1783441538.918291:0:5788:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a859084000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:65454767-383a-4679-a788-eba05c6e0989+36:5568:x1870073673371520:12345-192.168.201.13@tcp:35:ldlm_bl.0 00000100:00100000:1.0:1783441538.918772:0:5788:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a859084000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:65454767-383a-4679-a788-eba05c6e0989+37:5568:x1870073673371520:12345-192.168.201.13@tcp:35:ldlm_bl.0 Request processed in 449us (895us total) trans 4294967479 rc 0/0 00000100:00100000:1.0:1783441538.918783:0:5788:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.13@tcp, seq: 52 00000100:00100000:3.0:1783441538.919554:0:5787:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff91a859087480 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5787:1870073693289600:192.168.201.13@tcp:104: 00010000:00010000:3.0:1783441538.919599:0:5787:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff91a85fe59a00/0xa2426164df2c84a9 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783441538.925555:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.13@tcp (source: 12345-192.168.201.13@tcp) 00000100:00100000:3.0:1783441538.926155:0:5770:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073673371648 00000100:00100000:3.0:1783441538.926169:0:5770:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073673371648 00010000:00010000:3.0:1783441538.926221:0:5770:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff91a85fe58800/0xa2426164df2c844e lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.13@tcp remote: 0x633a354aa4df503e expref: 37 pid: 5785 timeout: 476 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783441538.926274:0:5770:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.13@tcp, seq: 76 00000100:00100000:3.0:1783441538.926286:0:5770:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a859087480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:65454767-383a-4679-a788-eba05c6e0989+37:2354:x1870073673371648:12345-192.168.201.13@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1783441538.926307:0:5770:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1783441538.926331:0:5770:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff91a85fe58800/0xa2426164df2c844e lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.13@tcp remote: 0x633a354aa4df503e expref: 37 pid: 5785 timeout: 476 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783441538.926348:0:5770:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff91a85fe58800/0xa2426164df2c844e lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.13@tcp remote: 0x633a354aa4df503e expref: 37 pid: 5785 timeout: 476 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783441538.926378:0:5770:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91a85fe58800/0xa2426164df2c844e lrc: 0/0,0 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.13@tcp remote: 0x633a354aa4df503e expref: 37 pid: 5785 timeout: 476 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783441538.926401:0:5770:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff91a85faeec00) 00010000:00010000:3.0:1783441538.926406:0:5770:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff91a85fe59a00/0xa2426164df2c84a9 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783441538.926416:0:5770:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff91a85fe59a00/0xa2426164df2c84a9 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783441538.926424:0:5770:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91a85fe59a00/0xa2426164df2c84a9 lrc: 4/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783441538.926456:0:5770:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1783441538.926605:0:5770:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a859087480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:65454767-383a-4679-a788-eba05c6e0989+36:2354:x1870073673371648:12345-192.168.201.13@tcp:103:ldlm_bl.0 Request processed in 320us (1063us total) trans 0 rc 0/0 00000100:00100000:3.0:1783441538.926613:0:5770:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.13@tcp, seq: 76 00010000:00010000:3.0:1783441538.926646:0:5787:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff91a85fe59a00/0xa2426164df2c84a9 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783441538.926656:0:5787:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91a85fe59a00/0xa2426164df2c84a9 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783441538.926696:0:5787:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff91a85fe59a00/0xa2426164df2c84a9 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783441538.926714:0:5787:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff91a85fe59a00/0xa2426164df2c84a9 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783441538.926721:0:5787:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff91a85fe59a00/0xa2426164df2c84a9 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783441538.926729:0:5787:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91a85fe59a00 already unused, calling callback (ffffffffc1f9b4f0) 00010000:00010000:3.0:1783441538.926734:0:5787:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91a85fe59a00/0xa2426164df2c84a9 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783441538.926786:0:5787:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91a85fe59a00/0xa2426164df2c84a9 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783441538.926796:0:5787:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff91a85faeec00) 00010000:00010000:3.0:1783441538.926799:0:5787:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1783441538.926802:0:5787:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff91a85fe59a00/0xa2426164df2c84a9 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783441538.926808:0:5787:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91a85fe59a00/0xa2426164df2c84a9 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783441538.927177:0:5787:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a87d4dd180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:65454767-383a-4679-a788-eba05c6e0989+35:11510:x1870073673371264:12345-192.168.201.13@tcp:54:lfs.0 Request processed in 21821us (22072us total) trans 0 rc 0/0 00000100:00100000:3.0:1783441538.927186:0:5787:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.13@tcp, seq: 196 00000100:00100000:1.0:1783441538.927379:0:3304:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1783441538.927403:0:3304:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff91a8476b0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3304:1870073693289728:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1783441538.927469:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783441538.927665:0:6584:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073693289728 00000100:00100000:2.0:1783441538.927673:0:6584:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073693289728 00000100:00100000:2.0:1783441538.927724:0:6584:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 74 00000100:00100000:2.0:1783441538.927734:0:6584:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a87d6f0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3304:x1870073693289728:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1783441538.927803:0:6584:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 49348608 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1783441538.927859:0:6584:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a87d6f0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3304:x1870073693289728:12345-0@lo:13:osp-pre-1-0.0 Request processed in 127us (389us total) trans 0 rc 0/0 00000100:00100000:2.0:1783441538.927880:0:6584:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 74 00000100:00100000:1.0:1783441538.928352:0:3304:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff91a8476b0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3304:1870073693289728:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1783441538.930579:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.13@tcp (source: 12345-192.168.201.13@tcp) 00000100:00100000:1.0:1783441538.930736:0:5788:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073673371904 00000100:00100000:1.0:1783441538.930786:0:5788:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073673371904 00000100:00100000:1.0:1783441538.930864:0:5788:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.13@tcp, seq: 53 00000100:00100000:1.0:1783441538.930876:0:5788:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a844b7ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:65454767-383a-4679-a788-eba05c6e0989+35:11510:x1870073673371904:12345-192.168.201.13@tcp:35:lfs.0 00000100:00100000:1.0:1783441538.931196:0:5788:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a844b7ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:65454767-383a-4679-a788-eba05c6e0989+36:11510:x1870073673371904:12345-192.168.201.13@tcp:35:lfs.0 Request processed in 321us (637us total) trans 4294967480 rc 0/0 00000100:00100000:1.0:1783441538.931205:0:5788:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.13@tcp, seq: 53 00000100:00100000:0.0:1783441539.044694:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.13@tcp (source: 12345-192.168.201.13@tcp) 00000100:00100000:3.0:1783441539.045050:0:5786:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073673372160 00000100:00100000:3.0:1783441539.045067:0:5786:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073673372160 00000100:00100000:3.0:1783441539.045157:0:5786:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.13@tcp, seq: 197 00000100:00100000:3.0:1783441539.045170:0:5786:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a844b7ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:65454767-383a-4679-a788-eba05c6e0989+36:11521:x1870073673372160:12345-192.168.201.13@tcp:101:cat.0 00010000:00010000:3.0:1783441539.045204:0:5786:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1783441539.045249:0:5786:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91a85eb3d600/0xa2426164df2c84b0 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x633a354aa4df505a expref: -99 pid: 5786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783441539.046956:0:5786:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff91a85eb3da00/0xa2426164df2c84b7 lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783441539.046996:0:5786:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91a85eb3da00/0xa2426164df2c84b7 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783441539.047013:0:5786:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91a85eb3da00/0xa2426164df2c84b7 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783441539.047048:0:5786:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff91a85eb3d200/0xa2426164df2c84be lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783441539.047056:0:5786:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91a85eb3d200/0xa2426164df2c84be lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783441539.047061:0:5786:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91a85eb3d200/0xa2426164df2c84be lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783441539.047512:0:5786:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff91a85eb3ce00/0xa2426164df2c84c5 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783441539.047523:0:5786:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91a85eb3ce00/0xa2426164df2c84c5 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783441539.047531:0:5786:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91a85eb3ce00/0xa2426164df2c84c5 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1783441539.047545:0:5786:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 8 00010000:00010000:3.0:1783441539.047689:0:5786:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff91a85eb3da00/0xa2426164df2c84b7 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783441539.047708:0:5786:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff91a85eb3da00/0xa2426164df2c84b7 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783441539.047715:0:5786:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff91a85eb3da00/0xa2426164df2c84b7 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783441539.047722:0:5786:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91a85eb3da00 already unused, calling callback (ffffffffc1f9b4f0) 00010000:00010000:3.0:1783441539.047728:0:5786:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91a85eb3da00/0xa2426164df2c84b7 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783441539.047737:0:5786:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91a85eb3da00/0xa2426164df2c84b7 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783441539.047792:0:5786:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff91a8429bdc00) 00010000:00010000:3.0:1783441539.047796:0:5786:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1783441539.047803:0:5786:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff91a85eb3da00/0xa2426164df2c84b7 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783441539.047809:0:5786:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91a85eb3da00/0xa2426164df2c84b7 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783441539.048389:0:5786:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff91a85eb3d200/0xa2426164df2c84be lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783441539.048401:0:5786:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff91a85eb3d200/0xa2426164df2c84be lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783441539.048407:0:5786:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff91a85eb3d200/0xa2426164df2c84be lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783441539.048411:0:5786:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91a85eb3d200 already unused, calling callback (ffffffffc1f9b4f0) 00010000:00010000:3.0:1783441539.048421:0:5786:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91a85eb3d200/0xa2426164df2c84be lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783441539.048427:0:5786:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91a85eb3d200/0xa2426164df2c84be lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783441539.048435:0:5786:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff91a85faee600) 00010000:00010000:3.0:1783441539.048437:0:5786:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1783441539.048439:0:5786:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff91a85eb3d200/0xa2426164df2c84be lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783441539.048443:0:5786:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91a85eb3d200/0xa2426164df2c84be lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783441539.048523:0:5786:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91a85eb3d600/0xa2426164df2c84b0 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.13@tcp remote: 0x633a354aa4df505a expref: 39 pid: 5786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783441539.048540:0:5786:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff91a85eb3ce00/0xa2426164df2c84c5 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.13@tcp remote: 0x633a354aa4df505a expref: 38 pid: 5786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783441539.048545:0:5786:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff91a85faeec00) 00010000:00010000:3.0:1783441539.048547:0:5786:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1783441539.048549:0:5786:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91a85eb3ce00, rc 0) 00000100:00100000:3.0:1783441539.049098:0:5786:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a844b7ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:65454767-383a-4679-a788-eba05c6e0989+38:11521:x1870073673372160:12345-192.168.201.13@tcp:101:cat.0 Request processed in 3926us (4415us total) trans 4294967481 rc 0/0 00000100:00100000:3.0:1783441539.049109:0:5786:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.13@tcp, seq: 197 00000100:00100000:3.0:1783441539.055312:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.13@tcp (source: 12345-192.168.201.13@tcp) 00000100:00100000:1.0:1783441539.055505:0:5788:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073673372416 00000100:00100000:1.0:1783441539.055519:0:5788:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073673372416 00000100:00100000:1.0:1783441539.055603:0:5788:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.13@tcp, seq: 54 00000100:00100000:1.0:1783441539.055616:0:5788:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a87d793b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:65454767-383a-4679-a788-eba05c6e0989+38:11521:x1870073673372416:12345-192.168.201.13@tcp:35:cat.0 00000100:00100000:1.0:1783441539.055999:0:5788:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a87d793b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:65454767-383a-4679-a788-eba05c6e0989+39:11521:x1870073673372416:12345-192.168.201.13@tcp:35:cat.0 Request processed in 384us (700us total) trans 4294967482 rc 0/0 00000100:00100000:1.0:1783441539.056009:0:5788:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.13@tcp, seq: 54 00000100:00100000:2.0:1783441539.090252:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.13@tcp (source: 12345-192.168.201.13@tcp) 00000100:00100000:1.0:1783441539.090476:0:6605:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073673372672 00000100:00100000:1.0:1783441539.090491:0:6605:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073673372672 00000100:00100000:3.0:1783441539.091059:0:5787:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.13@tcp, seq: 198 00000100:00100000:3.0:1783441539.091077:0:5787:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a8476b0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:65454767-383a-4679-a788-eba05c6e0989+39:11522:x1870073673372672:12345-192.168.201.13@tcp:36:rm.0 00010000:00010000:3.0:1783441539.091184:0:5787:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 3 locks, starting at 0 00010000:00010000:3.0:1783441539.091221:0:5787:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91a85eb3ce00/0xa2426164df2c84c5 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.13@tcp remote: 0x633a354aa4df505a expref: 39 pid: 5786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783441539.091249:0:5787:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91a85eaa0200/0xa2426164df2c849b lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.13@tcp remote: 0x633a354aa4df5053 expref: 38 pid: 5785 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783441539.091264:0:5787:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91a85eb3d000/0xa2426164df2c8463 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.13@tcp remote: 0x633a354aa4df5045 expref: 37 pid: 5786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783441539.092044:0:5787:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff91a85faeec00) 00010000:00010000:3.0:1783441539.092064:0:5787:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1783441539.092183:0:5787:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff91a85eaa1c00/0xa2426164df2c84d3 lrc: 3/0,1 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783441539.092202:0:5787:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91a85eaa1c00/0xa2426164df2c84d3 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783441539.092216:0:5787:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91a85eaa1c00/0xa2426164df2c84d3 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783441539.092235:0:5787:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff91a85eaa1a00/0xa2426164df2c84da lrc: 3/0,1 mode: --/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783441539.092242:0:5787:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91a85eaa1a00/0xa2426164df2c84da lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783441539.092249:0:5787:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91a85eaa1a00/0xa2426164df2c84da lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783441539.092869:0:5787:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff91a85eaa1800/0xa2426164df2c84e1 lrc: 3/0,1 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783441539.092880:0:5787:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91a85eaa1800/0xa2426164df2c84e1 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783441539.092887:0:5787:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91a85eaa1800/0xa2426164df2c84e1 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1783441539.098054:0:5787:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].7, 64 off8712 00000004:00080000:2.0:1783441539.098076:0:5787:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 376972333772ns, next at 377972328883ns, rc = 0 00010000:00010000:2.0:1783441539.098193:0:5787:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff91a85eaa1400/0xa2426164df2c84e8 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783441539.098225:0:5787:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91a85eaa1400/0xa2426164df2c84e8 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783441539.098240:0:5787:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91a85eaa1400/0xa2426164df2c84e8 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783441539.098251:0:5787:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff91a85eaa1400/0xa2426164df2c84e8 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783441539.098257:0:5787:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff91a85eaa1400/0xa2426164df2c84e8 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783441539.098262:0:5787:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff91a85eaa1400/0xa2426164df2c84e8 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783441539.098482:0:5787:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1783441539.098523:0:5787:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff91a85eaa1800/0xa2426164df2c84e1 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783441539.098531:0:5787:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff91a85eaa1800/0xa2426164df2c84e1 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783441539.098537:0:5787:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff91a85eaa1800/0xa2426164df2c84e1 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783441539.098543:0:5787:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91a85eaa1800 already unused, calling callback (ffffffffc1f9b4f0) 00010000:00010000:2.0:1783441539.098548:0:5787:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91a85eaa1800/0xa2426164df2c84e1 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783441539.098556:0:5787:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91a85eaa1800/0xa2426164df2c84e1 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783441539.098601:0:5787:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff91a8429bd100) 00010000:00010000:2.0:1783441539.098605:0:5787:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:2.0:1783441539.098612:0:5787:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff91a85eaa1800/0xa2426164df2c84e1 lrc: 2/0,0 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783441539.098618:0:5787:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91a85eaa1800/0xa2426164df2c84e1 lrc: 0/0,0 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783441539.098644:0:5787:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff91a85eaa1c00/0xa2426164df2c84d3 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783441539.098650:0:5787:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff91a85eaa1c00/0xa2426164df2c84d3 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783441539.098655:0:5787:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff91a85eaa1c00/0xa2426164df2c84d3 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783441539.098661:0:5787:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91a85eaa1c00 already unused, calling callback (ffffffffc1f9b4f0) 00010000:00010000:2.0:1783441539.098663:0:5787:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91a85eaa1c00/0xa2426164df2c84d3 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783441539.098669:0:5787:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91a85eaa1c00/0xa2426164df2c84d3 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783441539.098677:0:5787:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff91a8429bdc00) 00010000:00010000:2.0:1783441539.098680:0:5787:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1783441539.098683:0:5787:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff91a85eaa1c00/0xa2426164df2c84d3 lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783441539.098689:0:5787:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91a85eaa1c00/0xa2426164df2c84d3 lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1783441539.098710:0:5787:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 000000003084f80b reply state 000000001d7dd07e transno 4294967483 ns: mdt-lustre-MDT0000_UUID lock: ffff91a85eaa1a00/0xa2426164df2c84da lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783441539.098721:0:5787:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1783441539.098889:0:5787:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a8476b0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:65454767-383a-4679-a788-eba05c6e0989+38:11522:x1870073673372672:12345-192.168.201.13@tcp:36:rm.0 Request processed in 7812us (8645us total) trans 4294967483 rc 0/0 00000100:00100000:2.0:1783441539.098910:0:5787:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.13@tcp, seq: 198 00010000:00010000:2.0:1783441539.102357:0:3289:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff91a85eaa1a00/0xa2426164df2c84da lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783441539.102384:0:3289:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff91a85eaa1a00/0xa2426164df2c84da lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783441539.102393:0:3289:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff91a85eaa1a00/0xa2426164df2c84da lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783441539.102401:0:3289:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91a85eaa1a00 already unused, calling callback (ffffffffc1f9b4f0) 00010000:00010000:2.0:1783441539.102407:0:3289:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91a85eaa1a00/0xa2426164df2c84da lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783441539.102417:0:3289:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91a85eaa1a00/0xa2426164df2c84da lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783441539.102442:0:3289:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff91a8429bdf00) 00010000:00010000:2.0:1783441539.102446:0:3289:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1783441539.102452:0:3289:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff91a85eaa1a00/0xa2426164df2c84da lrc: 2/0,0 mode: --/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783441539.102459:0:3289:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91a85eaa1a00/0xa2426164df2c84da lrc: 0/0,0 mode: --/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783441539.103036:0:5773:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1783441539.103046:0:5773:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff91a85eaa1400/0xa2426164df2c84e8 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783441539.103054:0:5773:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91a85eaa1400 already unused, calling callback (ffffffffc155ff90) 00010000:00010000:1.0:1783441539.103058:0:5773:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91a85eaa1400/0xa2426164df2c84e8 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783441539.103065:0:5773:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91a85eaa1400/0xa2426164df2c84e8 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783441539.103077:0:5773:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff91a8429bd100) 00010000:00010000:1.0:1783441539.103079:0:5773:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:1.0:1783441539.103082:0:5773:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff91a85eaa1400/0xa2426164df2c84e8 lrc: 1/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783441539.103088:0:5773:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91a85eaa1400/0xa2426164df2c84e8 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783441539.103106:0:5773:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783441539.103108:0:5773:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783441539.103110:0:5773:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1783441539.181971:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.13@tcp (source: 12345-192.168.201.13@tcp) 00000100:00100000:0.0:1783441539.182624:0:5785:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073673372928 00000100:00100000:0.0:1783441539.182639:0:5785:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073673372928 00000100:00100000:0.0:1783441539.182718:0:5785:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.13@tcp, seq: 199 00000100:00100000:0.0:1783441539.182730:0:5785:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a87d7ba300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:65454767-383a-4679-a788-eba05c6e0989+37:11528:x1870073673372928:12345-192.168.201.13@tcp:101:bash.0 00010000:00010000:0.0:1783441539.182806:0:5785:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1783441539.182843:0:5785:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91a85fe58400/0xa2426164df2c84ef lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x633a354aa4df5061 expref: -99 pid: 5785 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783441539.183041:0:5785:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff91a85fe58000/0xa2426164df2c84f6 lrc: 3/0,1 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783441539.183059:0:5785:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91a85fe58000/0xa2426164df2c84f6 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783441539.183074:0:5785:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91a85fe58000/0xa2426164df2c84f6 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783441539.183105:0:5785:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff91a85fe59600/0xa2426164df2c84fd lrc: 3/0,1 mode: --/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783441539.183112:0:5785:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91a85fe59600/0xa2426164df2c84fd lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783441539.183118:0:5785:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91a85fe59600/0xa2426164df2c84fd lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:2.0:1783441539.185691:0:5785:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x5:0x0], index 1: 0 00010000:00010000:2.0:1783441539.186444:0:5785:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff91a85eaa1a00/0xa2426164df2c8504 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783441539.186468:0:5785:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91a85eaa1a00/0xa2426164df2c8504 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783441539.186483:0:5785:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91a85eaa1a00/0xa2426164df2c8504 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783441539.186545:0:5785:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff91a85fe58000/0xa2426164df2c84f6 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783441539.186554:0:5785:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff91a85fe58000/0xa2426164df2c84f6 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783441539.186572:0:5785:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff91a85fe58000/0xa2426164df2c84f6 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783441539.187060:0:5785:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91a85fe58000 already unused, calling callback (ffffffffc1f9b4f0) 00010000:00010000:2.0:1783441539.187066:0:5785:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91a85fe58000/0xa2426164df2c84f6 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783441539.187075:0:5785:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91a85fe58000/0xa2426164df2c84f6 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783441539.187093:0:5785:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff91a8429bdc00) 00010000:00010000:2.0:1783441539.187097:0:5785:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1783441539.187102:0:5785:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff91a85fe58000/0xa2426164df2c84f6 lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783441539.187129:0:5785:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91a85fe58000/0xa2426164df2c84f6 lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1783441539.187152:0:5785:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000fcbce6b6 reply state 00000000300c5f3d transno 4294967484 ns: mdt-lustre-MDT0000_UUID lock: ffff91a85fe59600/0xa2426164df2c84fd lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783441539.187162:0:5785:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:2.0:1783441539.187223:0:5785:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91a85fe58400/0xa2426164df2c84ef lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.13@tcp remote: 0x633a354aa4df5061 expref: 40 pid: 5785 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783441539.187574:0:5785:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff91a85eaa1a00/0xa2426164df2c8504 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.13@tcp remote: 0x633a354aa4df5061 expref: 39 pid: 5785 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783441539.187644:0:5785:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff91a8429bdf00) 00010000:00010000:2.0:1783441539.187647:0:5785:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1783441539.187650:0:5785:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91a85eaa1a00, rc 0) 00000100:00100000:2.0:1783441539.187870:0:5785:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a87d7ba300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:65454767-383a-4679-a788-eba05c6e0989+40:11528:x1870073673372928:12345-192.168.201.13@tcp:101:bash.0 Request processed in 5141us (5923us total) trans 4294967484 rc 0/0 00000100:00100000:2.0:1783441539.187881:0:5785:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.13@tcp, seq: 199 00010000:00010000:2.0:1783441539.205126:0:3290:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff91a85fe59600/0xa2426164df2c84fd lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783441539.205149:0:3290:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff91a85fe59600/0xa2426164df2c84fd lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783441539.205158:0:3290:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff91a85fe59600/0xa2426164df2c84fd lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783441539.205166:0:3290:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91a85fe59600 already unused, calling callback (ffffffffc1f9b4f0) 00010000:00010000:2.0:1783441539.205195:0:3290:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91a85fe59600/0xa2426164df2c84fd lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783441539.205205:0:3290:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91a85fe59600/0xa2426164df2c84fd lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783441539.205227:0:3290:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff91a8439b0000) 00010000:00010000:2.0:1783441539.205230:0:3290:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1783441539.205235:0:3290:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff91a85fe59600/0xa2426164df2c84fd lrc: 2/0,0 mode: --/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783441539.205243:0:3290:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91a85fe59600/0xa2426164df2c84fd lrc: 0/0,0 mode: --/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783441539.206457:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.13@tcp (source: 12345-192.168.201.13@tcp) 00000100:00100000:1.0:1783441539.206551:0:6582:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073673373056 00000100:00100000:1.0:1783441539.206572:0:6582:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073673373056 00000100:00100000:1.0:1783441539.206680:0:6582:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.13@tcp, seq: 60 00000100:00100000:1.0:1783441539.206696:0:6582:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a867fb3850 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:65454767-383a-4679-a788-eba05c6e0989+5:2355:x1870073673373056:12345-192.168.201.13@tcp:101:bash.0 00010000:00010000:1.0:1783441539.206720:0:6582:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1783441539.206774:0:6582:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000d6c785f6/0xa2426164df2c8512 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x633a354aa4df5068 expref: -99 pid: 6582 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1783441539.206810:0:6582:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x5:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1783441539.206838:0:6582:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=377s v=(0 0) 00010000:00010000:1.0:1783441539.206843:0:6582:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1783441539.206854:0:6582:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000d6c785f6/0xa2426164df2c8512 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.13@tcp remote: 0x633a354aa4df5068 expref: 6 pid: 6582 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783441539.206875:0:6582:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000d6c785f6/0xa2426164df2c8512 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.13@tcp remote: 0x633a354aa4df5068 expref: 6 pid: 6582 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783441539.206891:0:6582:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91a87da46000, rc 0) 00000100:00080000:0.0:1783441539.206995:0:5781:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1783441539.207287:0:6582:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a867fb3850 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:65454767-383a-4679-a788-eba05c6e0989+6:2355:x1870073673373056:12345-192.168.201.13@tcp:101:bash.0 Request processed in 597us (841us total) trans 0 rc 0/0 00000100:00100000:1.0:1783441539.207295:0:6582:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.13@tcp, seq: 60 00000100:00100000:0.0:1783441539.211473:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.13@tcp (source: 12345-192.168.201.13@tcp) 00000100:00100000:3.0:1783441539.211693:0:8557:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073673373184 00000100:00100000:3.0:1783441539.211707:0:8557:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073673373184 00000100:00100000:3.0:1783441539.211968:0:8557:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.13@tcp, seq: 61 00000100:00100000:3.0:1783441539.211981:0:8557:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a844b7fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:65454767-383a-4679-a788-eba05c6e0989+6:11528:x1870073673373184:12345-192.168.201.13@tcp:101:bash.0 00010000:00010000:3.0:1783441539.212056:0:8557:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1783441539.212084:0:8557:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000f0cc14ae/0xa2426164df2c8519 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x633a354aa4df506f expref: -99 pid: 8557 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783441539.212125:0:8557:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000d6c785f6/0xa2426164df2c8512 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.13@tcp remote: 0x633a354aa4df5068 expref: 7 pid: 6582 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783441539.212135:0:8557:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1783441539.212141:0:8557:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1783441539.212147:0:8557:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000f0cc14ae/0xa2426164df2c8519 lrc: 4/0,0 mode: --/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.201.13@tcp remote: 0x633a354aa4df506f expref: 7 pid: 8557 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783441539.212214:0:8557:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000d6c785f6/0xa2426164df2c8512 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.201.13@tcp remote: 0x633a354aa4df5068 expref: 7 pid: 6582 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783441539.212231:0:8557:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000d6c785f6/0xa2426164df2c8512 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.201.13@tcp remote: 0x633a354aa4df5068 expref: 7 pid: 6582 timeout: 477 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783441539.212248:0:8557:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff91a87d791180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:8557:1870073693289856:192.168.201.13@tcp:104: 00000100:00100000:3.0:1783441539.212383:0:8557:0:(client.c:2702:ptlrpc_set_wait()) set ffff91a848897d80 going to sleep for 11 seconds 00000100:00100000:2.0:1783441539.215845:0:8557:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff91a87d791180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:8557:1870073693289856:192.168.201.13@tcp:104: 00010000:00010000:2.0:1783441539.215994:0:8557:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000f0cc14ae/0xa2426164df2c8519 lrc: 3/0,0 mode: --/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.201.13@tcp remote: 0x633a354aa4df506f expref: 7 pid: 8557 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783441539.216096:0:8557:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91a841476000, rc 0) 00000100:00100000:2.0:1783441539.216164:0:8557:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a844b7fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:65454767-383a-4679-a788-eba05c6e0989+7:11528:x1870073673373184:12345-192.168.201.13@tcp:101:bash.0 Request processed in 4185us (4706us total) trans 0 rc 0/0 00000100:00100000:2.0:1783441539.216174:0:8557:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.13@tcp, seq: 61 00000100:00100000:2.0:1783441539.219693:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.13@tcp (source: 12345-192.168.201.13@tcp) 00000100:00100000:3.0:1783441539.220011:0:11015:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073673373312 00000100:00100000:3.0:1783441539.220025:0:11015:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073673373312 00010000:00010000:3.0:1783441539.220086:0:11015:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000d6c785f6/0xa2426164df2c8512 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.201.13@tcp remote: 0x633a354aa4df5068 expref: 7 pid: 6582 timeout: 477 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783441539.220131:0:11015:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.13@tcp, seq: 77 00000100:00100000:3.0:1783441539.220142:0:11015:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a846f75050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:65454767-383a-4679-a788-eba05c6e0989+7:2355:x1870073673373312:12345-192.168.201.13@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1783441539.220161:0:11015:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1783441539.220190:0:11015:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000d6c785f6/0xa2426164df2c8512 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.201.13@tcp remote: 0x633a354aa4df5068 expref: 7 pid: 6582 timeout: 477 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783441539.220206:0:11015:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000d6c785f6/0xa2426164df2c8512 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.201.13@tcp remote: 0x633a354aa4df5068 expref: 7 pid: 6582 timeout: 477 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783441539.220237:0:11015:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000d6c785f6/0xa2426164df2c8512 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.201.13@tcp remote: 0x633a354aa4df5068 expref: 7 pid: 6582 timeout: 477 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783441539.220286:0:11015:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1783441539.220292:0:11015:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1783441539.220302:0:11015:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000f0cc14ae/0xa2426164df2c8519 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.201.13@tcp remote: 0x633a354aa4df506f expref: 6 pid: 8557 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783441539.220313:0:11015:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000f0cc14ae/0xa2426164df2c8519 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.201.13@tcp remote: 0x633a354aa4df506f expref: 6 pid: 8557 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783441539.220366:0:11015:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 00000000f0cc14ae/0xa2426164df2c8519 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.201.13@tcp remote: 0x633a354aa4df506f expref: 6 pid: 8557 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783441539.220384:0:11015:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff91a87d792d80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:11015:1870073693289984:192.168.201.13@tcp:105: 00000100:00100000:3.0:1783441539.220499:0:11015:0:(client.c:2702:ptlrpc_set_wait()) set ffff91a848897600 going to sleep for 11 seconds 00000100:00100000:0.0:1783441539.238244:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.13@tcp (source: 12345-192.168.201.13@tcp) 00000100:00100000:1.0:1783441539.238617:0:5788:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073673373568 00000100:00100000:1.0:1783441539.238631:0:5788:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073673373568 00000100:00100000:1.0:1783441539.238716:0:5788:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.13@tcp, seq: 55 00000100:00100000:1.0:1783441539.238727:0:5788:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a844b7d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:65454767-383a-4679-a788-eba05c6e0989+39:11528:x1870073673373568:12345-192.168.201.13@tcp:35:bash.0 00000100:00100000:1.0:1783441539.239279:0:5788:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a844b7d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:65454767-383a-4679-a788-eba05c6e0989+40:11528:x1870073673373568:12345-192.168.201.13@tcp:35:bash.0 Request processed in 550us (1046us total) trans 4294967485 rc 0/0 00000100:00100000:1.0:1783441539.239305:0:5788:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.13@tcp, seq: 55 00000100:00100000:3.0:1783441539.240718:0:11015:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff91a87d792d80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:11015:1870073693289984:192.168.201.13@tcp:105: 00010000:00010000:3.0:1783441539.240799:0:11015:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1783441539.240869:0:11015:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a846f75050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:65454767-383a-4679-a788-eba05c6e0989+6:2355:x1870073673373312:12345-192.168.201.13@tcp:103:ldlm_bl.0 Request processed in 20727us (21189us total) trans 0 rc 0/0 00000100:00100000:3.0:1783441539.240883:0:11015:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.13@tcp, seq: 77 00010000:00010000:1.0:1783441539.248545:0:5772:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1783441539.473222:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.13@tcp (source: 12345-192.168.201.13@tcp) 00000100:00100000:1.0:1783441539.476084:0:6605:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073673373696 00000100:00100000:1.0:1783441539.476104:0:6605:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073673373696 00000100:00100000:1.0:1783441539.476203:0:6605:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.13@tcp, seq: 200 00000100:00100000:1.0:1783441539.476213:0:6605:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a87d7c7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:65454767-383a-4679-a788-eba05c6e0989+40:11544:x1870073673373696:12345-192.168.201.13@tcp:101:lfs.0 00010000:00010000:1.0:1783441539.476246:0:6605:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1783441539.476279:0:6605:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91a87da47c00/0xa2426164df2c8520 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x633a354aa4df5076 expref: -99 pid: 6605 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783441539.476362:0:6605:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff91a87da47000/0xa2426164df2c8527 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6605 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783441539.476380:0:6605:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91a87da47000/0xa2426164df2c8527 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6605 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783441539.476393:0:6605:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91a87da47000/0xa2426164df2c8527 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6605 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1783441539.476918:0:6605:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xa:0x0]: returning size 7680 00000004:00200000:1.0:1783441539.476926:0:6605:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 1 stripe count 1 MDT count 1 00000004:00010000:1.0:1783441539.476975:0:6605:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff91a87da47000/0xa2426164df2c8527 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6605 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783441539.477014:0:6605:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91a87da47c00/0xa2426164df2c8520 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.13@tcp remote: 0x633a354aa4df5076 expref: 42 pid: 6605 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783441539.477044:0:6605:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff91a87da47000/0xa2426164df2c8527 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.13@tcp remote: 0x633a354aa4df5076 expref: 41 pid: 6605 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783441539.477080:0:6605:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff91a8429bdc00) 00010000:00010000:1.0:1783441539.477083:0:6605:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1783441539.477088:0:6605:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91a87da47000, rc 0) 00000100:00100000:1.0:1783441539.477191:0:6605:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a87d7c7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:65454767-383a-4679-a788-eba05c6e0989+41:11544:x1870073673373696:12345-192.168.201.13@tcp:101:lfs.0 Request processed in 977us (3983us total) trans 0 rc 0/0 00000100:00100000:1.0:1783441539.477201:0:6605:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.13@tcp, seq: 200 00000100:00100000:2.0:1783441539.488275:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.13@tcp (source: 12345-192.168.201.13@tcp) 00000100:00100000:3.0:1783441539.488474:0:5786:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073673373952 00000100:00100000:3.0:1783441539.488796:0:5786:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073673373952 00000100:00100000:3.0:1783441539.488882:0:5786:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.13@tcp, seq: 201 00000100:00100000:3.0:1783441539.488894:0:5786:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a87d7bb800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:65454767-383a-4679-a788-eba05c6e0989+41:11544:x1870073673373952:12345-192.168.201.13@tcp:101:lfs.0 00010000:00010000:3.0:1783441539.488923:0:5786:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1783441539.488952:0:5786:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91a841476800/0xa2426164df2c852e lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x633a354aa4df507d expref: -99 pid: 5786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783441539.489115:0:5786:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff91a841476e00/0xa2426164df2c8535 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783441539.489132:0:5786:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91a841476e00/0xa2426164df2c8535 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783441539.489147:0:5786:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91a841476e00/0xa2426164df2c8535 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1783441539.489162:0:5786:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xe:0x0]: returning size 9 00010000:00010000:2.0:1783441539.496214:0:5786:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91a841476800/0xa2426164df2c852e lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.13@tcp remote: 0x633a354aa4df507d expref: 44 pid: 5786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783441539.496259:0:5786:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff91a841476e00/0xa2426164df2c8535 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.13@tcp remote: 0x633a354aa4df507d expref: 43 pid: 5786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783441539.496297:0:5786:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff91a8429bdf00) 00010000:00010000:2.0:1783441539.496300:0:5786:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1783441539.496305:0:5786:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91a841476e00, rc 0) 00000100:00100000:2.0:1783441539.496435:0:5786:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a87d7bb800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:65454767-383a-4679-a788-eba05c6e0989+43:11544:x1870073673373952:12345-192.168.201.13@tcp:101:lfs.0 Request processed in 7540us (8183us total) trans 4294967486 rc 0/0 00000100:00100000:2.0:1783441539.496445:0:5786:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.13@tcp, seq: 201 00000100:00100000:1.0:1783441539.507112:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.13@tcp (source: 12345-192.168.201.13@tcp) 00000100:00100000:1.0:1783441539.507198:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.13@tcp (source: 12345-192.168.201.13@tcp) 00000100:00100000:3.0:1783441539.507278:0:5771:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073673374336 00000100:00100000:3.0:1783441539.507291:0:5771:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073673374336 00000100:00100000:3.0:1783441539.507364:0:5771:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.13@tcp, seq: 13 00000100:00100000:3.0:1783441539.507372:0:5771:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a87d6f3100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:65454767-383a-4679-a788-eba05c6e0989+43:2353:x1870073673374336:12345-192.168.201.13@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1783441539.507388:0:5771:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1783441539.507417:0:5771:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91a841476e00/0xa2426164df2c8535 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.13@tcp remote: 0x633a354aa4df507d expref: 43 pid: 5786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783441539.507436:0:5771:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff91a8429bdf00) 00010000:00010000:3.0:1783441539.507441:0:5771:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1783441539.507564:0:5771:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a87d6f3100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:65454767-383a-4679-a788-eba05c6e0989+42:2353:x1870073673374336:12345-192.168.201.13@tcp:103:ldlm_bl.0 Request processed in 183us (355us total) trans 0 rc 0/0 00000100:00100000:3.0:1783441539.507580:0:5771:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.13@tcp, seq: 13 00000100:00100000:2.0:1783441539.507957:0:5787:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073673374208 00000100:00100000:2.0:1783441539.507962:0:5787:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073673374208 00000100:00100000:2.0:1783441539.508021:0:5787:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.13@tcp, seq: 202 00000100:00100000:2.0:1783441539.508027:0:5787:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a87d6f1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:65454767-383a-4679-a788-eba05c6e0989+42:11544:x1870073673374208:12345-192.168.201.13@tcp:101:lfs.0 00010000:00010000:2.0:1783441539.508048:0:5787:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1783441539.508067:0:5787:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91a85eaa1800/0xa2426164df2c8543 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x633a354aa4df5084 expref: -99 pid: 5787 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783441539.508169:0:5787:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff91a85eaa1c00/0xa2426164df2c854a lrc: 3/0,1 mode: --/PW res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783441539.508184:0:5787:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91a85eaa1c00/0xa2426164df2c854a lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783441539.508196:0:5787:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91a85eaa1c00/0xa2426164df2c854a lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1783441539.508211:0:5787:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xe:0x0]: returning size 9 00010000:00010000:2.0:1783441539.508377:0:5787:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91a85eaa1800/0xa2426164df2c8543 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.13@tcp remote: 0x633a354aa4df5084 expref: 45 pid: 5787 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783441539.508411:0:5787:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff91a85eaa1c00/0xa2426164df2c854a lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.13@tcp remote: 0x633a354aa4df5084 expref: 44 pid: 5787 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783441539.508417:0:5787:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff91a8429bdf00) 00010000:00010000:2.0:1783441539.508419:0:5787:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:2.0:1783441539.508421:0:5787:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91a85eaa1c00, rc 0) 00000100:00100000:2.0:1783441539.508451:0:5787:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a87d6f1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:65454767-383a-4679-a788-eba05c6e0989+44:11544:x1870073673374208:12345-192.168.201.13@tcp:101:lfs.0 Request processed in 426us (1507us total) trans 4294967487 rc 0/0 00000100:00100000:2.0:1783441539.508457:0:5787:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.13@tcp, seq: 202 00000100:00100000:0.0:1783441539.516446:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.13@tcp (source: 12345-192.168.201.13@tcp) 00000100:00100000:2.0:1783441539.516941:0:6581:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073673374464 00000100:00100000:2.0:1783441539.516955:0:6581:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073673374464 00000100:00100000:2.0:1783441539.517060:0:6581:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.13@tcp, seq: 62 00000100:00100000:2.0:1783441539.517070:0:6581:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a87d7c6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:65454767-383a-4679-a788-eba05c6e0989+6:2355:x1870073673374464:12345-192.168.201.13@tcp:1:lfs.0 00010000:00010000:2.0:1783441539.517125:0:6581:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000001061a6f6/0xa2426164df2c8558 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6581 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783441539.517145:0:6581:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000f0cc14ae/0xa2426164df2c8519 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.201.13@tcp remote: 0x633a354aa4df506f expref: 6 pid: 8557 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783441539.517152:0:6581:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1783441539.517156:0:6581:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1783441539.517160:0:6581:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000001061a6f6/0xa2426164df2c8558 lrc: 4/0,1 mode: --/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6581 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783441539.517196:0:6581:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000f0cc14ae/0xa2426164df2c8519 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.201.13@tcp remote: 0x633a354aa4df506f expref: 6 pid: 8557 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783441539.517225:0:6581:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000f0cc14ae/0xa2426164df2c8519 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.201.13@tcp remote: 0x633a354aa4df506f expref: 6 pid: 8557 timeout: 477 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783441539.517244:0:6581:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff91a87d7b9500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:6581:1870073693290112:192.168.201.13@tcp:104: 00000100:00100000:2.0:1783441539.517396:0:6581:0:(client.c:2702:ptlrpc_set_wait()) set ffff91a867dff300 going to sleep for 11 seconds 00000100:00100000:2.0:1783441539.522011:0:6581:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff91a87d7b9500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:6581:1870073693290112:192.168.201.13@tcp:104: 00010000:00010000:2.0:1783441539.522047:0:6581:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 000000001061a6f6/0xa2426164df2c8558 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6581 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783441539.523229:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.13@tcp (source: 12345-192.168.201.13@tcp) 00000100:00100000:1.0:1783441539.523374:0:6588:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073673374592 00000100:00100000:1.0:1783441539.523385:0:6588:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073673374592 00002000:00100000:1.0:1783441539.523450:0:6588:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x5:0x0] (0->8) req@ffff91a87d7c7b80 x1870073673374592/t0(0) o4->65454767-383a-4679-a788-eba05c6e0989@192.168.201.13@tcp:180/0 lens 504/0 e 0 to 0 dl 1783441550 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1783441539.523460:0:6588:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff91a87d7c7b80 with x1870073673374592 ext(0->8) 00010000:00010000:1.0:1783441539.523471:0:6588:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 00000000f0cc14ae/0xa2426164df2c8519 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.201.13@tcp remote: 0x633a354aa4df506f expref: 7 pid: 8557 timeout: 477 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783441539.523490:0:6588:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 00000000f0cc14ae/0xa2426164df2c8519 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.201.13@tcp remote: 0x633a354aa4df506f expref: 7 pid: 8557 timeout: 477 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1783441539.523566:0:6588:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff91a87d7c7b80 00000100:00100000:1.0:1783441539.523718:0:6588:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.13@tcp, seq: 3 00000100:00100000:1.0:1783441539.523731:0:6588:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a87d7c7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:65454767-383a-4679-a788-eba05c6e0989+7:2354:x1870073673374592:12345-192.168.201.13@tcp:4:lfs.0 00000100:00100000:1.0:1783441539.524801:0:6588:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a87d7c7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:65454767-383a-4679-a788-eba05c6e0989+9:2354:x1870073673374592:12345-192.168.201.13@tcp:4:lfs.0 Request processed in 1064us (1572us total) trans 4294967308 rc 0/0 00000100:00100000:1.0:1783441539.525198:0:6588:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.13@tcp, seq: 3 00002000:00100000:1.0:1783441539.525209:0:6588:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x5:0x0] (0->8) req@ffff91a87d7c7b80 x1870073673374592/t4294967308(0) o4->65454767-383a-4679-a788-eba05c6e0989@192.168.201.13@tcp:180/0 lens 504/448 e 0 to 0 dl 1783441550 ref 1 fl Complete:H/600/0 rc 0/0 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1783441539.525217:0:6588:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff91a87d7c7b80 with x1870073673374592 ext(0->8) 00010000:00010000:1.0:1783441539.525226:0:6588:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 00000000f0cc14ae/0xa2426164df2c8519 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.201.13@tcp remote: 0x633a354aa4df506f expref: 9 pid: 8557 timeout: 477 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783441539.525247:0:6588:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 00000000f0cc14ae/0xa2426164df2c8519 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.201.13@tcp remote: 0x633a354aa4df506f expref: 9 pid: 8557 timeout: 477 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1783441539.525254:0:6588:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff91a87d7c7b80 00000100:00100000:1.0:1783441539.529177:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.13@tcp (source: 12345-192.168.201.13@tcp) 00000100:00100000:0.0:1783441539.529356:0:11514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073673374720 00000100:00100000:0.0:1783441539.529370:0:11514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073673374720 00010000:00010000:0.0:1783441539.529428:0:11514:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000f0cc14ae/0xa2426164df2c8519 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.201.13@tcp remote: 0x633a354aa4df506f expref: 9 pid: 8557 timeout: 477 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783441539.529615:0:11514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.13@tcp, seq: 78 00000100:00100000:0.0:1783441539.529627:0:11514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a87d6f0000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:65454767-383a-4679-a788-eba05c6e0989+9:2353:x1870073673374720:12345-192.168.201.13@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1783441539.529648:0:11514:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00002000:00010000:0.0:1783441539.529830:0:11514:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0x5:0x0] updating lvb size from disk: 0 -> 9 00002000:00010000:0.0:1783441539.529834:0:11514:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000400:0x5:0x0] updating lvb mtime from disk: 0 -> 1783441540 00002000:00010000:0.0:1783441539.529836:0:11514:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000400:0x5:0x0] updating lvb atime from disk: 0 -> 1783441540 00002000:00010000:0.0:1783441539.529838:0:11514:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000400:0x5:0x0] updating lvb ctime from disk: 0 -> 1783441540 00010000:00010000:0.0:1783441539.529874:0:11514:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000f0cc14ae/0xa2426164df2c8519 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.201.13@tcp remote: 0x633a354aa4df506f expref: 9 pid: 8557 timeout: 477 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783441539.529892:0:11514:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000f0cc14ae/0xa2426164df2c8519 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.201.13@tcp remote: 0x633a354aa4df506f expref: 9 pid: 8557 timeout: 477 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783441539.529921:0:11514:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000f0cc14ae/0xa2426164df2c8519 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.201.13@tcp remote: 0x633a354aa4df506f expref: 9 pid: 8557 timeout: 477 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783441539.529944:0:11514:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1783441539.529949:0:11514:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1783441539.529966:0:11514:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 000000001061a6f6/0xa2426164df2c8558 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 6581 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783441539.529978:0:11514:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000001061a6f6/0xa2426164df2c8558 lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 6581 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783441539.530026:0:11514:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1783441539.530097:0:11514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a87d6f0000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:65454767-383a-4679-a788-eba05c6e0989+8:2353:x1870073673374720:12345-192.168.201.13@tcp:103:ldlm_bl.0 Request processed in 472us (936us total) trans 0 rc 0/0 00000100:00100000:0.0:1783441539.530107:0:11514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.13@tcp, seq: 78 00010000:00010000:2.0:1783441539.530192:0:6581:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 000000001061a6f6/0xa2426164df2c8558 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6581 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783441539.530203:0:6581:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000001061a6f6/0xa2426164df2c8558 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6581 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783441539.530248:0:6581:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000001061a6f6/0xa2426164df2c8558 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6581 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783441539.530258:0:6581:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000001061a6f6/0xa2426164df2c8558 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6581 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783441539.530266:0:6581:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000001061a6f6/0xa2426164df2c8558 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6581 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783441539.530287:0:6581:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91a85eaa1800 already unused, calling callback (ffffffffc155ff90) 00010000:00010000:2.0:1783441539.530292:0:6581:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000001061a6f6/0xa2426164df2c8558 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6581 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783441539.530302:0:6581:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000001061a6f6/0xa2426164df2c8558 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6581 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783441539.530316:0:6581:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000001061a6f6/0xa2426164df2c8558 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6581 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783441539.530323:0:6581:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000001061a6f6/0xa2426164df2c8558 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6581 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783441539.530383:0:6581:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a87d7c6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:65454767-383a-4679-a788-eba05c6e0989+7:2355:x1870073673374464:12345-192.168.201.13@tcp:1:lfs.0 Request processed in 13314us (13949us total) trans 0 rc 0/0 00000100:00100000:2.0:1783441539.530392:0:6581:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.13@tcp, seq: 62 00000100:00100000:1.0:1783441539.533640:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.13@tcp (source: 12345-192.168.201.13@tcp) 00000100:00100000:3.0:1783441539.534209:0:5788:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073673374976 00000100:00100000:3.0:1783441539.534222:0:5788:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073673374976 00000100:00100000:1.0:1783441539.534481:0:5788:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.13@tcp, seq: 56 00000100:00100000:1.0:1783441539.534506:0:5788:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a846865450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:65454767-383a-4679-a788-eba05c6e0989+44:11544:x1870073673374976:12345-192.168.201.13@tcp:35:lfs.0 00000004:00010000:1.0:1783441539.534611:0:5788:0:(mdt_open.c:1998:mdt_hsm_release()) ### [0x200000401:0xe:0x0] lease broken? 0 ns: mdt-lustre-MDT0000_UUID lock: ffff91a85eaa1c00/0xa2426164df2c854a lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.13@tcp remote: 0x633a354aa4df5084 expref: 44 pid: 5787 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1783441539.535249:0:5788:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967488 00000001:00080000:1.0:1783441539.535310:0:5788:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967489 00000001:00080000:1.0:1783441539.536140:0:5788:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967490 00010000:00010000:1.0:1783441539.536208:0:5788:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff91a87da46600/0xa2426164df2c855f lrc: 3/0,1 mode: --/EX res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783441539.536230:0:5788:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff91a85eaa1a00/0xa2426164df2c8504 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.13@tcp remote: 0x633a354aa4df5061 expref: 48 pid: 5785 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783441539.536259:0:5788:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff91a87da46600/0xa2426164df2c855f lrc: 4/0,1 mode: --/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783441539.536358:0:5788:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff91a85eaa1a00/0xa2426164df2c8504 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.13@tcp remote: 0x633a354aa4df5061 expref: 48 pid: 5785 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783441539.536376:0:5788:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff91a85eaa1a00/0xa2426164df2c8504 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.13@tcp remote: 0x633a354aa4df5061 expref: 48 pid: 5785 timeout: 477 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783441539.536393:0:5788:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff91a87da6aa00 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000_UUID:5788:1870073693290240:192.168.201.13@tcp:104: 00000100:00100000:1.0:1783441539.536507:0:5788:0:(client.c:2702:ptlrpc_set_wait()) set ffff91a84619e300 going to sleep for 11 seconds 00000100:00100000:1.0:1783441539.541605:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.13@tcp (source: 12345-192.168.201.13@tcp) 00000100:00100000:3.0:1783441539.541702:0:11015:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073673375104 00000100:00100000:3.0:1783441539.541714:0:11015:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073673375104 00010000:00010000:3.0:1783441539.541800:0:11015:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff91a85eaa1a00/0xa2426164df2c8504 lrc: 5/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.13@tcp remote: 0x633a354aa4df5061 expref: 49 pid: 5785 timeout: 477 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783441539.541880:0:11015:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.13@tcp, seq: 79 00000100:00100000:3.0:1783441539.541893:0:11015:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a87da6b100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:65454767-383a-4679-a788-eba05c6e0989+49:2355:x1870073673375104:12345-192.168.201.13@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1783441539.541912:0:11015:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1783441539.541921:0:11015:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff91a85eaa1a00/0xa2426164df2c8504 lrc: 5/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.13@tcp remote: 0x633a354aa4df5061 expref: 49 pid: 5785 timeout: 477 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783441539.541937:0:11015:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff91a85eaa1a00/0xa2426164df2c8504 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.13@tcp remote: 0x633a354aa4df5061 expref: 49 pid: 5785 timeout: 477 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783441539.541985:0:11015:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff91a8429bdf00) 00010000:00010000:3.0:1783441539.541991:0:11015:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff91a87da46600/0xa2426164df2c855f lrc: 3/0,1 mode: --/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783441539.542003:0:11015:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff91a87da46600/0xa2426164df2c855f lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 5788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783441539.542012:0:11015:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91a87da46600/0xa2426164df2c855f lrc: 4/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 5788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783441539.542035:0:11015:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1783441539.542111:0:11015:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a87da6b100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:65454767-383a-4679-a788-eba05c6e0989+49:2355:x1870073673375104:12345-192.168.201.13@tcp:103:ldlm_bl.0 Request processed in 220us (520us total) trans 0 rc 0/0 00000100:00100000:3.0:1783441539.542120:0:11015:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.13@tcp, seq: 79 00010000:00010000:2.0:1783441539.543157:0:5788:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91a85eaa1a00/0xa2426164df2c8504 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.13@tcp remote: 0x633a354aa4df5061 expref: 48 pid: 5785 timeout: 477 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783441539.543191:0:5788:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff91a87da6aa00 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000_UUID:5788:1870073693290240:192.168.201.13@tcp:104: 00010000:00010000:2.0:1783441539.543224:0:5788:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff91a87da46600/0xa2426164df2c855f lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783441539.543234:0:5788:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff91a87da46600/0xa2426164df2c855f lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783441539.543259:0:5788:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91a87da46600/0xa2426164df2c855f lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5788 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1783441539.543439:0:5788:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967491 00000001:00080000:2.0:1783441539.543726:0:5788:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967492 00000100:00100000:2.0:1783441539.545644:0:5788:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff91a87d7b9500 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:5788:1870073693290368:0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:2.0:1783441539.545761:0:5788:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783441539.545812:0:5788:0:(client.c:2702:ptlrpc_set_wait()) set ffff91a7410c8480 going to sleep for 11 seconds 00000100:00100000:3.0:1783441539.545855:0:5790:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073693290368 00000100:00100000:3.0:1783441539.545866:0:5790:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073693290368 00000100:00100000:3.0:1783441539.545939:0:5790:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:3.0:1783441539.545950:0:5790:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a87d7b8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:5788:x1870073693290368:12345-0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:3.0:1783441539.546196:0:5790:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a87d7b8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:5788:x1870073693290368:12345-0@lo:1000:mdt_rdpg00_000.0 Request processed in 247us (452us total) trans 0 rc 0/0 00000100:00100000:3.0:1783441539.546204:0:5790:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:2.0:1783441539.546271:0:5788:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff91a87d7b9500 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:5788:1870073693290368:0@lo:1000:mdt_rdpg00_000.0 00000001:00080000:2.0:1783441539.547428:0:5788:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967493 00000100:00100000:2.0:1783441539.547570:0:5788:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff91a87d7b9500 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:5788:1870073693290496:0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:2.0:1783441539.547636:0:5788:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783441539.547685:0:5788:0:(client.c:2702:ptlrpc_set_wait()) set ffff91a8486286c0 going to sleep for 11 seconds 00000100:00100000:3.0:1783441539.550990:0:5791:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073693290496 00000100:00100000:3.0:1783441539.551011:0:5791:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073693290496 00000100:00100000:3.0:1783441539.551118:0:5791:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:3.0:1783441539.551132:0:5791:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a87d7b8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:5788:x1870073693290496:12345-0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:3.0:1783441539.551528:0:5791:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a87d7b8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+7:5788:x1870073693290496:12345-0@lo:1000:mdt_rdpg00_000.0 Request processed in 398us (3891us total) trans 4294967309 rc 0/0 00000100:00100000:3.0:1783441539.551538:0:5791:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:2.0:1783441539.551984:0:5788:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff91a87d7b9500 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:5788:1870073693290496:0@lo:1000:mdt_rdpg00_000.0 00000001:00080000:2.0:1783441539.552115:0:5788:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967494 00010000:00010000:2.0:1783441539.552186:0:5788:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff91a87da46600/0xa2426164df2c855f lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783441539.552198:0:5788:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff91a87da46600/0xa2426164df2c855f lrc: 2/0,0 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783441539.552208:0:5788:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff91a87da46600/0xa2426164df2c855f lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783441539.552215:0:5788:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91a87da46600 already unused, calling callback (ffffffffc1f9b4f0) 00010000:00010000:2.0:1783441539.552221:0:5788:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91a87da46600/0xa2426164df2c855f lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783441539.552254:0:5788:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91a87da46600/0xa2426164df2c855f lrc: 4/0,0 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783441539.552279:0:5788:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff91a8429bdf00) 00010000:00010000:2.0:1783441539.552283:0:5788:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 28 00010000:00010000:2.0:1783441539.552293:0:5788:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff91a87da46600/0xa2426164df2c855f lrc: 2/0,0 mode: --/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783441539.552303:0:5788:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91a87da46600/0xa2426164df2c855f lrc: 0/0,0 mode: --/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5788 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:2.0:1783441539.552593:0:5788:0:(mdd_object.c:4010:mdd_close()) Object [0x200000401:0xf:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000040:00080000:2.0:1783441539.552709:0:5788:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].5, 64 off8512 00000004:00080000:2.0:1783441539.552720:0:5788:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 377426978044ns, next at 378426975996ns, rc = 0 00000001:00080000:2.0:1783441539.552726:0:5788:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967495 00010000:00010000:2.0:1783441539.552789:0:5788:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff91a8429bdf00) 00010000:00010000:2.0:1783441539.552792:0:5788:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:2.0:1783441539.552800:0:5788:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91a85eaa1c00/0xa2426164df2c854a lrc: 0/0,0 mode: --/PW res: [0x200000401:0xe:0x0].0x0 bits 0x4/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.13@tcp remote: 0x633a354aa4df5084 expref: 52 pid: 5787 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783441539.552936:0:5788:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a846865450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:65454767-383a-4679-a788-eba05c6e0989+51:11544:x1870073673374976:12345-192.168.201.13@tcp:35:lfs.0 Request processed in 18433us (19308us total) trans 4294967496 rc 0/0 00000100:00100000:2.0:1783441539.552946:0:5788:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.13@tcp, seq: 56 00000020:00080000:2.0:1783441539.552952:0:5788:0:(tgt_main.c:784:tgt_ses_key_exit()) total 9 transactions per RPC 00000100:00100000:1.0:1783441539.561922:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.13@tcp (source: 12345-192.168.201.13@tcp) 00000100:00100000:2.0:1783441539.562044:0:5785:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073673375232 00000100:00100000:2.0:1783441539.562174:0:5785:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073673375232 00000100:00100000:2.0:1783441539.562309:0:5785:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.13@tcp, seq: 203 00000100:00100000:2.0:1783441539.562322:0:5785:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a87da6aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:65454767-383a-4679-a788-eba05c6e0989+51:11544:x1870073673375232:12345-192.168.201.13@tcp:101:lfs.0 00010000:00010000:2.0:1783441539.562378:0:5785:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1783441539.562412:0:5785:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91a85eaa1a00/0xa2426164df2c8566 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x633a354aa4df508b expref: -99 pid: 5785 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783441539.562494:0:5785:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91a85eaa1a00/0xa2426164df2c8566 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.201.13@tcp remote: 0x633a354aa4df508b expref: 52 pid: 5785 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783441539.562512:0:5785:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff91a85eaa1a00/0xa2426164df2c8566 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.13@tcp remote: 0x633a354aa4df508b expref: 52 pid: 5785 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783441539.562535:0:5785:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff91a8429bdd00) 00010000:00010000:2.0:1783441539.562538:0:5785:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1783441539.562543:0:5785:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91a85eaa1a00, rc 0) 00000100:00100000:2.0:1783441539.562634:0:5785:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a87da6aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:65454767-383a-4679-a788-eba05c6e0989+52:11544:x1870073673375232:12345-192.168.201.13@tcp:101:lfs.0 Request processed in 315us (727us total) trans 0 rc 0/0 00000100:00100000:2.0:1783441539.562642:0:5785:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.13@tcp, seq: 203 00000100:00100000:3.0:1783441539.570934:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.13@tcp (source: 12345-192.168.201.13@tcp) 00000100:00100000:2.0:1783441539.571317:0:5789:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073673375488 00000100:00100000:2.0:1783441539.571330:0:5789:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073673375488 00000100:00100000:2.0:1783441539.571471:0:5789:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.13@tcp, seq: 57 00000100:00100000:2.0:1783441539.571485:0:5789:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a87d792d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:65454767-383a-4679-a788-eba05c6e0989+52:11544:x1870073673375488:12345-192.168.201.13@tcp:35:lfs.0 00000100:00100000:2.0:1783441539.571858:0:5789:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a87d792d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:65454767-383a-4679-a788-eba05c6e0989+53:11544:x1870073673375488:12345-192.168.201.13@tcp:35:lfs.0 Request processed in 374us (938us total) trans 4294967497 rc 0/0 00000100:00100000:2.0:1783441539.571867:0:5789:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.13@tcp, seq: 57 00000100:00100000:1.0:1783441539.692712:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.13@tcp (source: 12345-192.168.201.13@tcp) 00000100:00100000:0.0:1783441539.693804:0:6605:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073673375616 00000100:00100000:0.0:1783441539.693821:0:6605:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073673375616 00000100:00100000:0.0:1783441539.693973:0:6605:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.13@tcp, seq: 204 00000100:00100000:0.0:1783441539.693986:0:6605:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a875427b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:65454767-383a-4679-a788-eba05c6e0989+53:11555:x1870073673375616:12345-192.168.201.13@tcp:34:lfs.0 00010000:00010000:0.0:1783441539.694113:0:6605:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff91a85fe58800/0xa2426164df2c856d lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6605 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783441539.694162:0:6605:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91a85fe58800/0xa2426164df2c856d lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6605 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783441539.694177:0:6605:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91a85fe58800/0xa2426164df2c856d lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6605 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783441539.694198:0:6605:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff91a85fe58600/0xa2426164df2c8574 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6605 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783441539.694204:0:6605:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91a85fe58600/0xa2426164df2c8574 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6605 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783441539.694211:0:6605:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91a85fe58600/0xa2426164df2c8574 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6605 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783441539.694350:0:6605:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff91a85fe58a00/0xa2426164df2c857b lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6605 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783441539.694359:0:6605:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91a85fe58a00/0xa2426164df2c857b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6605 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783441539.694367:0:6605:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91a85fe58a00/0xa2426164df2c857b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6605 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1783441539.694422:0:6605:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff91a85fe58a00/0xa2426164df2c857b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6605 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783441539.694438:0:6605:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff91a85fe58800/0xa2426164df2c856d lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6605 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783441539.694445:0:6605:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff91a85fe58800/0xa2426164df2c856d lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6605 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783441539.694464:0:6605:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff91a85fe58800/0xa2426164df2c856d lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6605 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783441539.694471:0:6605:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91a85fe58800 already unused, calling callback (ffffffffc1f9b4f0) 00010000:00010000:0.0:1783441539.694476:0:6605:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91a85fe58800/0xa2426164df2c856d lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6605 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783441539.694497:0:6605:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91a85fe58800/0xa2426164df2c856d lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6605 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783441539.694514:0:6605:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff91a8429bdc00) 00010000:00010000:0.0:1783441539.694517:0:6605:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1783441539.694522:0:6605:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff91a85fe58800/0xa2426164df2c856d lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6605 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783441539.694529:0:6605:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91a85fe58800/0xa2426164df2c856d lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6605 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783441539.694546:0:6605:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff91a85fe58600/0xa2426164df2c8574 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6605 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783441539.694560:0:6605:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff91a85fe58600/0xa2426164df2c8574 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6605 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783441539.694567:0:6605:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff91a85fe58600/0xa2426164df2c8574 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6605 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783441539.694571:0:6605:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91a85fe58600 already unused, calling callback (ffffffffc1f9b4f0) 00010000:00010000:0.0:1783441539.694575:0:6605:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91a85fe58600/0xa2426164df2c8574 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6605 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783441539.694591:0:6605:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91a85fe58600/0xa2426164df2c8574 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6605 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783441539.694599:0:6605:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff91a8439b0500) 00010000:00010000:0.0:1783441539.694602:0:6605:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1783441539.694605:0:6605:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff91a85fe58600/0xa2426164df2c8574 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6605 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783441539.694611:0:6605:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91a85fe58600/0xa2426164df2c8574 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6605 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783441539.694628:0:6605:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff91a85fe58a00/0xa2426164df2c857b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6605 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783441539.694636:0:6605:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff91a85fe58a00/0xa2426164df2c857b lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6605 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783441539.694642:0:6605:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff91a85fe58a00/0xa2426164df2c857b lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6605 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783441539.694647:0:6605:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91a85fe58a00 already unused, calling callback (ffffffffc1f9b4f0) 00010000:00010000:0.0:1783441539.694649:0:6605:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91a85fe58a00/0xa2426164df2c857b lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6605 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783441539.694667:0:6605:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91a85fe58a00/0xa2426164df2c857b lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6605 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783441539.694675:0:6605:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff91a8429bdd00) 00010000:00010000:0.0:1783441539.694677:0:6605:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1783441539.694680:0:6605:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff91a85fe58a00/0xa2426164df2c857b lrc: 2/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6605 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783441539.694697:0:6605:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91a85fe58a00/0xa2426164df2c857b lrc: 0/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6605 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783441539.695585:0:6605:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a875427b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:65454767-383a-4679-a788-eba05c6e0989+53:11555:x1870073673375616:12345-192.168.201.13@tcp:34:lfs.0 Request processed in 1592us (2877us total) trans 0 rc 0/0 00000100:00100000:0.0:1783441539.695600:0:6605:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.13@tcp, seq: 204 00000100:00100000:0.0:1783441539.744140:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.13@tcp (source: 12345-192.168.201.13@tcp) 00000100:00100000:3.0:1783441539.744307:0:5786:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073673375872 00000100:00100000:3.0:1783441539.744321:0:5786:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073673375872 00000100:00100000:3.0:1783441539.744408:0:5786:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.13@tcp, seq: 205 00000100:00100000:3.0:1783441539.744421:0:5786:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a875691f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:65454767-383a-4679-a788-eba05c6e0989+53:11558:x1870073673375872:12345-192.168.201.13@tcp:101:lfs.0 00010000:00010000:3.0:1783441539.744452:0:5786:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1783441539.744482:0:5786:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91a841476e00/0xa2426164df2c8582 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x633a354aa4df5092 expref: -99 pid: 5786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783441539.745069:0:5786:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff91a841477c00/0xa2426164df2c8589 lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783441539.745089:0:5786:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91a841477c00/0xa2426164df2c8589 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783441539.745103:0:5786:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91a841477c00/0xa2426164df2c8589 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783441539.745134:0:5786:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff91a841477e00/0xa2426164df2c8590 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783441539.745142:0:5786:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91a841477e00/0xa2426164df2c8590 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783441539.745150:0:5786:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91a841477e00/0xa2426164df2c8590 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783441539.745321:0:5786:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff91a841477200/0xa2426164df2c8597 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783441539.745330:0:5786:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91a841477200/0xa2426164df2c8597 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783441539.745337:0:5786:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91a841477200/0xa2426164df2c8597 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1783441539.745348:0:5786:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xe:0x0]: returning size 9 00010000:00010000:3.0:1783441539.745777:0:5786:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff91a841477c00/0xa2426164df2c8589 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783441539.745787:0:5786:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff91a841477c00/0xa2426164df2c8589 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783441539.745795:0:5786:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff91a841477c00/0xa2426164df2c8589 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783441539.745801:0:5786:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91a841477c00 already unused, calling callback (ffffffffc1f9b4f0) 00010000:00010000:3.0:1783441539.745806:0:5786:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91a841477c00/0xa2426164df2c8589 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783441539.745827:0:5786:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91a841477c00/0xa2426164df2c8589 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783441539.745844:0:5786:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff91a8429bdc00) 00010000:00010000:3.0:1783441539.745847:0:5786:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1783441539.745854:0:5786:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff91a841477c00/0xa2426164df2c8589 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783441539.745860:0:5786:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91a841477c00/0xa2426164df2c8589 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783441539.745878:0:5786:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff91a841477e00/0xa2426164df2c8590 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783441539.745885:0:5786:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff91a841477e00/0xa2426164df2c8590 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783441539.745893:0:5786:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff91a841477e00/0xa2426164df2c8590 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783441539.745898:0:5786:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91a841477e00 already unused, calling callback (ffffffffc1f9b4f0) 00010000:00010000:3.0:1783441539.745901:0:5786:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91a841477e00/0xa2426164df2c8590 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783441539.745907:0:5786:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91a841477e00/0xa2426164df2c8590 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783441539.745915:0:5786:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff91a85faeec00) 00010000:00010000:3.0:1783441539.745917:0:5786:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1783441539.745920:0:5786:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff91a841477e00/0xa2426164df2c8590 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783441539.745936:0:5786:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91a841477e00/0xa2426164df2c8590 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783441539.746000:0:5786:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91a841476e00/0xa2426164df2c8582 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.13@tcp remote: 0x633a354aa4df5092 expref: 56 pid: 5786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783441539.746018:0:5786:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff91a841477200/0xa2426164df2c8597 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.13@tcp remote: 0x633a354aa4df5092 expref: 55 pid: 5786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783441539.746086:0:5786:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff91a8429bdd00) 00010000:00010000:3.0:1783441539.746089:0:5786:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1783441539.746092:0:5786:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91a841477200, rc 0) 00000100:00100000:3.0:1783441539.746258:0:5786:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a875691f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:65454767-383a-4679-a788-eba05c6e0989+55:11558:x1870073673375872:12345-192.168.201.13@tcp:101:lfs.0 Request processed in 1839us (2133us total) trans 4294967498 rc 0/0 00000100:00100000:3.0:1783441539.746268:0:5786:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.13@tcp, seq: 205 00000100:00100000:3.0:1783441539.749965:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.13@tcp (source: 12345-192.168.201.13@tcp) 00000100:00100000:2.0:1783441539.750171:0:5787:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073673376000 00000100:00100000:2.0:1783441539.750183:0:5787:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073673376000 00000100:00100000:2.0:1783441539.750304:0:5787:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.13@tcp, seq: 206 00000100:00100000:2.0:1783441539.750319:0:5787:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a87d790a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:65454767-383a-4679-a788-eba05c6e0989+55:11558:x1870073673376000:12345-192.168.201.13@tcp:54:lfs.0 00010000:00010000:2.0:1783441539.750435:0:5787:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff91a85eaa1c00/0xa2426164df2c85a5 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783441539.750469:0:5787:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91a85eaa1c00/0xa2426164df2c85a5 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783441539.750484:0:5787:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91a85eaa1c00/0xa2426164df2c85a5 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783441539.750530:0:5787:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff91a85eaa1c00/0xa2426164df2c85a5 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783441539.750538:0:5787:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff91a85eaa1c00/0xa2426164df2c85a5 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783441539.750545:0:5787:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff91a85eaa1c00/0xa2426164df2c85a5 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783441539.750561:0:5787:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91a85eaa1c00 already unused, calling callback (ffffffffc1f9b4f0) 00010000:00010000:2.0:1783441539.750567:0:5787:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91a85eaa1c00/0xa2426164df2c85a5 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783441539.750576:0:5787:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91a85eaa1c00/0xa2426164df2c85a5 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783441539.750591:0:5787:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff91a8429bdd00) 00010000:00010000:2.0:1783441539.750594:0:5787:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1783441539.750599:0:5787:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff91a85eaa1c00/0xa2426164df2c85a5 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783441539.750606:0:5787:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91a85eaa1c00/0xa2426164df2c85a5 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783441539.750734:0:5787:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a87d790a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:65454767-383a-4679-a788-eba05c6e0989+55:11558:x1870073673376000:12345-192.168.201.13@tcp:54:lfs.0 Request processed in 418us (783us total) trans 0 rc 0/0 00000100:00100000:2.0:1783441539.750784:0:5787:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.13@tcp, seq: 206 00000100:00100000:1.0:1783441539.754401:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.13@tcp (source: 12345-192.168.201.13@tcp) 00000100:00100000:2.0:1783441539.754633:0:5788:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073673376256 00000100:00100000:2.0:1783441539.754647:0:5788:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073673376256 00000100:00100000:2.0:1783441539.754791:0:5788:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.13@tcp, seq: 58 00000100:00100000:2.0:1783441539.754804:0:5788:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a875424e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:65454767-383a-4679-a788-eba05c6e0989+55:11558:x1870073673376256:12345-192.168.201.13@tcp:35:lfs.0 00000100:00100000:2.0:1783441539.755130:0:5788:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a875424e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:65454767-383a-4679-a788-eba05c6e0989+56:11558:x1870073673376256:12345-192.168.201.13@tcp:35:lfs.0 Request processed in 328us (744us total) trans 4294967499 rc 0/0 00000100:00100000:2.0:1783441539.755139:0:5788:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.13@tcp, seq: 58 00000100:00100000:1.0:1783441539.844409:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.13@tcp (source: 12345-192.168.201.13@tcp) 00000100:00100000:2.0:1783441539.844530:0:5785:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073673376512 00000100:00100000:2.0:1783441539.844544:0:5785:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073673376512 00000100:00100000:2.0:1783441539.844670:0:5785:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.13@tcp, seq: 207 00000100:00100000:2.0:1783441539.844682:0:5785:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a875426d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:65454767-383a-4679-a788-eba05c6e0989+56:11568:x1870073673376512:12345-192.168.201.13@tcp:101:bash.0 00010000:00010000:2.0:1783441539.844716:0:5785:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1783441539.844720:0:5785:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:2.0:1783441539.844917:0:5785:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91a87da47000/0xa2426164df2c8527 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.13@tcp remote: 0x633a354aa4df5076 expref: 56 pid: 6605 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783441539.844945:0:5785:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff91a8429bdc00) 00010000:00010000:2.0:1783441539.844952:0:5785:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1783441539.845032:0:5785:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91a85eaa1c00/0xa2426164df2c85ac lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x633a354aa4df5099 expref: -99 pid: 5785 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783441539.845166:0:5785:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff91a85eaa1800/0xa2426164df2c85b3 lrc: 3/0,1 mode: --/CW res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783441539.845197:0:5785:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff91a841477200/0xa2426164df2c8597 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.13@tcp remote: 0x633a354aa4df5092 expref: 56 pid: 5786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783441539.845208:0:5785:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff91a85eaa1800/0xa2426164df2c85b3 lrc: 4/0,1 mode: --/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783441539.845249:0:5785:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff91a841477200/0xa2426164df2c8597 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.13@tcp remote: 0x633a354aa4df5092 expref: 56 pid: 5786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783441539.845265:0:5785:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff91a841477200/0xa2426164df2c8597 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.13@tcp remote: 0x633a354aa4df5092 expref: 56 pid: 5786 timeout: 477 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783441539.845283:0:5785:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff91a87d7bb480 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5785:1870073693290624:192.168.201.13@tcp:104: 00000100:00100000:2.0:1783441539.845543:0:5785:0:(client.c:2702:ptlrpc_set_wait()) set ffff91a8486280c0 going to sleep for 11 seconds 00000100:00100000:0.0:1783441539.853472:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.13@tcp (source: 12345-192.168.201.13@tcp) 00000100:00100000:3.0:1783441539.853895:0:5770:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073673376640 00000100:00100000:3.0:1783441539.853908:0:5770:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073673376640 00010000:00010000:3.0:1783441539.854039:0:5770:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff91a841477200/0xa2426164df2c8597 lrc: 5/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.13@tcp remote: 0x633a354aa4df5092 expref: 57 pid: 5786 timeout: 477 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783441539.854093:0:5770:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.13@tcp, seq: 80 00000100:00100000:3.0:1783441539.854105:0:5770:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a874dc4380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:65454767-383a-4679-a788-eba05c6e0989+57:2355:x1870073673376640:12345-192.168.201.13@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1783441539.854123:0:5770:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1783441539.854131:0:5770:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff91a841477200/0xa2426164df2c8597 lrc: 5/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.13@tcp remote: 0x633a354aa4df5092 expref: 57 pid: 5786 timeout: 477 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783441539.854171:0:5770:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff91a841477200/0xa2426164df2c8597 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.13@tcp remote: 0x633a354aa4df5092 expref: 57 pid: 5786 timeout: 477 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783441539.854200:0:5770:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff91a8429bdd00) 00010000:00010000:3.0:1783441539.854206:0:5770:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff91a85eaa1800/0xa2426164df2c85b3 lrc: 3/0,1 mode: --/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783441539.854218:0:5770:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff91a85eaa1800/0xa2426164df2c85b3 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783441539.854226:0:5770:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91a85eaa1800/0xa2426164df2c85b3 lrc: 4/0,1 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783441539.854250:0:5770:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1783441539.854324:0:5770:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a874dc4380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:65454767-383a-4679-a788-eba05c6e0989+57:2355:x1870073673376640:12345-192.168.201.13@tcp:103:ldlm_bl.0 Request processed in 221us (870us total) trans 0 rc 0/0 00000100:00100000:3.0:1783441539.854333:0:5770:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.13@tcp, seq: 80 00010000:00010000:2.0:1783441539.854969:0:5785:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91a841477200/0xa2426164df2c8597 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.13@tcp remote: 0x633a354aa4df5092 expref: 56 pid: 5786 timeout: 477 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783441539.854991:0:5785:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff91a87d7bb480 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5785:1870073693290624:192.168.201.13@tcp:104: 00010000:00010000:2.0:1783441539.855020:0:5785:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff91a85eaa1800/0xa2426164df2c85b3 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783441539.855030:0:5785:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff91a85eaa1800/0xa2426164df2c85b3 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783441539.855036:0:5785:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91a85eaa1800/0xa2426164df2c85b3 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1783441539.855059:0:5785:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xe:0x0]: returning size 9 00010000:00010000:2.0:1783441539.855261:0:5785:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91a85eaa1c00/0xa2426164df2c85ac lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.13@tcp remote: 0x633a354aa4df5099 expref: 57 pid: 5785 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783441539.855279:0:5785:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff91a85eaa1800/0xa2426164df2c85b3 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.13@tcp remote: 0x633a354aa4df5099 expref: 56 pid: 5785 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783441539.855288:0:5785:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff91a8429bdd00) 00010000:00010000:2.0:1783441539.855292:0:5785:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:2.0:1783441539.855294:0:5785:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91a85eaa1800, rc 0) 00000100:00100000:2.0:1783441539.855355:0:5785:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a875426d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:65454767-383a-4679-a788-eba05c6e0989+56:11568:x1870073673376512:12345-192.168.201.13@tcp:101:bash.0 Request processed in 10675us (10960us total) trans 4294967500 rc 0/0 00000100:00100000:2.0:1783441539.855363:0:5785:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.13@tcp, seq: 207 00000100:00100000:0.0:1783441539.858431:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.13@tcp (source: 12345-192.168.201.13@tcp) 00000100:00100000:1.0:1783441539.858605:0:6605:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073673376896 00000100:00100000:1.0:1783441539.858618:0:6605:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073673376896 00000100:00100000:1.0:1783441539.858695:0:6605:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.13@tcp, seq: 208 00000100:00100000:1.0:1783441539.858707:0:6605:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a874dc5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:65454767-383a-4679-a788-eba05c6e0989+56:11568:x1870073673376896:12345-192.168.201.13@tcp:36:bash.0 00010000:00010000:1.0:1783441539.859098:0:6605:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff91a87da46600/0xa2426164df2c85c1 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6605 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783441539.859120:0:6605:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91a87da46600/0xa2426164df2c85c1 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6605 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783441539.859133:0:6605:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91a87da46600/0xa2426164df2c85c1 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6605 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1783441539.859217:0:6605:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967501 00000004:00010000:1.0:1783441539.859244:0:6605:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000a0f21ead reply state 0000000008dd15fa transno 4294967502 ns: mdt-lustre-MDT0000_UUID lock: ffff91a87da46600/0xa2426164df2c85c1 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6605 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783441539.859255:0:6605:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1783441539.859371:0:6605:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a874dc5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:65454767-383a-4679-a788-eba05c6e0989+59:11568:x1870073673376896:12345-192.168.201.13@tcp:36:bash.0 Request processed in 664us (952us total) trans 4294967502 rc 0/0 00000100:00100000:1.0:1783441539.859379:0:6605:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.13@tcp, seq: 208 00000020:00080000:1.0:1783441539.859385:0:6605:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:1.0:1783441539.863468:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.13@tcp (source: 12345-192.168.201.13@tcp) 00010000:00010000:2.0:1783441539.863582:0:3289:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff91a87da46600/0xa2426164df2c85c1 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6605 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783441539.863598:0:3289:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff91a87da46600/0xa2426164df2c85c1 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6605 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783441539.863606:0:3289:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff91a87da46600/0xa2426164df2c85c1 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6605 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783441539.863613:0:3289:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91a87da46600 already unused, calling callback (ffffffffc1f9b4f0) 00010000:00010000:2.0:1783441539.863620:0:3289:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91a87da46600/0xa2426164df2c85c1 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6605 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783441539.863628:0:3289:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91a87da46600/0xa2426164df2c85c1 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6605 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783441539.863652:0:3289:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff91a8429bdd00) 00010000:00010000:2.0:1783441539.863655:0:3289:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1783441539.863677:0:3289:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff91a87da46600/0xa2426164df2c85c1 lrc: 2/0,0 mode: --/PW res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6605 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783441539.863684:0:3289:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91a87da46600/0xa2426164df2c85c1 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6605 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783441539.863884:0:5786:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073673377024 00000100:00100000:3.0:1783441539.863899:0:5786:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073673377024 00000100:00100000:3.0:1783441539.863970:0:5786:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.13@tcp, seq: 209 00000100:00100000:3.0:1783441539.863983:0:5786:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a87531ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:65454767-383a-4679-a788-eba05c6e0989+58:11568:x1870073673377024:12345-192.168.201.13@tcp:101:bash.0 00010000:00010000:3.0:1783441539.864016:0:5786:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1783441539.864041:0:5786:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91a841476e00/0xa2426164df2c85c8 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x633a354aa4df50a0 expref: -99 pid: 5786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783441539.864153:0:5786:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff91a841477e00/0xa2426164df2c85cf lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783441539.864186:0:5786:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff91a85eaa1800/0xa2426164df2c85b3 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.13@tcp remote: 0x633a354aa4df5099 expref: 59 pid: 5785 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783441539.864196:0:5786:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff91a841477e00/0xa2426164df2c85cf lrc: 4/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x13/0x8 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783441539.864246:0:5786:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff91a85eaa1800/0xa2426164df2c85b3 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.13@tcp remote: 0x633a354aa4df5099 expref: 59 pid: 5785 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783441539.864264:0:5786:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff91a85eaa1800/0xa2426164df2c85b3 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.13@tcp remote: 0x633a354aa4df5099 expref: 59 pid: 5785 timeout: 477 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783441539.864283:0:5786:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff91a87d792a00 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5786:1870073693290752:192.168.201.13@tcp:104: 00000100:00100000:3.0:1783441539.864411:0:5786:0:(client.c:2702:ptlrpc_set_wait()) set ffff91a8488976c0 going to sleep for 11 seconds 00000100:00100000:2.0:1783441539.877939:0:5786:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff91a87d792a00 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5786:1870073693290752:192.168.201.13@tcp:104: 00010000:00010000:2.0:1783441539.877990:0:5786:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff91a841477e00/0xa2426164df2c85cf lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x13/0x8 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783441539.878232:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.13@tcp (source: 12345-192.168.201.13@tcp) 00000100:00100000:3.0:1783441539.879470:0:11514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073673377152 00000100:00100000:3.0:1783441539.879496:0:11514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073673377152 00010000:00010000:3.0:1783441539.879565:0:11514:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff91a85eaa1800/0xa2426164df2c85b3 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.13@tcp remote: 0x633a354aa4df5099 expref: 60 pid: 5785 timeout: 477 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783441539.879624:0:11514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.13@tcp, seq: 81 00000100:00100000:3.0:1783441539.879635:0:11514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a87d681c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:65454767-383a-4679-a788-eba05c6e0989+60:2355:x1870073673377152:12345-192.168.201.13@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1783441539.879653:0:11514:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1783441539.879662:0:11514:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff91a85eaa1800/0xa2426164df2c85b3 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.13@tcp remote: 0x633a354aa4df5099 expref: 60 pid: 5785 timeout: 477 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783441539.879677:0:11514:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff91a85eaa1800/0xa2426164df2c85b3 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.13@tcp remote: 0x633a354aa4df5099 expref: 60 pid: 5785 timeout: 477 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783441539.879727:0:11514:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91a85eaa1800/0xa2426164df2c85b3 lrc: 0/0,0 mode: --/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.13@tcp remote: 0x633a354aa4df5099 expref: 60 pid: 5785 timeout: 477 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783441539.879793:0:11514:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff91a8429bdd00) 00010000:00010000:3.0:1783441539.879801:0:11514:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff91a841477e00/0xa2426164df2c85cf lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x13/0x8 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783441539.879814:0:11514:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff91a841477e00/0xa2426164df2c85cf lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783441539.879823:0:11514:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91a841477e00/0xa2426164df2c85cf lrc: 4/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783441539.879855:0:11514:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1783441539.879933:0:11514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a87d681c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:65454767-383a-4679-a788-eba05c6e0989+59:2355:x1870073673377152:12345-192.168.201.13@tcp:103:ldlm_bl.0 Request processed in 299us (1702us total) trans 0 rc 0/0 00000100:00100000:3.0:1783441539.879941:0:11514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.13@tcp, seq: 81 00010000:00010000:0.0:1783441539.880064:0:5786:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff91a841477e00/0xa2426164df2c85cf lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783441539.880074:0:5786:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91a841477e00/0xa2426164df2c85cf lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1783441539.880137:0:5786:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xe:0x0]: returning size 0 00000004:00200000:0.0:1783441539.880143:0:5786:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:0.0:1783441539.880171:0:5786:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff91a841477e00/0xa2426164df2c85cf lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783441539.880210:0:5786:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91a841476e00/0xa2426164df2c85c8 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.13@tcp remote: 0x633a354aa4df50a0 expref: 60 pid: 5786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783441539.880226:0:5786:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff91a841477e00/0xa2426164df2c85cf lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.13@tcp remote: 0x633a354aa4df50a0 expref: 59 pid: 5786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783441539.880234:0:5786:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff91a8429bdd00) 00010000:00010000:0.0:1783441539.880237:0:5786:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1783441539.880247:0:5786:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91a841477e00, rc 0) 00000100:00100000:0.0:1783441539.880277:0:5786:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a87531ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:65454767-383a-4679-a788-eba05c6e0989+59:11568:x1870073673377024:12345-192.168.201.13@tcp:101:bash.0 Request processed in 16298us (16826us total) trans 0 rc 0/0 00000100:00100000:0.0:1783441539.880285:0:5786:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.13@tcp, seq: 209 00000100:00100000:0.0:1783441539.887284:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.13@tcp (source: 12345-192.168.201.13@tcp) 00000100:00100000:3.0:1783441539.887389:0:5789:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073673377408 00000100:00100000:3.0:1783441539.887401:0:5789:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073673377408 00000100:00100000:3.0:1783441539.887490:0:5789:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.13@tcp, seq: 59 00000100:00100000:3.0:1783441539.887503:0:5789:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a874dc5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:65454767-383a-4679-a788-eba05c6e0989+58:11568:x1870073673377408:12345-192.168.201.13@tcp:35:bash.0 00000100:00100000:3.0:1783441539.887860:0:5789:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a874dc5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:65454767-383a-4679-a788-eba05c6e0989+59:11568:x1870073673377408:12345-192.168.201.13@tcp:35:bash.0 Request processed in 359us (590us total) trans 4294967503 rc 0/0 00000100:00100000:3.0:1783441539.887869:0:5789:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.13@tcp, seq: 59 00000100:00100000:3.0:1783441539.949505:0:3303:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1783441539.949537:0:3303:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff91a87d683480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3303:1870073693290880:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1783441539.949669:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783441539.950004:0:6584:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073693290880 00000100:00100000:0.0:1783441539.950015:0:6584:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073693290880 00000100:00100000:0.0:1783441539.950087:0:6584:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 75 00000100:00100000:0.0:1783441539.950100:0:6584:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a87d791f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3303:x1870073693290880:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1783441539.950150:0:6584:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1783441539.950208:0:6584:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a87d791f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3303:x1870073693290880:12345-0@lo:13:osp-pre-0-0.0 Request processed in 111us (538us total) trans 0 rc 0/0 00000100:00100000:0.0:1783441539.950216:0:6584:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 75 00000100:00100000:3.0:1783441539.950495:0:3303:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff91a87d683480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3303:1870073693290880:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1783441539.961814:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.13@tcp (source: 12345-192.168.201.13@tcp) 00000100:00100000:0.0:1783441539.961883:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.13@tcp (source: 12345-192.168.201.13@tcp) 00000100:00100000:2.0:1783441539.962604:0:6583:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073673377664 00000100:00100000:2.0:1783441539.962620:0:6583:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073673377664 00000100:00100000:2.0:1783441539.962716:0:6583:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.13@tcp, seq: 97 00000100:00100000:2.0:1783441539.962727:0:6583:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a874dc5f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:65454767-383a-4679-a788-eba05c6e0989+9:2354:x1870073673377664:12345-192.168.201.13@tcp:400:kworker.0 00000100:00100000:2.0:1783441539.962875:0:6583:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a874dc5f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:65454767-383a-4679-a788-eba05c6e0989+9:2354:x1870073673377664:12345-192.168.201.13@tcp:400:kworker.0 Request processed in 149us (1078us total) trans 0 rc 0/0 00000100:00100000:2.0:1783441539.962884:0:6583:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.13@tcp, seq: 97 00000100:00100000:3.0:1783441539.963535:0:5779:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073673377536 00000100:00100000:3.0:1783441539.963544:0:5779:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073673377536 00000100:00100000:3.0:1783441539.963605:0:5779:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.13@tcp, seq: 299 00000100:00100000:3.0:1783441539.963614:0:5779:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a848f35450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:51c2a82e-e792-4f56-84e8-12cc033e9e70+13:2354:x1870073673377536:12345-192.168.201.13@tcp:400:kworker.0 00000100:00100000:3.0:1783441539.963672:0:5779:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a848f35450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:51c2a82e-e792-4f56-84e8-12cc033e9e70+13:2354:x1870073673377536:12345-192.168.201.13@tcp:400:kworker.0 Request processed in 58us (1787us total) trans 0 rc 0/0 00000100:00100000:3.0:1783441539.963679:0:5779:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.13@tcp, seq: 299 00000100:00080000:0.0:1783441539.963767:0:5781:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1783441539.969394:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.13@tcp (source: 12345-192.168.201.13@tcp) 00000100:00100000:1.0:1783441539.969594:0:6605:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073673377792 00000100:00100000:1.0:1783441539.969609:0:6605:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073673377792 00000100:00100000:1.0:1783441539.969708:0:6605:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.13@tcp, seq: 172 00000100:00100000:1.0:1783441539.969723:0:6605:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a874dc7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:d5aa2a25-c618-49e9-a833-85b3b4747e53+5:2355:x1870073673377792:12345-192.168.201.13@tcp:400:kworker.0 00000100:00100000:1.0:1783441539.969874:0:6605:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a874dc7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:d5aa2a25-c618-49e9-a833-85b3b4747e53+5:2355:x1870073673377792:12345-192.168.201.13@tcp:400:kworker.0 Request processed in 156us (495us total) trans 0 rc 0/0 00000100:00100000:1.0:1783441539.969883:0:6605:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.13@tcp, seq: 172 00000100:00080000:0.0:1783441539.970375:0:5781:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1783441539.983297:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.13@tcp (source: 12345-192.168.201.13@tcp) 00000100:00100000:2.0:1783441539.983407:0:5785:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073673377920 00000100:00100000:2.0:1783441539.983422:0:5785:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073673377920 00000100:00100000:2.0:1783441539.983513:0:5785:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.13@tcp, seq: 210 00000100:00100000:2.0:1783441539.983525:0:5785:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a87d680380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:65454767-383a-4679-a788-eba05c6e0989+59:11574:x1870073673377920:12345-192.168.201.13@tcp:101:lfs.0 00010000:00010000:2.0:1783441539.983568:0:5785:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1783441539.983606:0:5785:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91a85eaa1400/0xa2426164df2c85d6 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x633a354aa4df50a7 expref: -99 pid: 5785 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783441539.983725:0:5785:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff91a85eaa0200/0xa2426164df2c85dd lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783441539.983787:0:5785:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91a85eaa0200/0xa2426164df2c85dd lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783441539.983808:0:5785:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91a85eaa0200/0xa2426164df2c85dd lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1783441539.983889:0:5785:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xa:0x0]: returning size 7680 00000004:00200000:2.0:1783441539.983893:0:5785:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 1 stripe count 1 MDT count 1 00000004:00010000:2.0:1783441539.983920:0:5785:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff91a85eaa0200/0xa2426164df2c85dd lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783441539.983949:0:5785:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91a85eaa1400/0xa2426164df2c85d6 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.13@tcp remote: 0x633a354aa4df50a7 expref: 61 pid: 5785 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783441539.983985:0:5785:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff91a85eaa0200/0xa2426164df2c85dd lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.13@tcp remote: 0x633a354aa4df50a7 expref: 60 pid: 5785 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783441539.983994:0:5785:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff91a8429bdc00) 00010000:00010000:2.0:1783441539.983997:0:5785:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1783441539.984002:0:5785:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91a85eaa0200, rc 0) 00000100:00100000:2.0:1783441539.984084:0:5785:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a87d680380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:65454767-383a-4679-a788-eba05c6e0989+60:11574:x1870073673377920:12345-192.168.201.13@tcp:101:lfs.0 Request processed in 560us (801us total) trans 0 rc 0/0 00000100:00100000:2.0:1783441539.984091:0:5785:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.13@tcp, seq: 210 00000100:00100000:3.0:1783441539.988444:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.13@tcp (source: 12345-192.168.201.13@tcp) 00000100:00100000:1.0:1783441539.988530:0:6605:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073673378048 00000100:00100000:1.0:1783441539.988544:0:6605:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073673378048 00000100:00100000:1.0:1783441539.988679:0:6605:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.13@tcp, seq: 211 00000100:00100000:1.0:1783441539.988692:0:6605:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a87d790700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:65454767-383a-4679-a788-eba05c6e0989+60:11574:x1870073673378048:12345-192.168.201.13@tcp:101:lfs.0 00010000:00010000:1.0:1783441539.988720:0:6605:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1783441539.988793:0:6605:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91a87da47c00/0xa2426164df2c85e4 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x633a354aa4df50ae expref: -99 pid: 6605 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783441539.988912:0:6605:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff91a87da46600/0xa2426164df2c85eb lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6605 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783441539.988931:0:6605:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91a87da46600/0xa2426164df2c85eb lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6605 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783441539.988945:0:6605:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91a87da46600/0xa2426164df2c85eb lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6605 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783441539.988976:0:6605:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff91a87da47000/0xa2426164df2c85f2 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6605 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783441539.988985:0:6605:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91a87da47000/0xa2426164df2c85f2 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6605 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783441539.988993:0:6605:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91a87da47000/0xa2426164df2c85f2 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6605 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783441539.989129:0:6605:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff91a87da47200/0xa2426164df2c85f9 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6605 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783441539.989139:0:6605:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91a87da47200/0xa2426164df2c85f9 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6605 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783441539.989146:0:6605:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91a87da47200/0xa2426164df2c85f9 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6605 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1783441539.989192:0:6605:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xe:0x0]: returning size 0 00000004:00200000:1.0:1783441539.989197:0:6605:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:1.0:1783441539.989221:0:6605:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff91a87da47200/0xa2426164df2c85f9 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6605 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783441539.989247:0:6605:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91a87da47200/0xa2426164df2c85f9 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6605 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783441539.989257:0:6605:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff91a87da46600/0xa2426164df2c85eb lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6605 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783441539.989265:0:6605:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff91a87da46600/0xa2426164df2c85eb lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 6605 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783441539.989272:0:6605:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff91a87da46600/0xa2426164df2c85eb lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6605 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783441539.989278:0:6605:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91a87da46600 already unused, calling callback (ffffffffc1f9b4f0) 00010000:00010000:1.0:1783441539.989283:0:6605:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91a87da46600/0xa2426164df2c85eb lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6605 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783441539.989291:0:6605:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91a87da46600/0xa2426164df2c85eb lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 6605 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783441539.989306:0:6605:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff91a8429bdc00) 00010000:00010000:1.0:1783441539.989309:0:6605:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1783441539.989314:0:6605:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff91a87da46600/0xa2426164df2c85eb lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6605 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783441539.989321:0:6605:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91a87da46600/0xa2426164df2c85eb lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6605 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783441539.989339:0:6605:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff91a87da47000/0xa2426164df2c85f2 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6605 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783441539.989346:0:6605:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff91a87da47000/0xa2426164df2c85f2 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6605 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783441539.989357:0:6605:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff91a87da47000/0xa2426164df2c85f2 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6605 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783441539.989363:0:6605:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91a87da47000 already unused, calling callback (ffffffffc1f9b4f0) 00010000:00010000:1.0:1783441539.989366:0:6605:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91a87da47000/0xa2426164df2c85f2 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6605 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783441539.989372:0:6605:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91a87da47000/0xa2426164df2c85f2 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6605 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783441539.989380:0:6605:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff91a858b90300) 00010000:00010000:1.0:1783441539.989383:0:6605:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1783441539.989385:0:6605:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff91a87da47000/0xa2426164df2c85f2 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6605 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783441539.989390:0:6605:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91a87da47000/0xa2426164df2c85f2 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6605 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783441539.989431:0:6605:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91a87da47c00/0xa2426164df2c85e4 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.13@tcp remote: 0x633a354aa4df50ae expref: 62 pid: 6605 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783441539.989444:0:6605:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff91a87da47200/0xa2426164df2c85f9 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.13@tcp remote: 0x633a354aa4df50ae expref: 61 pid: 6605 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783441539.989451:0:6605:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff91a8429bdd00) 00010000:00010000:1.0:1783441539.989453:0:6605:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1783441539.989456:0:6605:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91a87da47200, rc 0) 00000100:00100000:1.0:1783441539.989541:0:6605:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a87d790700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:65454767-383a-4679-a788-eba05c6e0989+61:11574:x1870073673378048:12345-192.168.201.13@tcp:101:lfs.0 Request processed in 852us (1108us total) trans 0 rc 0/0 00000100:00100000:1.0:1783441539.989569:0:6605:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.13@tcp, seq: 211 00000100:00100000:2.0:1783441539.994283:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.13@tcp (source: 12345-192.168.201.13@tcp) 00000100:00100000:2.0:1783441539.994380:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.13@tcp (source: 12345-192.168.201.13@tcp) 00000100:00100000:0.0:1783441539.994435:0:5785:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073673378304 00000100:00100000:0.0:1783441539.994449:0:5785:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073673378304 00000100:00100000:0.0:1783441539.994710:0:5785:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.13@tcp, seq: 212 00000100:00100000:0.0:1783441539.994723:0:5785:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a87d7bb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:65454767-383a-4679-a788-eba05c6e0989+61:11574:x1870073673378304:12345-192.168.201.13@tcp:101:lfs.0 00000100:00100000:3.0:1783441539.994781:0:5771:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073673378432 00010000:00010000:0.0:1783441539.994781:0:5785:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:3.0:1783441539.994787:0:5771:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073673378432 00010000:00010000:0.0:1783441539.994810:0:5785:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91a85fe59000/0xa2426164df2c8600 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x633a354aa4df50b5 expref: -99 pid: 5785 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783441539.994826:0:5771:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.13@tcp, seq: 14 00000100:00100000:3.0:1783441539.994833:0:5771:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a87d7b9880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:65454767-383a-4679-a788-eba05c6e0989+63:2355:x1870073673378432:12345-192.168.201.13@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1783441539.994847:0:5771:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1783441539.994871:0:5771:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91a87da47200/0xa2426164df2c85f9 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.13@tcp remote: 0x633a354aa4df50ae expref: 63 pid: 6605 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783441539.994895:0:5771:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff91a8429bdd00) 00010000:00010000:3.0:1783441539.994901:0:5771:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1783441539.994928:0:5785:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff91a85fe59c00/0xa2426164df2c8607 lrc: 3/0,1 mode: --/CW res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783441539.994964:0:5771:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a87d7b9880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:65454767-383a-4679-a788-eba05c6e0989+62:2355:x1870073673378432:12345-192.168.201.13@tcp:103:ldlm_bl.0 Request processed in 130us (582us total) trans 0 rc 0/0 00000100:00100000:3.0:1783441539.994972:0:5771:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.13@tcp, seq: 14 00010000:00010000:0.0:1783441539.994983:0:5785:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff91a841477e00/0xa2426164df2c85cf lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.13@tcp remote: 0x633a354aa4df50a0 expref: 62 pid: 5786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783441539.994993:0:5785:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff91a85fe59c00/0xa2426164df2c8607 lrc: 4/0,1 mode: --/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783441539.995032:0:5785:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff91a841477e00/0xa2426164df2c85cf lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.13@tcp remote: 0x633a354aa4df50a0 expref: 61 pid: 5786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783441539.995046:0:5785:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff91a841477e00/0xa2426164df2c85cf lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.13@tcp remote: 0x633a354aa4df50a0 expref: 61 pid: 5786 timeout: 477 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783441539.995061:0:5785:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff91a874dc5c00 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5785:1870073693291008:192.168.201.13@tcp:104: 00000100:00100000:0.0:1783441539.995929:0:5785:0:(client.c:2702:ptlrpc_set_wait()) set ffff91a87d8009c0 going to sleep for 11 seconds 00000100:00100000:0.0:1783441540.002654:0:5785:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff91a874dc5c00 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5785:1870073693291008:192.168.201.13@tcp:104: 00010000:00010000:0.0:1783441540.002702:0:5785:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff91a85fe59c00/0xa2426164df2c8607 lrc: 3/0,1 mode: --/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783441540.003574:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.13@tcp (source: 12345-192.168.201.13@tcp) 00000100:00100000:0.0:1783441540.003878:0:5769:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073673378560 00000100:00100000:0.0:1783441540.003891:0:5769:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073673378560 00010000:00010000:0.0:1783441540.004092:0:5769:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff91a841477e00/0xa2426164df2c85cf lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.13@tcp remote: 0x633a354aa4df50a0 expref: 62 pid: 5786 timeout: 477 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783441540.004143:0:5769:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.13@tcp, seq: 82 00000100:00100000:0.0:1783441540.004155:0:5769:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a846f74c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:65454767-383a-4679-a788-eba05c6e0989+62:2354:x1870073673378560:12345-192.168.201.13@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1783441540.004176:0:5769:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1783441540.004195:0:5769:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff91a841477e00/0xa2426164df2c85cf lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.13@tcp remote: 0x633a354aa4df50a0 expref: 62 pid: 5786 timeout: 477 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783441540.004209:0:5769:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff91a841477e00/0xa2426164df2c85cf lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.13@tcp remote: 0x633a354aa4df50a0 expref: 62 pid: 5786 timeout: 477 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783441540.004242:0:5769:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91a841477e00/0xa2426164df2c85cf lrc: 0/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.13@tcp remote: 0x633a354aa4df50a0 expref: 62 pid: 5786 timeout: 477 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783441540.004263:0:5769:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff91a8429bdd00) 00010000:00010000:0.0:1783441540.004269:0:5769:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff91a85fe59c00/0xa2426164df2c8607 lrc: 3/0,1 mode: --/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783441540.004280:0:5769:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff91a85fe59c00/0xa2426164df2c8607 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783441540.004289:0:5769:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91a85fe59c00/0xa2426164df2c8607 lrc: 4/0,1 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783441540.004329:0:5769:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1783441540.004404:0:5769:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a846f74c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:65454767-383a-4679-a788-eba05c6e0989+61:2354:x1870073673378560:12345-192.168.201.13@tcp:103:ldlm_bl.0 Request processed in 250us (835us total) trans 0 rc 0/0 00000100:00100000:0.0:1783441540.004413:0:5769:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.13@tcp, seq: 82 00010000:00010000:3.0:1783441540.004651:0:5785:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff91a85fe59c00/0xa2426164df2c8607 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783441540.004661:0:5785:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91a85fe59c00/0xa2426164df2c8607 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1783441540.004693:0:5785:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xe:0x0]: returning size 0 00010000:00010000:3.0:1783441540.004948:0:5785:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91a85fe59000/0xa2426164df2c8600 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.13@tcp remote: 0x633a354aa4df50b5 expref: 62 pid: 5785 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783441540.005044:0:5785:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff91a85fe59c00/0xa2426164df2c8607 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.13@tcp remote: 0x633a354aa4df50b5 expref: 61 pid: 5785 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783441540.005052:0:5785:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff91a8429bdd00) 00010000:00010000:3.0:1783441540.005055:0:5785:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:3.0:1783441540.005057:0:5785:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91a85fe59c00, rc 0) 00000100:00100000:3.0:1783441540.005100:0:5785:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a87d7bb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:65454767-383a-4679-a788-eba05c6e0989+61:11574:x1870073673378304:12345-192.168.201.13@tcp:101:lfs.0 Request processed in 10382us (10833us total) trans 4294967504 rc 0/0 00000100:00100000:3.0:1783441540.005107:0:5785:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.13@tcp, seq: 212 00000100:00100000:3.0:1783441540.009039:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.13@tcp (source: 12345-192.168.201.13@tcp) 00000100:00080000:1.0:1783441540.009300:0:5781:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1783441540.009998:0:11514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073673378816 00000100:00100000:0.0:1783441540.010015:0:11514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073673378816 00000100:00100000:0.0:1783441540.010117:0:11514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.13@tcp, seq: 15 00000100:00100000:0.0:1783441540.010130:0:11514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a87d791c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:65454767-383a-4679-a788-eba05c6e0989+61:11574:x1870073673378816:12345-192.168.201.13@tcp:103:lfs.0 00010000:00010000:0.0:1783441540.010151:0:11514:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1783441540.010187:0:11514:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91a85eaa1a00/0xa2426164df2c8566 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.13@tcp remote: 0x633a354aa4df508b expref: 61 pid: 5785 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783441540.010232:0:11514:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff91a8429bdd00) 00010000:00010000:0.0:1783441540.010240:0:11514:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1783441540.010335:0:11514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a87d791c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:65454767-383a-4679-a788-eba05c6e0989+60:11574:x1870073673378816:12345-192.168.201.13@tcp:103:lfs.0 Request processed in 206us (1312us total) trans 0 rc 0/0 00000100:00100000:0.0:1783441540.010344:0:11514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.13@tcp, seq: 15 00000100:00100000:0.0:1783441540.013159:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.13@tcp (source: 12345-192.168.201.13@tcp) 00000100:00100000:2.0:1783441540.013278:0:5787:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073673378944 00000100:00100000:2.0:1783441540.013291:0:5787:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073673378944 00000100:00100000:2.0:1783441540.014136:0:5787:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.13@tcp, seq: 213 00000100:00100000:2.0:1783441540.014153:0:5787:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a874dc4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:65454767-383a-4679-a788-eba05c6e0989+60:11574:x1870073673378944:12345-192.168.201.13@tcp:58:lfs.0 00010000:00010000:2.0:1783441540.014295:0:5787:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff91a85eaa1200/0xa2426164df2c8615 lrc: 3/0,1 mode: --/EX res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783441540.014334:0:5787:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91a85eaa1200/0xa2426164df2c8615 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783441540.014349:0:5787:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91a85eaa1200/0xa2426164df2c8615 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1783441540.014642:0:5787:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].5, 136 off8872 00000100:00100000:2.0:1783441540.014941:0:5787:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a874dc4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:65454767-383a-4679-a788-eba05c6e0989+60:11574:x1870073673378944:12345-192.168.201.13@tcp:58:lfs.0 Request processed in 791us (1796us total) trans 0 rc 0/0 00000100:00100000:2.0:1783441540.014952:0:5787:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.13@tcp, seq: 213 00000100:00100000:2.0:1783441540.022425:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.13@tcp (source: 12345-192.168.201.13@tcp) 00000100:00100000:0.0:1783441540.022707:0:5786:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073673379072 00000100:00100000:0.0:1783441540.022720:0:5786:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073673379072 00000100:00100000:0.0:1783441540.022871:0:5786:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.13@tcp, seq: 214 00000100:00100000:0.0:1783441540.022883:0:5786:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a87d7ba680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:65454767-383a-4679-a788-eba05c6e0989+60:11574:x1870073673379072:12345-192.168.201.13@tcp:101:lfs.0 00010000:00010000:0.0:1783441540.022909:0:5786:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1783441540.022937:0:5786:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91a85fe58600/0xa2426164df2c861c lrc: 2/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x633a354aa4df50bc expref: -99 pid: 5786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783441540.023013:0:5786:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff91a85eaa1200/0xa2426164df2c8615 lrc: 2/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783441540.023026:0:5786:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff91a85fe58600/0xa2426164df2c861c lrc: 4/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.201.13@tcp remote: 0x633a354aa4df50bc expref: 61 pid: 5786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783441540.023051:0:5786:0:(ldlm_request.c:385:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: mdt-lustre-MDT0000_UUID lock: ffff91a85eaa1200/0xa2426164df2c8615 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000020 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783441540.023066:0:5786:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff91a85fe58600/0xa2426164df2c861c lrc: 3/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.13@tcp remote: 0x633a354aa4df50bc expref: 61 pid: 5786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783441540.023083:0:5786:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff91a8429bdd00) 00010000:00010000:0.0:1783441540.023104:0:5786:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1783441540.023109:0:5786:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff91a85fe58600/0xa2426164df2c861c lrc: 3/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.13@tcp remote: 0x633a354aa4df50bc expref: 61 pid: 5786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783441540.023118:0:5786:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91a85fe58600, rc 0) 00000100:00100000:0.0:1783441540.023203:0:5786:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a87d7ba680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:65454767-383a-4679-a788-eba05c6e0989+61:11574:x1870073673379072:12345-192.168.201.13@tcp:101:lfs.0 Request processed in 321us (794us total) trans 0 rc 0/0 00000100:00100000:0.0:1783441540.023210:0:5786:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.13@tcp, seq: 214 00010000:00010000:1.0:1783441540.269045:0:5773:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:2.0:1783441540.333165:0:11531:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:2.0:1783441540.333179:0:11531:0:(llog_cat.c:841:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1783441540.333221:0:11531:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 6 count 3 00000040:00080000:2.0:1783441540.333228:0:11531:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:2.0:1783441540.333390:0:11531:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff91a87d7bbb80 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:11531:1870073693291136:192.168.201.13@tcp:107:hsm_cdtr.0 00000100:00100000:2.0:1783441540.334817:0:11531:0:(client.c:2702:ptlrpc_set_wait()) set ffff91a848628000 going to sleep for 11 seconds 00000100:00100000:2.0:1783441540.343291:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.13@tcp (source: 12345-192.168.201.13@tcp) 00000100:00100000:3.0:1783441540.343708:0:11531:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff91a87d7bbb80 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:11531:1870073693291136:192.168.201.13@tcp:107:hsm_cdtr.0 00000100:00100000:0.0:1783441540.346730:0:6605:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073673379200 00000100:00100000:0.0:1783441540.346763:0:6605:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073673379200 00000100:00100000:0.0:1783441540.349256:0:6605:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.13@tcp, seq: 215 00000100:00100000:0.0:1783441540.349293:0:6605:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a87d7b9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:65454767-383a-4679-a788-eba05c6e0989+61:11575:x1870073673379200:12345-192.168.201.13@tcp:53:lhsmtool_posix.0 00000004:00000080:0.0:1783441540.349375:0:6605:0:(mdt_handler.c:7960:mdt_fid2path()) path get [0x200000401:0xe:0x0] from 18446744073709551615 #0 00000100:00100000:0.0:1783441540.350004:0:6605:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a87d7b9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:65454767-383a-4679-a788-eba05c6e0989+61:11575:x1870073673379200:12345-192.168.201.13@tcp:53:lhsmtool_posix.0 Request processed in 727us (6727us total) trans 0 rc 0/0 00000100:00100000:0.0:1783441540.350014:0:6605:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.13@tcp, seq: 215 00000100:00100000:0.0:1783441540.353071:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.13@tcp (source: 12345-192.168.201.13@tcp) 00000100:00100000:3.0:1783441540.358215:0:5785:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073673379328 00000100:00100000:3.0:1783441540.358238:0:5785:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073673379328 00000100:00100000:3.0:1783441540.358395:0:5785:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.13@tcp, seq: 216 00000100:00100000:3.0:1783441540.358408:0:5785:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a874dc5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:65454767-383a-4679-a788-eba05c6e0989+61:11575:x1870073673379328:12345-192.168.201.13@tcp:34:lhsmtool_posix.0 00010000:00010000:3.0:1783441540.358518:0:5785:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff91a841477c00/0xa2426164df2c8623 lrc: 3/1,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783441540.358552:0:5785:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91a841477c00/0xa2426164df2c8623 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783441540.358567:0:5785:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91a841477c00/0xa2426164df2c8623 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783441540.358624:0:5785:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff91a841476e00/0xa2426164df2c862a lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0xafd4eada bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783441540.358631:0:5785:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91a841476e00/0xa2426164df2c862a lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xafd4eada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783441540.358638:0:5785:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91a841476e00/0xa2426164df2c862a lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xafd4eada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783441540.358668:0:5785:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff91a841477200/0xa2426164df2c8631 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783441540.358677:0:5785:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91a841477200/0xa2426164df2c8631 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783441540.358683:0:5785:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91a841477200/0xa2426164df2c8631 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1783441540.358736:0:5785:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xe:0x0]: returning size 0 00000004:00200000:3.0:1783441540.358769:0:5785:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:3.0:1783441540.358784:0:5785:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff91a841477200/0xa2426164df2c8631 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783441540.358796:0:5785:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff91a841477c00/0xa2426164df2c8623 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783441540.358802:0:5785:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff91a841477c00/0xa2426164df2c8623 lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783441540.358810:0:5785:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff91a841477c00/0xa2426164df2c8623 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783441540.358841:0:5785:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91a841477c00 already unused, calling callback (ffffffffc1f9b4f0) 00010000:00010000:3.0:1783441540.358847:0:5785:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91a841477c00/0xa2426164df2c8623 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783441540.358855:0:5785:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91a841477c00/0xa2426164df2c8623 lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783441540.358882:0:5785:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff91a858b90e00) 00010000:00010000:3.0:1783441540.358885:0:5785:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1783441540.358891:0:5785:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff91a841477c00/0xa2426164df2c8623 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783441540.358897:0:5785:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91a841477c00/0xa2426164df2c8623 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783441540.358916:0:5785:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff91a841476e00/0xa2426164df2c862a lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xafd4eada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783441540.358923:0:5785:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff91a841476e00/0xa2426164df2c862a lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xafd4eada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783441540.358929:0:5785:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff91a841476e00/0xa2426164df2c862a lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xafd4eada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783441540.358934:0:5785:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91a841476e00 already unused, calling callback (ffffffffc1f9b4f0) 00010000:00010000:3.0:1783441540.358937:0:5785:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91a841476e00/0xa2426164df2c862a lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xafd4eada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783441540.358944:0:5785:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91a841476e00/0xa2426164df2c862a lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xafd4eada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783441540.358963:0:5785:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0xafd4eada (ffff91a85faeec00) 00010000:00010000:3.0:1783441540.358966:0:5785:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1783441540.358969:0:5785:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff91a841476e00/0xa2426164df2c862a lrc: 2/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0xafd4eada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783441540.358975:0:5785:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91a841476e00/0xa2426164df2c862a lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0xafd4eada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783441540.358995:0:5785:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff91a841477200/0xa2426164df2c8631 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783441540.359001:0:5785:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff91a841477200/0xa2426164df2c8631 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783441540.359007:0:5785:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff91a841477200/0xa2426164df2c8631 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783441540.359012:0:5785:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91a841477200 already unused, calling callback (ffffffffc1f9b4f0) 00010000:00010000:3.0:1783441540.359015:0:5785:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91a841477200/0xa2426164df2c8631 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783441540.359021:0:5785:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91a841477200/0xa2426164df2c8631 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783441540.359028:0:5785:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff91a8429bdd00) 00010000:00010000:3.0:1783441540.359030:0:5785:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1783441540.359033:0:5785:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff91a841477200/0xa2426164df2c8631 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783441540.359038:0:5785:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91a841477200/0xa2426164df2c8631 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783441540.359158:0:5785:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a874dc5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:65454767-383a-4679-a788-eba05c6e0989+61:11575:x1870073673379328:12345-192.168.201.13@tcp:34:lhsmtool_posix.0 Request processed in 750us (6098us total) trans 0 rc 0/0 00000100:00100000:3.0:1783441540.359168:0:5785:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.13@tcp, seq: 216 00000100:00100000:2.0:1783441540.366686:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.13@tcp (source: 12345-192.168.201.13@tcp) 00000100:00100000:3.0:1783441540.366939:0:5787:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073673379584 00000100:00100000:3.0:1783441540.366954:0:5787:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073673379584 00000100:00100000:3.0:1783441540.367036:0:5787:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.13@tcp, seq: 217 00000100:00100000:3.0:1783441540.367048:0:5787:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a87d7bad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:65454767-383a-4679-a788-eba05c6e0989+61:11575:x1870073673379584:12345-192.168.201.13@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1783441540.367080:0:5787:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1783441540.367106:0:5787:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91a841476000/0xa2426164df2c8638 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x633a354aa4df50c3 expref: -99 pid: 5787 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783441540.367247:0:5787:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff91a841476800/0xa2426164df2c863f lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783441540.367266:0:5787:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91a841476800/0xa2426164df2c863f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783441540.367281:0:5787:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91a841476800/0xa2426164df2c863f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1783441540.367296:0:5787:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xe:0x0]: returning size 0 00010000:00010000:3.0:1783441540.367434:0:5787:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff91a841476800/0xa2426164df2c863f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783441540.367444:0:5787:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff91a841476800/0xa2426164df2c863f lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783441540.367450:0:5787:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff91a841476800/0xa2426164df2c863f lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783441540.367477:0:5787:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91a841476800 already unused, calling callback (ffffffffc1f9b4f0) 00010000:00010000:3.0:1783441540.367482:0:5787:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91a841476800/0xa2426164df2c863f lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783441540.367489:0:5787:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91a841476800/0xa2426164df2c863f lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783441540.367504:0:5787:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff91a8429bdd00) 00010000:00010000:3.0:1783441540.367507:0:5787:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:3.0:1783441540.367513:0:5787:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff91a841476800/0xa2426164df2c863f lrc: 2/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783441540.367520:0:5787:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91a841476800/0xa2426164df2c863f lrc: 0/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783441540.367586:0:5787:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff91a841476000/0xa2426164df2c8638 lrc: 1/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.13@tcp remote: 0x633a354aa4df50c3 expref: 63 pid: 5787 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783441540.367610:0:5787:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff91a858b90e00) 00010000:00010000:3.0:1783441540.367612:0:5787:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1783441540.367617:0:5787:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91a841476000/0xa2426164df2c8638 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.13@tcp remote: 0x633a354aa4df50c3 expref: 63 pid: 5787 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783441540.367628:0:5787:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91a841476000, rc 0) 00000100:00100000:3.0:1783441540.367727:0:5787:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a87d7bad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:65454767-383a-4679-a788-eba05c6e0989+62:11575:x1870073673379584:12345-192.168.201.13@tcp:101:lhsmtool_posix.0 Request processed in 681us (1059us total) trans 4294967505 rc 301/301 00000100:00100000:3.0:1783441540.367736:0:5787:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.13@tcp, seq: 217 00000100:00100000:2.0:1783441540.373320:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.13@tcp (source: 12345-192.168.201.13@tcp) 00000100:00100000:0.0:1783441540.373444:0:5786:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073673379712 00000100:00100000:0.0:1783441540.373460:0:5786:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073673379712 00000100:00100000:0.0:1783441540.373555:0:5786:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.13@tcp, seq: 218 00000100:00100000:0.0:1783441540.373567:0:5786:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a87d7b8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:65454767-383a-4679-a788-eba05c6e0989+62:11575:x1870073673379712:12345-192.168.201.13@tcp:53:lhsmtool_posix.0 00000004:00000080:0.0:1783441540.373625:0:5786:0:(mdt_handler.c:7960:mdt_fid2path()) path get [0x200000401:0xe:0x0] from 18446744073709551615 #0 00000100:00100000:0.0:1783441540.374013:0:5786:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a87d7b8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:65454767-383a-4679-a788-eba05c6e0989+62:11575:x1870073673379712:12345-192.168.201.13@tcp:53:lhsmtool_posix.0 Request processed in 447us (709us total) trans 0 rc 0/0 00000100:00100000:0.0:1783441540.374022:0:5786:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.13@tcp, seq: 218 00000100:00100000:1.0:1783441540.380301:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.13@tcp (source: 12345-192.168.201.13@tcp) 00000100:00100000:3.0:1783441540.383284:0:5787:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073673379968 00000100:00100000:3.0:1783441540.383326:0:5787:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073673379968 00000100:00100000:1.0:1783441540.383797:0:5787:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.13@tcp, seq: 219 00000100:00100000:1.0:1783441540.383811:0:5787:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a87d682a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:65454767-383a-4679-a788-eba05c6e0989+62:11575:x1870073673379968:12345-192.168.201.13@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1783441540.383851:0:5787:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1783441540.383856:0:5787:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:1.0:1783441540.383893:0:5787:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91a85eaa0200/0xa2426164df2c85dd lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.13@tcp remote: 0x633a354aa4df50a7 expref: 62 pid: 5785 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783441540.383918:0:5787:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff91a8429bdc00) 00010000:00010000:1.0:1783441540.383925:0:5787:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1783441540.383944:0:5787:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91a87da47000/0xa2426164df2c864d lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x633a354aa4df50ca expref: -99 pid: 5787 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:1.0:1783441540.384496:0:5787:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x6:0x0], index 0: 0 00010000:00010000:1.0:1783441540.385166:0:5787:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff91a87da46600/0xa2426164df2c8654 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x10:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783441540.385184:0:5787:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91a87da46600/0xa2426164df2c8654 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783441540.385197:0:5787:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91a87da46600/0xa2426164df2c8654 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783441540.385274:0:5787:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91a87da47000/0xa2426164df2c864d lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.13@tcp remote: 0x633a354aa4df50ca expref: 64 pid: 5787 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783441540.385321:0:5787:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff91a87da46600/0xa2426164df2c8654 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.13@tcp remote: 0x633a354aa4df50ca expref: 63 pid: 5787 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783441540.385331:0:5787:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff91a858b90300) 00010000:00010000:1.0:1783441540.385335:0:5787:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1783441540.385338:0:5787:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91a87da46600, rc 0) 00000100:00100000:1.0:1783441540.385445:0:5787:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a87d682a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:65454767-383a-4679-a788-eba05c6e0989+63:11575:x1870073673379968:12345-192.168.201.13@tcp:101:lhsmtool_posix.0 Request processed in 1637us (5157us total) trans 4294967506 rc 0/0 00000100:00100000:1.0:1783441540.385455:0:5787:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.13@tcp, seq: 219 00000100:00100000:2.0:1783441540.392199:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.13@tcp (source: 12345-192.168.201.13@tcp) 00000100:00100000:0.0:1783441540.392314:0:5786:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073673380224 00000100:00100000:0.0:1783441540.392343:0:5786:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073673380224 00000100:00100000:0.0:1783441540.392422:0:5786:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.13@tcp, seq: 220 00000100:00100000:0.0:1783441540.392433:0:5786:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a87d7baa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:65454767-383a-4679-a788-eba05c6e0989+63:11575:x1870073673380224:12345-192.168.201.13@tcp:36:lhsmtool_posix.0 00010000:00010000:0.0:1783441540.392517:0:5786:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1783441540.392568:0:5786:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91a87da46600/0xa2426164df2c8654 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x10:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.13@tcp remote: 0x633a354aa4df50ca expref: 63 pid: 5787 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783441540.392596:0:5786:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff91a858b90300) 00010000:00010000:0.0:1783441540.392613:0:5786:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1783441540.392643:0:5786:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff91a85fe59a00/0xa2426164df2c8662 lrc: 3/0,1 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783441540.392659:0:5786:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91a85fe59a00/0xa2426164df2c8662 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783441540.392671:0:5786:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91a85fe59a00/0xa2426164df2c8662 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783441540.392689:0:5786:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff91a85fe59200/0xa2426164df2c8669 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xa:0x0].0xc0c9df0a bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783441540.392697:0:5786:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91a85fe59200/0xa2426164df2c8669 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0xc0c9df0a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783441540.392704:0:5786:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91a85fe59200/0xa2426164df2c8669 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0xc0c9df0a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783441540.393171:0:5786:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff91a85fe59a00/0xa2426164df2c8662 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783441540.393181:0:5786:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff91a85fe59a00/0xa2426164df2c8662 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783441540.393198:0:5786:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff91a85fe59a00/0xa2426164df2c8662 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783441540.393204:0:5786:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91a85fe59a00 already unused, calling callback (ffffffffc1f9b4f0) 00010000:00010000:0.0:1783441540.393210:0:5786:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91a85fe59a00/0xa2426164df2c8662 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783441540.393219:0:5786:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91a85fe59a00/0xa2426164df2c8662 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783441540.393230:0:5786:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff91a8429bdc00) 00010000:00010000:0.0:1783441540.393234:0:5786:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1783441540.393238:0:5786:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff91a85fe59a00/0xa2426164df2c8662 lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783441540.393245:0:5786:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91a85fe59a00/0xa2426164df2c8662 lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783441540.393256:0:5786:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff91a85fe59200/0xa2426164df2c8669 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0xc0c9df0a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783441540.393263:0:5786:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff91a85fe59200/0xa2426164df2c8669 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0xc0c9df0a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783441540.393269:0:5786:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff91a85fe59200/0xa2426164df2c8669 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0xc0c9df0a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783441540.393273:0:5786:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91a85fe59200 already unused, calling callback (ffffffffc1f9b4f0) 00010000:00010000:0.0:1783441540.393277:0:5786:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91a85fe59200/0xa2426164df2c8669 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0xc0c9df0a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783441540.393293:0:5786:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91a85fe59200/0xa2426164df2c8669 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0xc0c9df0a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783441540.393303:0:5786:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0xc0c9df0a (ffff91a8439b0500) 00010000:00010000:0.0:1783441540.393305:0:5786:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1783441540.393309:0:5786:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff91a85fe59200/0xa2426164df2c8669 lrc: 2/0,0 mode: --/PW res: [0x200000401:0xa:0x0].0xc0c9df0a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783441540.393315:0:5786:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91a85fe59200/0xa2426164df2c8669 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xa:0x0].0xc0c9df0a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783441540.396678:0:5786:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a87d7baa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:65454767-383a-4679-a788-eba05c6e0989+62:11575:x1870073673380224:12345-192.168.201.13@tcp:36:lhsmtool_posix.0 Request processed in 4226us (4473us total) trans 0 rc -2/-2 00000100:00100000:0.0:1783441540.396697:0:5786:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.13@tcp, seq: 220 00000100:00100000:3.0:1783441540.403407:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.13@tcp (source: 12345-192.168.201.13@tcp) 00000100:00100000:0.0:1783441540.403507:0:6605:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073673380352 00000100:00100000:0.0:1783441540.403520:0:6605:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073673380352 00000100:00100000:0.0:1783441540.403707:0:6605:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.13@tcp, seq: 221 00000100:00100000:0.0:1783441540.403720:0:6605:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a87d793100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:65454767-383a-4679-a788-eba05c6e0989+62:11575:x1870073673380352:12345-192.168.201.13@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1783441540.403793:0:6605:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1783441540.403948:0:6605:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91a85fe58000/0xa2426164df2c8670 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x10:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x633a354aa4df50d1 expref: -99 pid: 6605 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783441540.404004:0:6605:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff91a85fe58400/0xa2426164df2c8677 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x10:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6605 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783441540.404022:0:6605:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91a85fe58400/0xa2426164df2c8677 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6605 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783441540.404035:0:6605:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91a85fe58400/0xa2426164df2c8677 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6605 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783441540.404182:0:6605:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91a85fe58000/0xa2426164df2c8670 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x10:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.13@tcp remote: 0x633a354aa4df50d1 expref: 64 pid: 6605 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783441540.404206:0:6605:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff91a85fe58400/0xa2426164df2c8677 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.13@tcp remote: 0x633a354aa4df50d1 expref: 63 pid: 6605 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783441540.404217:0:6605:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff91a8439b0000) 00010000:00010000:0.0:1783441540.404220:0:6605:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:0.0:1783441540.404225:0:6605:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91a85fe58400, rc 0) 00000100:00100000:0.0:1783441540.404368:0:6605:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a87d793100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:65454767-383a-4679-a788-eba05c6e0989+63:11575:x1870073673380352:12345-192.168.201.13@tcp:101:lhsmtool_posix.0 Request processed in 651us (978us total) trans 0 rc 0/0 00000100:00100000:0.0:1783441540.404377:0:6605:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.13@tcp, seq: 221 00000100:00100000:1.0:1783441540.409529:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.13@tcp (source: 12345-192.168.201.13@tcp) 00000100:00100000:3.0:1783441540.409709:0:5785:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073673380608 00000100:00100000:3.0:1783441540.409722:0:5785:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073673380608 00000100:00100000:2.0:1783441540.410707:0:5785:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.13@tcp, seq: 222 00000100:00100000:2.0:1783441540.410723:0:5785:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a87d682680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:65454767-383a-4679-a788-eba05c6e0989+63:11575:x1870073673380608:12345-192.168.201.13@tcp:36:lhsmtool_posix.0 00010000:00010000:2.0:1783441540.411188:0:5785:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff91a85eaa1800/0xa2426164df2c867e lrc: 3/0,1 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783441540.411213:0:5785:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91a85eaa1800/0xa2426164df2c867e lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783441540.411250:0:5785:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91a85eaa1800/0xa2426164df2c867e lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1783441540.411616:0:5785:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].8, 88 off8800 00000004:00080000:2.0:1783441540.411627:0:5785:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 378285885562ns, next at 379285883212ns, rc = 0 00000004:00010000:2.0:1783441540.411770:0:5785:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 000000003221e3b2 reply state 00000000b0430f58 transno 4294967507 ns: mdt-lustre-MDT0000_UUID lock: ffff91a85eaa1800/0xa2426164df2c867e lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783441540.411783:0:5785:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1783441540.412717:0:5785:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a87d682680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:65454767-383a-4679-a788-eba05c6e0989+65:11575:x1870073673380608:12345-192.168.201.13@tcp:36:lhsmtool_posix.0 Request processed in 1986us (3191us total) trans 4294967507 rc 0/0 00000100:00100000:2.0:1783441540.412730:0:5785:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.13@tcp, seq: 222 00000100:00100000:2.0:1783441540.417566:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.13@tcp (source: 12345-192.168.201.13@tcp) 00000100:00100000:1.0:1783441540.417800:0:6605:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073673380736 00000100:00100000:1.0:1783441540.417815:0:6605:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073673380736 00000100:00100000:1.0:1783441540.417912:0:6605:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.13@tcp, seq: 223 00000100:00100000:1.0:1783441540.417924:0:6605:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a87d7b9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:65454767-383a-4679-a788-eba05c6e0989+65:11575:x1870073673380736:12345-192.168.201.13@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1783441540.417960:0:6605:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1783441540.418002:0:6605:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91a87da46000/0xa2426164df2c8685 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x10:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x633a354aa4df50d8 expref: -99 pid: 6605 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783441540.418560:0:6605:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91a87da46000/0xa2426164df2c8685 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.201.13@tcp remote: 0x633a354aa4df50d8 expref: 66 pid: 6605 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783441540.418581:0:6605:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff91a87da46000/0xa2426164df2c8685 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.13@tcp remote: 0x633a354aa4df50d8 expref: 66 pid: 6605 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783441540.418608:0:6605:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff91a8439b0000) 00010000:00010000:1.0:1783441540.418632:0:6605:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1783441540.418637:0:6605:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91a87da46000, rc 0) 00000100:00100000:1.0:1783441540.418729:0:6605:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a87d7b9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:65454767-383a-4679-a788-eba05c6e0989+66:11575:x1870073673380736:12345-192.168.201.13@tcp:101:lhsmtool_posix.0 Request processed in 806us (1194us total) trans 0 rc 0/0 00000100:00100000:1.0:1783441540.418738:0:6605:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.13@tcp, seq: 223 00000100:00100000:3.0:1783441540.421626:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.13@tcp (source: 12345-192.168.201.13@tcp) 00000100:00100000:1.0:1783441540.421933:0:6582:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073673380864 00000100:00100000:1.0:1783441540.421947:0:6582:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073673380864 00000100:00100000:1.0:1783441540.422073:0:6582:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.13@tcp, seq: 63 00000100:00100000:1.0:1783441540.422084:0:6582:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a87d790e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:65454767-383a-4679-a788-eba05c6e0989+9:2354:x1870073673380864:12345-192.168.201.13@tcp:2:lhsmtool_posix.0 00000100:00100000:1.0:1783441540.422506:0:6582:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a87d790e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:65454767-383a-4679-a788-eba05c6e0989+10:2354:x1870073673380864:12345-192.168.201.13@tcp:2:lhsmtool_posix.0 Request processed in 422us (894us total) trans 4294967319 rc 0/0 00000100:00100000:1.0:1783441540.422515:0:6582:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.13@tcp, seq: 63 00010000:00010000:0.0:1783441540.423180:0:3290:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff91a85eaa1800/0xa2426164df2c867e lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783441540.423196:0:3290:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff91a85eaa1800/0xa2426164df2c867e lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783441540.423206:0:3290:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff91a85eaa1800/0xa2426164df2c867e lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783441540.423213:0:3290:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91a85eaa1800 already unused, calling callback (ffffffffc1f9b4f0) 00010000:00010000:0.0:1783441540.423218:0:3290:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91a85eaa1800/0xa2426164df2c867e lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783441540.423227:0:3290:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91a85eaa1800/0xa2426164df2c867e lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783441540.423249:0:3290:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff91a8439b0000) 00010000:00010000:0.0:1783441540.423272:0:3290:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:0.0:1783441540.423278:0:3290:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff91a85eaa1800/0xa2426164df2c867e lrc: 2/0,0 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783441540.423285:0:3290:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91a85eaa1800/0xa2426164df2c867e lrc: 0/0,0 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783441540.425801:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.13@tcp (source: 12345-192.168.201.13@tcp) 00000100:00100000:0.0:1783441540.425924:0:5789:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073673381120 00000100:00100000:0.0:1783441540.425938:0:5789:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073673381120 00000100:00100000:0.0:1783441540.426007:0:5789:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.13@tcp, seq: 60 00000100:00100000:0.0:1783441540.426019:0:5789:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a87d792300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:65454767-383a-4679-a788-eba05c6e0989+65:11575:x1870073673381120:12345-192.168.201.13@tcp:35:lhsmtool_posix.0 00000100:00100000:1.0:1783441540.427416:0:5789:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a87d792300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:65454767-383a-4679-a788-eba05c6e0989+66:11575:x1870073673381120:12345-192.168.201.13@tcp:35:lhsmtool_posix.0 Request processed in 1387us (1617us total) trans 4294967508 rc 0/0 00000100:00100000:1.0:1783441540.427432:0:5789:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.13@tcp, seq: 60 00000100:00100000:2.0:1783441540.433072:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.13@tcp (source: 12345-192.168.201.13@tcp) 00000100:00100000:0.0:1783441540.433187:0:5786:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073673381376 00000100:00100000:0.0:1783441540.433200:0:5786:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073673381376 00000100:00100000:0.0:1783441540.433315:0:5786:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.13@tcp, seq: 224 00000100:00100000:0.0:1783441540.433329:0:5786:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a87d7b8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:65454767-383a-4679-a788-eba05c6e0989+66:11575:x1870073673381376:12345-192.168.201.13@tcp:57:lhsmtool_posix.0 00000100:00100000:0.0:1783441540.433498:0:5786:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a87d7b8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:65454767-383a-4679-a788-eba05c6e0989+66:11575:x1870073673381376:12345-192.168.201.13@tcp:57:lhsmtool_posix.0 Request processed in 171us (756us total) trans 0 rc 0/0 00000100:00100000:0.0:1783441540.433507:0:5786:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.13@tcp, seq: 224 00000100:00100000:3.0:1783441540.435939:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.13@tcp (source: 12345-192.168.201.13@tcp) 00000100:00100000:2.0:1783441540.436559:0:5785:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073673381504 00000100:00100000:2.0:1783441540.436575:0:5785:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073673381504 00000100:00100000:2.0:1783441540.436663:0:5785:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.13@tcp, seq: 225 00000100:00100000:2.0:1783441540.436674:0:5785:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a87d793800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:65454767-383a-4679-a788-eba05c6e0989+66:11575:x1870073673381504:12345-192.168.201.13@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1783441540.436704:0:5785:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1783441540.436730:0:5785:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91a85eaa1c00/0xa2426164df2c868c lrc: 2/0,0 mode: --/CR res: [0x200000401:0x10:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x633a354aa4df50df expref: -99 pid: 5785 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783441540.436861:0:5785:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff91a85eaa1400/0xa2426164df2c8693 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x10:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783441540.436879:0:5785:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91a85eaa1400/0xa2426164df2c8693 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783441540.436918:0:5785:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91a85eaa1400/0xa2426164df2c8693 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1783441540.436971:0:5785:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1783441540.436995:0:5785:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff91a85eaa1400/0xa2426164df2c8693 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783441540.437028:0:5785:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91a85eaa1c00/0xa2426164df2c868c lrc: 0/0,0 mode: --/CR res: [0x200000401:0x10:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.13@tcp remote: 0x633a354aa4df50df expref: 68 pid: 5785 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783441540.437050:0:5785:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff91a85eaa1400/0xa2426164df2c8693 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.13@tcp remote: 0x633a354aa4df50df expref: 67 pid: 5785 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783441540.437061:0:5785:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff91a8439b0000) 00010000:00010000:2.0:1783441540.437064:0:5785:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:2.0:1783441540.437068:0:5785:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91a85eaa1400, rc 0) 00000100:00100000:2.0:1783441540.437147:0:5785:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a87d793800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:65454767-383a-4679-a788-eba05c6e0989+67:11575:x1870073673381504:12345-192.168.201.13@tcp:101:lhsmtool_posix.0 Request processed in 474us (1223us total) trans 0 rc 0/0 00000100:00100000:2.0:1783441540.437156:0:5785:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.13@tcp, seq: 225 00000100:00100000:3.0:1783441540.445181:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.13@tcp (source: 12345-192.168.201.13@tcp) 00000100:00100000:2.0:1783441540.445272:0:6583:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073673381632 00000100:00100000:2.0:1783441540.445285:0:6583:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073673381632 00000100:00100000:2.0:1783441540.445358:0:6583:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.13@tcp, seq: 64 00000100:00100000:2.0:1783441540.445370:0:6583:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a87d791500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:65454767-383a-4679-a788-eba05c6e0989+10:2355:x1870073673381632:12345-192.168.201.13@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1783441540.445395:0:6583:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1783441540.445428:0:6583:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000c797bd17/0xa2426164df2c869a lrc: 2/0,0 mode: --/PR res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x633a354aa4df50e6 expref: -99 pid: 6583 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1783441540.445503:0:6583:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x6:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x6a4d2885, blocks: 0x1 00010000:00010000:2.0:1783441540.445531:0:6583:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x6:0x0].0x0 since=378s v=(0 0) 00010000:00010000:2.0:1783441540.445536:0:6583:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1783441540.445556:0:6583:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000c797bd17/0xa2426164df2c869a lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.13@tcp remote: 0x633a354aa4df50e6 expref: 11 pid: 6583 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783441540.445585:0:6583:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000c797bd17/0xa2426164df2c869a lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.13@tcp remote: 0x633a354aa4df50e6 expref: 11 pid: 6583 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783441540.445603:0:6583:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91a85eaa1a00, rc 0) 00000100:00100000:2.0:1783441540.445681:0:6583:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a87d791500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:65454767-383a-4679-a788-eba05c6e0989+11:2355:x1870073673381632:12345-192.168.201.13@tcp:101:lhsmtool_posix.0 Request processed in 313us (515us total) trans 0 rc 0/0 00000100:00100000:2.0:1783441540.445689:0:6583:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.13@tcp, seq: 64 00000100:00100000:2.0:1783441540.448837:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.13@tcp (source: 12345-192.168.201.13@tcp) 00000100:00100000:0.0:1783441540.449331:0:5785:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073673381888 00000100:00100000:0.0:1783441540.449344:0:5785:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073673381888 00000100:00100000:0.0:1783441540.449413:0:5785:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.13@tcp, seq: 226 00000100:00100000:0.0:1783441540.449425:0:5785:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a87d7b9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:65454767-383a-4679-a788-eba05c6e0989+67:11575:x1870073673381888:12345-192.168.201.13@tcp:57:lhsmtool_posix.0 00000100:00100000:0.0:1783441540.449592:0:5785:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a87d7b9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:65454767-383a-4679-a788-eba05c6e0989+67:11575:x1870073673381888:12345-192.168.201.13@tcp:57:lhsmtool_posix.0 Request processed in 167us (770us total) trans 0 rc 0/0 00000100:00100000:0.0:1783441540.449949:0:5785:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.13@tcp, seq: 226 00000100:00100000:3.0:1783441540.455127:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.13@tcp (source: 12345-192.168.201.13@tcp) 00000100:00100000:2.0:1783441540.455272:0:6581:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073673382016 00000100:00100000:2.0:1783441540.455286:0:6581:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073673382016 00000100:00100000:2.0:1783441540.455372:0:6581:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.13@tcp, seq: 65 00000100:00100000:2.0:1783441540.455384:0:6581:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a87d790000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:65454767-383a-4679-a788-eba05c6e0989+11:11575:x1870073673382016:12345-192.168.201.13@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1783441540.455408:0:6581:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1783441540.455434:0:6581:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000ba5ebf5a/0xa2426164df2c86a1 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x633a354aa4df50ed expref: -99 pid: 6581 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783441540.455477:0:6581:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000c797bd17/0xa2426164df2c869a lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.13@tcp remote: 0x633a354aa4df50e6 expref: 12 pid: 6583 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783441540.455510:0:6581:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1783441540.455515:0:6581:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1783441540.455522:0:6581:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000ba5ebf5a/0xa2426164df2c86a1 lrc: 4/0,0 mode: --/PW res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.201.13@tcp remote: 0x633a354aa4df50ed expref: 12 pid: 6581 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783441540.455575:0:6581:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000c797bd17/0xa2426164df2c869a lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.201.13@tcp remote: 0x633a354aa4df50e6 expref: 12 pid: 6583 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783441540.455591:0:6581:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000c797bd17/0xa2426164df2c869a lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.201.13@tcp remote: 0x633a354aa4df50e6 expref: 12 pid: 6583 timeout: 478 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783441540.455610:0:6581:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff91a87d7bb100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:6581:1870073693291264:192.168.201.13@tcp:104: 00000100:00100000:2.0:1783441540.455826:0:6581:0:(client.c:2702:ptlrpc_set_wait()) set ffff91a848628d80 going to sleep for 11 seconds 00000100:00100000:3.0:1783441540.465538:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.13@tcp (source: 12345-192.168.201.13@tcp) 00000100:00100000:2.0:1783441540.465538:0:6581:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff91a87d7bb100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:6581:1870073693291264:192.168.201.13@tcp:104: 00010000:00010000:2.0:1783441540.465604:0:6581:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000ba5ebf5a/0xa2426164df2c86a1 lrc: 3/0,0 mode: --/PW res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.201.13@tcp remote: 0x633a354aa4df50ed expref: 12 pid: 6581 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783441540.465633:0:6581:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91a85eaa1c00, rc 0) 00000100:00100000:2.0:1783441540.465723:0:6581:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a87d790000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:65454767-383a-4679-a788-eba05c6e0989+12:11575:x1870073673382016:12345-192.168.201.13@tcp:101:lhsmtool_posix.0 Request processed in 10341us (10615us total) trans 0 rc 0/0 00000100:00100000:2.0:1783441540.465733:0:6581:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.13@tcp, seq: 65 00000100:00100000:1.0:1783441540.465831:0:5770:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073673382144 00000100:00100000:1.0:1783441540.465840:0:5770:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073673382144 00010000:00010000:1.0:1783441540.465891:0:5770:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000c797bd17/0xa2426164df2c869a lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.201.13@tcp remote: 0x633a354aa4df50e6 expref: 13 pid: 6583 timeout: 478 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783441540.465933:0:5770:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.13@tcp, seq: 83 00000100:00100000:1.0:1783441540.465944:0:5770:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a87d790380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:65454767-383a-4679-a788-eba05c6e0989+13:2355:x1870073673382144:12345-192.168.201.13@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1783441540.465962:0:5770:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1783441540.465993:0:5770:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000c797bd17/0xa2426164df2c869a lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.201.13@tcp remote: 0x633a354aa4df50e6 expref: 13 pid: 6583 timeout: 478 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783441540.466026:0:5770:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000c797bd17/0xa2426164df2c869a lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.201.13@tcp remote: 0x633a354aa4df50e6 expref: 13 pid: 6583 timeout: 478 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783441540.466054:0:5770:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000c797bd17/0xa2426164df2c869a lrc: 0/0,0 mode: --/PR res: [0x240000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.201.13@tcp remote: 0x633a354aa4df50e6 expref: 13 pid: 6583 timeout: 478 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783441540.466072:0:5770:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1783441540.466077:0:5770:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1783441540.466087:0:5770:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000ba5ebf5a/0xa2426164df2c86a1 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.201.13@tcp remote: 0x633a354aa4df50ed expref: 12 pid: 6581 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783441540.466098:0:5770:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000ba5ebf5a/0xa2426164df2c86a1 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.201.13@tcp remote: 0x633a354aa4df50ed expref: 12 pid: 6581 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783441540.466140:0:5770:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: 00000000ba5ebf5a/0xa2426164df2c86a1 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.201.13@tcp remote: 0x633a354aa4df50ed expref: 12 pid: 6581 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783441540.466156:0:5770:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff91a87d681f80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:5770:1870073693291392:192.168.201.13@tcp:105: 00000100:00100000:1.0:1783441540.466230:0:5770:0:(client.c:2702:ptlrpc_set_wait()) set ffff91a84619e0c0 going to sleep for 11 seconds 00000100:00100000:3.0:1783441540.471455:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.13@tcp (source: 12345-192.168.201.13@tcp) 00000100:00100000:1.0:1783441540.471579:0:5770:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff91a87d681f80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:5770:1870073693291392:192.168.201.13@tcp:105: 00000100:00100000:2.0:1783441540.471624:0:6587:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073673382272 00000100:00100000:2.0:1783441540.471634:0:6587:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073673382272 00010000:00010000:1.0:1783441540.471666:0:5770:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00002000:00100000:2.0:1783441540.471699:0:6587:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0x6:0x0] (0->12) req@ffff91a87d793480 x1870073673382272/t0(0) o4->65454767-383a-4679-a788-eba05c6e0989@192.168.201.13@tcp:181/0 lens 504/0 e 0 to 0 dl 1783441551 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1783441540.471726:0:6587:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff91a87d793480 with x1870073673382272 ext(0->12) 00002000:00010000:2.0:1783441540.471733:0:6587:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff91a87d793480 00000100:00100000:2.0:1783441540.471794:0:6587:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.13@tcp, seq: 6 00000100:00100000:1.0:1783441540.471804:0:5770:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a87d790380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:65454767-383a-4679-a788-eba05c6e0989+12:2355:x1870073673382144:12345-192.168.201.13@tcp:103:ldlm_bl.0 Request processed in 5861us (6268us total) trans 0 rc 0/0 00000100:00100000:2.0:1783441540.471805:0:6587:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a87d793480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:65454767-383a-4679-a788-eba05c6e0989+12:2355:x1870073673382272:12345-192.168.201.13@tcp:4:lhsmtool_posix.0 00000100:00100000:1.0:1783441540.471814:0:5770:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.13@tcp, seq: 83 00000100:00100000:2.0:1783441540.472346:0:6587:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a87d793480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:65454767-383a-4679-a788-eba05c6e0989+13:2355:x1870073673382272:12345-192.168.201.13@tcp:4:lhsmtool_posix.0 Request processed in 541us (902us total) trans 4294967320 rc 0/0 00000100:00100000:2.0:1783441540.472354:0:6587:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.13@tcp, seq: 6 00002000:00100000:2.0:1783441540.472362:0:6587:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0x6:0x0] (0->12) req@ffff91a87d793480 x1870073673382272/t4294967320(0) o4->65454767-383a-4679-a788-eba05c6e0989@192.168.201.13@tcp:181/0 lens 504/448 e 0 to 0 dl 1783441551 ref 1 fl Complete:/600/0 rc 0/0 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1783441540.472371:0:6587:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff91a87d793480 with x1870073673382272 ext(0->12) 00002000:00010000:2.0:1783441540.472374:0:6587:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff91a87d793480 00000100:00100000:3.0:1783441540.476181:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.13@tcp (source: 12345-192.168.201.13@tcp) 00000100:00100000:0.0:1783441540.478708:0:5786:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073673382400 00000100:00100000:0.0:1783441540.478731:0:5786:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073673382400 00000100:00100000:0.0:1783441540.478980:0:5786:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.13@tcp, seq: 227 00000100:00100000:0.0:1783441540.478993:0:5786:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a87d791880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:65454767-383a-4679-a788-eba05c6e0989+67:11575:x1870073673382400:12345-192.168.201.13@tcp:44:lhsmtool_posix.0 00000001:00080000:1.0:1783441540.533483:0:5807:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967508 is committed 00000004:00080000:1.0:1783441540.533678:0:5807:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 9 committed 00000004:00080000:1.0:1783441540.533705:0:5807:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 6 committed 00000020:00080000:1.0:1783441540.533724:0:5807:0:(update_trans.c:60:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff91a848628780 refcount 2 committed 0 result 0 batchid 7 00000020:00080000:1.0:1783441540.533729:0:5807:0:(update_trans.c:68:top_multiple_thandle_dump()) st ffff91a87d809200 obd lustre-OST0001-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff91a848628f00 00000020:00080000:1.0:1783441540.533733:0:5807:0:(update_trans.c:68:top_multiple_thandle_dump()) st ffff91a87d809600 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff91a877fe7400 00000004:00080000:1.0:1783441540.533782:0:5807:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 8 committed 00000020:00080000:1.0:1783441540.533805:0:5807:0:(update_trans.c:1341:distribute_txn_batchid_cb()) lustre-MDT0000: 5 batchid updated 00000020:00080000:1.0:1783441540.533838:0:5807:0:(update_trans.c:60:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff91a848632c00 refcount 2 committed 0 result 0 batchid 6 00000020:00080000:1.0:1783441540.533842:0:5807:0:(update_trans.c:68:top_multiple_thandle_dump()) st ffff91a86f31cd00 obd lustre-OST0000-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff91a848632e40 00000020:00080000:1.0:1783441540.533845:0:5807:0:(update_trans.c:68:top_multiple_thandle_dump()) st ffff91a86f31ca00 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff91a875231400 00000020:00080000:1.0:1783441540.534049:0:5818:0:(update_trans.c:1581:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 7 committed batchid 5 00000020:00080000:1.0:1783441540.534255:0:5818:0:(update_trans.c:1581:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 5 00000100:00100000:1.0:1783441540.534281:0:3305:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff91a87d681f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3305:1870073693291520:0@lo:6:osp-syn-0-0.0 00000100:00100000:1.0:1783441540.534384:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783441540.534532:0:3305:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1783441540.534547:0:3305:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff91a87d681c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3305:1870073693291648:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1783441540.534794:0:5786:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a87d791880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:65454767-383a-4679-a788-eba05c6e0989+21:11575:x1870073673382400:12345-192.168.201.13@tcp:44:lhsmtool_posix.0 Request processed in 55799us (58620us total) trans 0 rc 0/0 00000100:00100000:0.0:1783441540.534807:0:5786:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.13@tcp, seq: 227 00000100:00100000:1.0:1783441540.535458:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783441540.535521:0:3303:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff91a87d683480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3303:1870073693291776:0@lo:6:osp-syn-1-0.0 00000100:00100000:1.0:1783441540.535772:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783441540.535816:0:6583:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073693291520 00000100:00100000:1.0:1783441540.535823:0:6583:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073693291520 00000100:00100000:1.0:1783441540.535881:0:6583:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073693291648 00000100:00100000:1.0:1783441540.535884:0:6583:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073693291648 00000100:00100000:1.0:1783441540.535893:0:6583:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073693291776 00000100:00100000:1.0:1783441540.535895:0:6583:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073693291776 00000100:00100000:1.0:1783441540.535911:0:6583:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 66 00000100:00100000:1.0:1783441540.535935:0:6583:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a87d80ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+7:3305:x1870073693291520:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:1.0:1783441540.535969:0:6583:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x240000400:5 count 1 00010000:00010000:1.0:1783441540.536000:0:6583:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000000615ae02/0xa2426164df2c86a8 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6583 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783441540.536027:0:6583:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000004bc0e53c/0xa2426164df2c846a lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.201.13@tcp remote: 0x633a354aa4df504c expref: 12 pid: 6583 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783441540.536038:0:6583:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x240000400:0x5:0x0].0x0 since=2s v=(0 0) 00010000:00010000:1.0:1783441540.536043:0:6583:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1783441540.536048:0:6583:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000000615ae02/0xa2426164df2c86a8 lrc: 4/0,1 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6583 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783441540.536084:0:6583:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 000000004bc0e53c/0xa2426164df2c846a lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080010020 nid: 192.168.201.13@tcp remote: 0x633a354aa4df504c expref: 12 pid: 6583 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783441540.536098:0:6583:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 000000004bc0e53c/0xa2426164df2c846a lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000480010020 nid: 192.168.201.13@tcp remote: 0x633a354aa4df504c expref: 12 pid: 6583 timeout: 478 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783441540.536110:0:6583:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff91a8756a5880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:6583:1870073693291904:192.168.201.13@tcp:104: 00000100:00100000:1.0:1783441540.536167:0:6583:0:(client.c:2702:ptlrpc_set_wait()) set ffff91a84619e0c0 going to sleep for 11 seconds 00000100:00080000:1.0:1783441540.536179:0:5781:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1783441540.536184:0:5781:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1783441540.536225:0:6581:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 67 00000100:00100000:1.0:1783441540.536232:0:6581:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a87d806d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+7:3305:x1870073693291648:12345-0@lo:2:osp-syn-0-0.0 00002000:00010000:1.0:1783441540.536407:0:6581:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x6:0x0] updating lvb size from disk: 0 -> 13 00002000:00010000:1.0:1783441540.536416:0:6581:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x240000400:0x6:0x0] updating lvb mtime from disk: 0 -> 1783441541 00002000:00010000:1.0:1783441540.536419:0:6581:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x240000400:0x6:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:1.0:1783441540.536421:0:6581:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x240000400:0x6:0x0] updating lvb ctime from disk: 1783441541 -> 1783441541 00002000:00010000:1.0:1783441540.536424:0:6581:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x6:0x0] updating lvb blocks from disk: 1 -> 1 00000100:00100000:1.0:1783441540.536462:0:6581:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a87d806d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+8:3305:x1870073693291648:12345-0@lo:2:osp-syn-0-0.0 Request processed in 230us (1007us total) trans 4294967321 rc 0/0 00000004:00080000:0.0:1783441540.537033:0:3305:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff91a87d681c00/2, rc 0, transno 4294967321 00000100:00100000:0.0:1783441540.537044:0:3305:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff91a87d681c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3305:1870073693291648:0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1783441540.537900:0:6581:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 67 00000100:00100000:1.0:1783441540.537944:0:6581:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 68 00000100:00100000:1.0:1783441540.537963:0:6581:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a87d805180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+7:3303:x1870073693291776:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:1.0:1783441540.538011:0:6581:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x280000400:5 count 1 00002000:00010000:1.0:1783441540.538059:0:6581:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x5:0x0] initial LVB size: 9, mtime: 0x6a4d2884, atime: 0x6a4d2884, ctime: 0x6a4d2884, blocks: 0x1 00010000:00010000:1.0:1783441540.538068:0:6581:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000725429ac/0xa2426164df2c86af lrc: 3/0,1 mode: --/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6581 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783441540.538088:0:6581:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=378s v=(0 0) 00010000:00010000:1.0:1783441540.538093:0:6581:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1783441540.538101:0:6581:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000725429ac/0xa2426164df2c86af lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6581 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783441540.538119:0:6581:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000725429ac/0xa2426164df2c86af lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6581 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783441540.538132:0:6581:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000725429ac/0xa2426164df2c86af lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6581 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783441540.538141:0:6581:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000725429ac/0xa2426164df2c86af lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 6581 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783441540.538194:0:6581:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1783441540.538818:0:5772:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1783441540.538829:0:5772:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000725429ac/0xa2426164df2c86af lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6581 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783441540.538841:0:5772:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91a87da47c00 already unused, calling callback (ffffffffc155ff90) 00010000:00010000:0.0:1783441540.538847:0:5772:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000725429ac/0xa2426164df2c86af lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6581 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783441540.538858:0:5772:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000725429ac/0xa2426164df2c86af lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 6581 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783441540.538879:0:5772:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000725429ac/0xa2426164df2c86af lrc: 1/0,0 mode: --/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6581 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783441540.538886:0:5772:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000725429ac/0xa2426164df2c86af lrc: 0/0,0 mode: --/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6581 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783441540.538914:0:5772:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783441540.538916:0:5772:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783441540.538926:0:5772:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1783441540.540335:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.13@tcp (source: 12345-192.168.201.13@tcp) 00000100:00100000:3.0:1783441540.540411:0:6582:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 4 min 3 max 116 00000100:00100000:3.0:1783441540.540424:0:6582:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost00_004' 00000100:00100000:1.0:1783441540.540854:0:6581:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a87d805180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+8:3303:x1870073693291776:12345-0@lo:6:osp-syn-1-0.0 Request processed in 2898us (5078us total) trans 4294967310 rc 0/0 00000100:00100000:1.0:1783441540.540873:0:6581:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 68 00000100:00100000:1.0:1783441540.540910:0:6581:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073673382528 00000100:00100000:1.0:1783441540.540920:0:6581:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073673382528 00000100:00100000:1.0:1783441540.540966:0:6581:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.13@tcp, seq: 69 00000100:00100000:1.0:1783441540.540975:0:6581:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a87d7bb100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:65454767-383a-4679-a788-eba05c6e0989+13:2354:x1870073673382528:12345-192.168.201.13@tcp:16:lhsmtool_posix.0 00000100:00100000:3.0:1783441540.543705:0:6583:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff91a8756a5880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:6583:1870073693291904:192.168.201.13@tcp:104: 00010000:00010000:3.0:1783441540.543788:0:6583:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 000000000615ae02/0xa2426164df2c86a8 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6583 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783441540.545288:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.13@tcp (source: 12345-192.168.201.13@tcp) 00000100:00100000:2.0:1783441540.545996:0:11015:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073673382656 00000100:00100000:2.0:1783441540.546010:0:11015:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073673382656 00010000:00010000:2.0:1783441540.546062:0:11015:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 000000004bc0e53c/0xa2426164df2c846a lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.201.13@tcp remote: 0x633a354aa4df504c expref: 14 pid: 6583 timeout: 478 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783441540.546116:0:11015:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.13@tcp, seq: 84 00000100:00100000:2.0:1783441540.546128:0:11015:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a8756a6d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:65454767-383a-4679-a788-eba05c6e0989+14:2354:x1870073673382656:12345-192.168.201.13@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1783441540.546145:0:11015:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1783441540.546152:0:11015:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 000000004bc0e53c/0xa2426164df2c846a lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.201.13@tcp remote: 0x633a354aa4df504c expref: 14 pid: 6583 timeout: 478 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783441540.546186:0:11015:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 000000004bc0e53c/0xa2426164df2c846a lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000480010020 nid: 192.168.201.13@tcp remote: 0x633a354aa4df504c expref: 14 pid: 6583 timeout: 478 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783441540.546217:0:11015:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000004bc0e53c/0xa2426164df2c846a lrc: 0/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801480010020 nid: 192.168.201.13@tcp remote: 0x633a354aa4df504c expref: 14 pid: 6583 timeout: 478 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783441540.546240:0:11015:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1783441540.546245:0:11015:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1783441540.546252:0:11015:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000000615ae02/0xa2426164df2c86a8 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 6583 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783441540.546264:0:11015:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000000615ae02/0xa2426164df2c86a8 lrc: 4/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 6583 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783441540.546301:0:11015:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1783441540.546377:0:11015:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a8756a6d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:65454767-383a-4679-a788-eba05c6e0989+13:2354:x1870073673382656:12345-192.168.201.13@tcp:103:ldlm_bl.0 Request processed in 249us (1097us total) trans 0 rc 0/0 00000100:00100000:2.0:1783441540.546385:0:11015:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.13@tcp, seq: 84 00010000:00010000:2.0:1783441540.547398:0:6583:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 000000000615ae02/0xa2426164df2c86a8 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6583 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783441540.547415:0:6583:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000000615ae02/0xa2426164df2c86a8 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6583 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783441540.547429:0:6583:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000000615ae02/0xa2426164df2c86a8 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6583 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783441540.547452:0:6583:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000000615ae02/0xa2426164df2c86a8 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 6583 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783441540.547482:0:6583:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:2.0:1783441540.548331:0:6583:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a87d80ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+8:3305:x1870073693291520:12345-0@lo:6:osp-syn-0-0.0 Request processed in 12389us (13939us total) trans 4294967322 rc 0/0 00000100:00100000:2.0:1783441540.548345:0:6583:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 66 00010000:00010000:1.0:1783441540.548772:0:5773:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1783441540.548785:0:5773:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000000615ae02/0xa2426164df2c86a8 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6583 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783441540.548800:0:5773:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91a87da47000 already unused, calling callback (ffffffffc155ff90) 00010000:00010000:1.0:1783441540.548807:0:5773:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000000615ae02/0xa2426164df2c86a8 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6583 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783441540.548820:0:5773:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000000615ae02/0xa2426164df2c86a8 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 6583 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783441540.548845:0:5773:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000000615ae02/0xa2426164df2c86a8 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6583 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783441540.548852:0:5773:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000000615ae02/0xa2426164df2c86a8 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6583 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783441540.548900:0:5773:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783441540.548901:0:5773:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783441540.548903:0:5773:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00080000:2.0:1783441540.549436:0:3305:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff91a87d681f80/2, rc 0, transno 4294967322 00000100:00100000:2.0:1783441540.549451:0:3305:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff91a87d681f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3305:1870073693291520:0@lo:6:osp-syn-0-0.0 00000004:00080000:0.0:1783441540.549708:0:3303:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff91a87d683480/2, rc 0, transno 4294967310 00000100:00100000:0.0:1783441540.549716:0:3303:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff91a87d683480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3303:1870073693291776:0@lo:6:osp-syn-1-0.0 00000100:00100000:2.0:1783441540.576124:0:6581:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a87d7bb100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:65454767-383a-4679-a788-eba05c6e0989+12:2354:x1870073673382528:12345-192.168.201.13@tcp:16:lhsmtool_posix.0 Request processed in 35134us (35786us total) trans 0 rc 0/0 00000100:00100000:2.0:1783441540.576138:0:6581:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.13@tcp, seq: 69 00000001:00080000:0.0:1783441540.576617:0:6613:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967316 is committed 00000001:00080000:0.0:1783441540.576638:0:6613:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967321 is committed 00000001:00080000:0.0:1783441540.576645:0:6613:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967319 is committed 00000001:00080000:0.0:1783441540.576651:0:6613:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967320 is committed 00000100:00100000:1.0:1783441540.578605:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.13@tcp (source: 12345-192.168.201.13@tcp) 00000100:00100000:3.0:1783441540.578778:0:5787:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073673382912 00000100:00100000:3.0:1783441540.578793:0:5787:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073673382912 00000100:00100000:3.0:1783441540.578865:0:5787:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.13@tcp, seq: 228 00000100:00100000:3.0:1783441540.578877:0:5787:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a8756a5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:65454767-383a-4679-a788-eba05c6e0989+21:11575:x1870073673382912:12345-192.168.201.13@tcp:36:lhsmtool_posix.0 00010000:00010000:3.0:1783441540.578949:0:5787:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1783441540.578997:0:5787:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91a85eaa1400/0xa2426164df2c8693 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x10:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.13@tcp remote: 0x633a354aa4df50df expref: 21 pid: 5785 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783441540.579017:0:5787:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff91a8439b0000) 00010000:00010000:3.0:1783441540.579022:0:5787:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1783441540.579078:0:5787:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff91a841476000/0xa2426164df2c86b6 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783441540.579092:0:5787:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91a841476000/0xa2426164df2c86b6 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783441540.579101:0:5787:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91a841476000/0xa2426164df2c86b6 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1783441540.579420:0:5787:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000f3a10142 reply state 00000000bbae17e2 transno 4294967509 ns: mdt-lustre-MDT0000_UUID lock: ffff91a841476000/0xa2426164df2c86b6 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783441540.579431:0:5787:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1783441540.579874:0:5787:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a8756a5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:65454767-383a-4679-a788-eba05c6e0989+22:11575:x1870073673382912:12345-192.168.201.13@tcp:36:lhsmtool_posix.0 Request processed in 995us (1281us total) trans 4294967509 rc 0/0 00000100:00100000:3.0:1783441540.579884:0:5787:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.13@tcp, seq: 228 00010000:00010000:2.0:1783441540.584244:0:3289:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff91a841476000/0xa2426164df2c86b6 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783441540.584270:0:3289:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff91a841476000/0xa2426164df2c86b6 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783441540.584279:0:3289:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff91a841476000/0xa2426164df2c86b6 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783441540.584286:0:3289:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91a841476000 already unused, calling callback (ffffffffc1f9b4f0) 00010000:00010000:2.0:1783441540.584292:0:3289:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91a841476000/0xa2426164df2c86b6 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783441540.584301:0:3289:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91a841476000/0xa2426164df2c86b6 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783441540.584358:0:3289:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff91a8439b0000) 00010000:00010000:2.0:1783441540.584361:0:3289:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1783441540.584367:0:3289:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff91a841476000/0xa2426164df2c86b6 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783441540.584373:0:3289:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91a841476000/0xa2426164df2c86b6 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783441540.584654:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.13@tcp (source: 12345-192.168.201.13@tcp) 00000100:00100000:3.0:1783441540.585257:0:8557:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073673383040 00000100:00100000:3.0:1783441540.585274:0:8557:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073673383040 00000100:00100000:3.0:1783441540.585395:0:8557:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.13@tcp, seq: 70 00000100:00100000:3.0:1783441540.585409:0:8557:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a8476b3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:65454767-383a-4679-a788-eba05c6e0989+7:2354:x1870073673383040:12345-192.168.201.13@tcp:2:lhsmtool_posix.0 00002000:00010000:3.0:1783441540.585727:0:8557:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x6:0x0] updating lvb size from disk: 13 -> 13 00002000:00010000:3.0:1783441540.585732:0:8557:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x240000400:0x6:0x0] updating lvb mtime from disk: 1783441541 -> 1783441540 00002000:00010000:3.0:1783441540.585735:0:8557:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x240000400:0x6:0x0] updating lvb atime from disk: 0 -> 1783441540 00002000:00010000:3.0:1783441540.585737:0:8557:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x240000400:0x6:0x0] updating lvb ctime from disk: 1783441541 -> 1783441540 00002000:00010000:3.0:1783441540.585920:0:8557:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x6:0x0] updating lvb blocks from disk: 1 -> 11 00000100:00100000:3.0:1783441540.586019:0:8557:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a8476b3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:65454767-383a-4679-a788-eba05c6e0989+8:2354:x1870073673383040:12345-192.168.201.13@tcp:2:lhsmtool_posix.0 Request processed in 611us (1370us total) trans 4294967323 rc 0/0 00000100:00100000:3.0:1783441540.586028:0:8557:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.13@tcp, seq: 70 00000100:00100000:2.0:1783441540.589131:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.13@tcp (source: 12345-192.168.201.13@tcp) 00000100:00100000:1.0:1783441540.589253:0:6605:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073673383296 00000100:00100000:1.0:1783441540.589267:0:6605:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073673383296 00000100:00100000:1.0:1783441540.589387:0:6605:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.13@tcp, seq: 229 00000100:00100000:1.0:1783441540.589401:0:6605:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a87d7b8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:65454767-383a-4679-a788-eba05c6e0989+21:11575:x1870073673383296:12345-192.168.201.13@tcp:55:lhsmtool_posix.0 00010000:00010000:1.0:1783441540.589657:0:6605:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff91a87da47200/0xa2426164df2c86bd lrc: 3/0,1 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6605 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783441540.589683:0:6605:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff91a85fe58400/0xa2426164df2c8677 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.13@tcp remote: 0x633a354aa4df50d1 expref: 21 pid: 6605 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783441540.589693:0:6605:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff91a87da47200/0xa2426164df2c86bd lrc: 4/0,1 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6605 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783441540.589868:0:6605:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff91a85fe58400/0xa2426164df2c8677 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.13@tcp remote: 0x633a354aa4df50d1 expref: 21 pid: 6605 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783441540.589886:0:6605:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff91a85fe58400/0xa2426164df2c8677 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.13@tcp remote: 0x633a354aa4df50d1 expref: 21 pid: 6605 timeout: 478 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783441540.589907:0:6605:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff91a8476b2300 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:6605:1870073693292032:192.168.201.13@tcp:104: 00000100:00100000:1.0:1783441540.590081:0:6605:0:(client.c:2702:ptlrpc_set_wait()) set ffff91a84619e180 going to sleep for 11 seconds 00000100:00100000:2.0:1783441540.593504:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.13@tcp (source: 12345-192.168.201.13@tcp) 00000100:00100000:0.0:1783441540.593623:0:6605:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff91a8476b2300 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:6605:1870073693292032:192.168.201.13@tcp:104: 00010000:00010000:0.0:1783441540.593661:0:6605:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff91a87da47200/0xa2426164df2c86bd lrc: 3/0,1 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6605 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783441540.593802:0:5771:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073673383424 00000100:00100000:3.0:1783441540.593831:0:5771:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073673383424 00010000:00010000:3.0:1783441540.593881:0:5771:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff91a85fe58400/0xa2426164df2c8677 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.13@tcp remote: 0x633a354aa4df50d1 expref: 22 pid: 6605 timeout: 478 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783441540.593931:0:5771:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.13@tcp, seq: 85 00000100:00100000:3.0:1783441540.593943:0:5771:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a87d7bbb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:65454767-383a-4679-a788-eba05c6e0989+22:2354:x1870073673383424:12345-192.168.201.13@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1783441540.593972:0:5771:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1783441540.593981:0:5771:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff91a85fe58400/0xa2426164df2c8677 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.13@tcp remote: 0x633a354aa4df50d1 expref: 22 pid: 6605 timeout: 478 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783441540.593996:0:5771:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff91a85fe58400/0xa2426164df2c8677 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.13@tcp remote: 0x633a354aa4df50d1 expref: 22 pid: 6605 timeout: 478 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783441540.594026:0:5771:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91a85fe58400/0xa2426164df2c8677 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x10:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.13@tcp remote: 0x633a354aa4df50d1 expref: 22 pid: 6605 timeout: 478 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783441540.594047:0:5771:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff91a8439b0000) 00010000:00010000:3.0:1783441540.594054:0:5771:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff91a87da47200/0xa2426164df2c86bd lrc: 3/0,1 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6605 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783441540.594066:0:5771:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff91a87da47200/0xa2426164df2c86bd lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 6605 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783441540.594075:0:5771:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91a87da47200/0xa2426164df2c86bd lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 6605 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783441540.594103:0:5771:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1783441540.594201:0:6605:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff91a87da47200/0xa2426164df2c86bd lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6605 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783441540.594209:0:6605:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91a87da47200/0xa2426164df2c86bd lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6605 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783441540.594250:0:6605:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff91a87da47200/0xa2426164df2c86bd lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6605 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783441540.594258:0:6605:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff91a87da47200/0xa2426164df2c86bd lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6605 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783441540.594264:0:6605:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff91a87da47200/0xa2426164df2c86bd lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6605 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783441540.594270:0:6605:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91a87da47200 already unused, calling callback (ffffffffc1f9b4f0) 00010000:00010000:0.0:1783441540.594277:0:6605:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91a87da47200/0xa2426164df2c86bd lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6605 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783441540.594285:0:6605:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91a87da47200/0xa2426164df2c86bd lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6605 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783441540.594304:0:6605:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff91a8439b0000) 00010000:00010000:0.0:1783441540.594307:0:6605:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 21 00010000:00010000:0.0:1783441540.594311:0:6605:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff91a87da47200/0xa2426164df2c86bd lrc: 2/0,0 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6605 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783441540.594317:0:6605:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91a87da47200/0xa2426164df2c86bd lrc: 0/0,0 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6605 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783441540.594681:0:5771:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a87d7bbb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:65454767-383a-4679-a788-eba05c6e0989+21:2354:x1870073673383424:12345-192.168.201.13@tcp:103:ldlm_bl.0 Request processed in 738us (1199us total) trans 0 rc 0/0 00000100:00100000:3.0:1783441540.594704:0:5771:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.13@tcp, seq: 85 00000100:00100000:0.0:1783441540.594999:0:6605:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a87d7b8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:65454767-383a-4679-a788-eba05c6e0989+20:11575:x1870073673383296:12345-192.168.201.13@tcp:55:lhsmtool_posix.0 Request processed in 5599us (5882us total) trans 0 rc -22/-22 00000100:00100000:0.0:1783441540.595009:0:6605:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.13@tcp, seq: 229 00000100:00100000:2.0:1783441540.597675:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.13@tcp (source: 12345-192.168.201.13@tcp) 00000100:00100000:0.0:1783441540.597987:0:12319:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073673383552 00000100:00100000:0.0:1783441540.598000:0:12319:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073673383552 00000100:00100000:0.0:1783441540.598077:0:12319:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.13@tcp, seq: 71 00000100:00100000:0.0:1783441540.598089:0:12319:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a87d7b9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:65454767-383a-4679-a788-eba05c6e0989+8:2352:x1870073673383552:12345-192.168.201.13@tcp:1:lhsmtool_posix.0 00010000:00010000:0.0:1783441540.598159:0:12319:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000025372a6/0xa2426164df2c86c4 lrc: 3/1,0 mode: --/PR res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 12319 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783441540.598187:0:12319:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000ba5ebf5a/0xa2426164df2c86a1 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.201.13@tcp remote: 0x633a354aa4df50ed expref: 8 pid: 6581 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783441540.598197:0:12319:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x240000400:0x6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1783441540.598202:0:12319:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x6:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1783441540.598206:0:12319:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000025372a6/0xa2426164df2c86c4 lrc: 4/1,0 mode: --/PR res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 12319 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783441540.598258:0:12319:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000ba5ebf5a/0xa2426164df2c86a1 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.201.13@tcp remote: 0x633a354aa4df50ed expref: 8 pid: 6581 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783441540.598297:0:12319:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000ba5ebf5a/0xa2426164df2c86a1 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.201.13@tcp remote: 0x633a354aa4df50ed expref: 8 pid: 6581 timeout: 478 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783441540.598316:0:12319:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff91a874dc7480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:12319:1870073693292160:192.168.201.13@tcp:104: 00000100:00100000:0.0:1783441540.598550:0:12319:0:(client.c:2702:ptlrpc_set_wait()) set ffff91a87d800cc0 going to sleep for 11 seconds 00000100:00100000:2.0:1783441540.602524:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.13@tcp (source: 12345-192.168.201.13@tcp) 00000100:00100000:0.0:1783441540.603322:0:12319:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff91a874dc7480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:12319:1870073693292160:192.168.201.13@tcp:104: 00010000:00010000:0.0:1783441540.603361:0:12319:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000025372a6/0xa2426164df2c86c4 lrc: 3/1,0 mode: --/PR res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 12319 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783441540.603623:0:5770:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073673383680 00000100:00100000:3.0:1783441540.603635:0:5770:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073673383680 00010000:00010000:3.0:1783441540.603687:0:5770:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000ba5ebf5a/0xa2426164df2c86a1 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.201.13@tcp remote: 0x633a354aa4df50ed expref: 9 pid: 6581 timeout: 478 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783441540.603803:0:5770:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.13@tcp, seq: 86 00000100:00100000:3.0:1783441540.603816:0:5770:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a844b7ca80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:65454767-383a-4679-a788-eba05c6e0989+9:2355:x1870073673383680:12345-192.168.201.13@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1783441540.603837:0:5770:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1783441540.603873:0:5770:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000ba5ebf5a/0xa2426164df2c86a1 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.201.13@tcp remote: 0x633a354aa4df50ed expref: 9 pid: 6581 timeout: 478 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783441540.603888:0:5770:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000ba5ebf5a/0xa2426164df2c86a1 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.201.13@tcp remote: 0x633a354aa4df50ed expref: 9 pid: 6581 timeout: 478 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783441540.603918:0:5770:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000ba5ebf5a/0xa2426164df2c86a1 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.201.13@tcp remote: 0x633a354aa4df50ed expref: 9 pid: 6581 timeout: 478 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783441540.603938:0:5770:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x6:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1783441540.603943:0:5770:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x6:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1783441540.603950:0:5770:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000025372a6/0xa2426164df2c86c4 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 12319 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783441540.603975:0:5770:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000025372a6/0xa2426164df2c86c4 lrc: 4/1,0 mode: PR/PR res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 12319 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783441540.604036:0:5770:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1783441540.604121:0:5770:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a844b7ca80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:65454767-383a-4679-a788-eba05c6e0989+8:2355:x1870073673383680:12345-192.168.201.13@tcp:103:ldlm_bl.0 Request processed in 306us (1614us total) trans 0 rc 0/0 00000100:00100000:3.0:1783441540.604131:0:5770:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.13@tcp, seq: 86 00010000:00010000:1.0:1783441540.604204:0:12319:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000025372a6/0xa2426164df2c86c4 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 12319 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783441540.604216:0:12319:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000025372a6/0xa2426164df2c86c4 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 12319 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783441540.604250:0:12319:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000025372a6/0xa2426164df2c86c4 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 12319 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783441540.604260:0:12319:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000025372a6/0xa2426164df2c86c4 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 12319 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783441540.604270:0:12319:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000025372a6/0xa2426164df2c86c4 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 12319 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783441540.604278:0:12319:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91a85fe59a00 already unused, calling callback (ffffffffc155ff90) 00010000:00010000:1.0:1783441540.604284:0:12319:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000025372a6/0xa2426164df2c86c4 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 12319 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783441540.604295:0:12319:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000025372a6/0xa2426164df2c86c4 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 12319 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783441540.604311:0:12319:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000025372a6/0xa2426164df2c86c4 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 12319 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783441540.604319:0:12319:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000025372a6/0xa2426164df2c86c4 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 12319 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783441540.604398:0:12319:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a87d7b9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:65454767-383a-4679-a788-eba05c6e0989+7:2352:x1870073673383552:12345-192.168.201.13@tcp:1:lhsmtool_posix.0 Request processed in 6310us (6737us total) trans 0 rc 0/0 00000100:00100000:1.0:1783441540.604408:0:12319:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.13@tcp, seq: 71 00000100:00100000:1.0:1783441540.607726:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.13@tcp (source: 12345-192.168.201.13@tcp) 00000100:00100000:0.0:1783441540.608026:0:5785:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073673383936 00000100:00100000:0.0:1783441540.608039:0:5785:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073673383936 00000100:00100000:0.0:1783441540.608152:0:5785:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.13@tcp, seq: 230 00000100:00100000:0.0:1783441540.608166:0:5785:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a8476b1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:65454767-383a-4679-a788-eba05c6e0989+20:11575:x1870073673383936:12345-192.168.201.13@tcp:57:lhsmtool_posix.0 00010000:00010000:0.0:1783441540.608287:0:5785:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff91a85fe59600/0xa2426164df2c86cb lrc: 3/0,1 mode: --/PW res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783441540.608312:0:5785:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91a85fe59600/0xa2426164df2c86cb lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783441540.608327:0:5785:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91a85fe59600/0xa2426164df2c86cb lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783441540.609320:0:5785:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff91a87da47c00/0xa2426164df2c86d2 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x10:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783441540.609343:0:5785:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff91a87da46000/0xa2426164df2c8685 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.13@tcp remote: 0x633a354aa4df50d8 expref: 21 pid: 6605 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783441540.609353:0:5785:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff91a87da47c00/0xa2426164df2c86d2 lrc: 4/0,1 mode: --/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783441540.609411:0:5785:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff91a87da46000/0xa2426164df2c8685 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.201.13@tcp remote: 0x633a354aa4df50d8 expref: 21 pid: 6605 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783441540.609430:0:5785:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff91a87da46000/0xa2426164df2c8685 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.201.13@tcp remote: 0x633a354aa4df50d8 expref: 21 pid: 6605 timeout: 478 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783441540.609449:0:5785:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff91a8476b2300 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5785:1870073693292288:192.168.201.13@tcp:104: 00000100:00100000:1.0:1783441540.609877:0:5785:0:(client.c:2702:ptlrpc_set_wait()) set ffff91a84619e0c0 going to sleep for 11 seconds 00000100:00100000:2.0:1783441540.613596:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.13@tcp (source: 12345-192.168.201.13@tcp) 00000100:00100000:3.0:1783441540.613677:0:11514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073673384064 00000100:00100000:3.0:1783441540.613690:0:11514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073673384064 00010000:00010000:3.0:1783441540.613775:0:11514:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff91a87da46000/0xa2426164df2c8685 lrc: 5/0,0 mode: CR/CR res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.201.13@tcp remote: 0x633a354aa4df50d8 expref: 22 pid: 6605 timeout: 478 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783441540.613820:0:11514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.13@tcp, seq: 87 00000100:00100000:3.0:1783441540.613832:0:11514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a844b7d500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:65454767-383a-4679-a788-eba05c6e0989+22:2354:x1870073673384064:12345-192.168.201.13@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1783441540.613855:0:11514:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1783441540.613863:0:11514:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff91a87da46000/0xa2426164df2c8685 lrc: 5/0,0 mode: CR/CR res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.201.13@tcp remote: 0x633a354aa4df50d8 expref: 22 pid: 6605 timeout: 478 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783441540.613879:0:11514:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff91a87da46000/0xa2426164df2c8685 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.201.13@tcp remote: 0x633a354aa4df50d8 expref: 22 pid: 6605 timeout: 478 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783441540.613909:0:11514:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff91a8439b0000) 00010000:00010000:3.0:1783441540.613916:0:11514:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff91a87da47c00/0xa2426164df2c86d2 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783441540.613927:0:11514:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff91a87da47c00/0xa2426164df2c86d2 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50290000000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783441540.613935:0:11514:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91a87da47c00/0xa2426164df2c86d2 lrc: 4/0,1 mode: EX/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50290000000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783441540.613996:0:11514:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1783441540.614074:0:11514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a844b7d500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:65454767-383a-4679-a788-eba05c6e0989+22:2354:x1870073673384064:12345-192.168.201.13@tcp:103:ldlm_bl.0 Request processed in 244us (497us total) trans 0 rc 0/0 00000100:00100000:3.0:1783441540.614083:0:11514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.13@tcp, seq: 87 00010000:00010000:1.0:1783441540.615734:0:5785:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91a87da46000/0xa2426164df2c8685 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.201.13@tcp remote: 0x633a354aa4df50d8 expref: 21 pid: 6605 timeout: 478 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783441540.615842:0:5785:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff91a8476b2300 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5785:1870073693292288:192.168.201.13@tcp:104: 00010000:00010000:1.0:1783441540.615872:0:5785:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff91a87da47c00/0xa2426164df2c86d2 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783441540.615901:0:5785:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff91a87da47c00/0xa2426164df2c86d2 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783441540.615908:0:5785:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91a87da47c00/0xa2426164df2c86d2 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1783441540.616286:0:5785:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967510 00000001:00080000:1.0:1783441540.616444:0:5785:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967511 00000001:00080000:1.0:1783441540.616633:0:5785:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967512 00000100:00100000:1.0:1783441540.616738:0:5785:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff91a8476b2300 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-mdtlov_UUID:5785:1870073693292416:0@lo:1000:mdt00_000.0 00000100:00100000:1.0:1783441540.616974:0:5785:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783441540.617089:0:5785:0:(client.c:2702:ptlrpc_set_wait()) set ffff91a84619ed80 going to sleep for 11 seconds 00000100:00100000:2.0:1783441540.617140:0:5790:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073693292416 00000100:00100000:2.0:1783441540.617149:0:5790:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073693292416 00000100:00100000:2.0:1783441540.617244:0:5790:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:2.0:1783441540.617255:0:5790:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a87d4e8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:5785:x1870073693292416:12345-0@lo:1000:mdt00_000.0 00000100:00100000:2.0:1783441540.617352:0:5790:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a87d4e8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:5785:x1870073693292416:12345-0@lo:1000:mdt00_000.0 Request processed in 98us (377us total) trans 0 rc 0/0 00000100:00100000:2.0:1783441540.617360:0:5790:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:1.0:1783441540.617419:0:5785:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967321 gen 2 00000004:00080000:1.0:1783441540.617427:0:5785:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967317 committed transno 4294967321 00000004:00080000:1.0:1783441540.617455:0:5785:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff91a87d681c00, transno 4294967321 00000100:00100000:1.0:1783441540.617490:0:5785:0:(client.c:3156:ptlrpc_free_committed()) @@@ stopping search req@ffff91a87d681f80 x1870073693291520/t4294967322(4294967322) o6->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 544/432 e 0 to 0 dl 1783441556 ref 1 fl Complete:RQU/204/0 rc 0/0 job:'osp-syn-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1783441540.617505:0:5785:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff91a8476b2300 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-mdtlov_UUID:5785:1870073693292416:0@lo:1000:mdt00_000.0 00000001:00080000:1.0:1783441540.618127:0:5785:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967513 00000100:00100000:1.0:1783441540.618215:0:5785:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff91a8476b2300 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-mdtlov_UUID:5785:1870073693292544:0@lo:1000:mdt00_000.0 00000100:00100000:1.0:1783441540.618262:0:5785:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783441540.619028:0:5785:0:(client.c:2702:ptlrpc_set_wait()) set ffff91a84619e0c0 going to sleep for 11 seconds 00000100:00100000:3.0:1783441540.619112:0:5791:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073693292544 00000100:00100000:3.0:1783441540.619122:0:5791:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073693292544 00000100:00100000:3.0:1783441540.619178:0:5791:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:3.0:1783441540.619190:0:5791:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a87d87dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:5785:x1870073693292544:12345-0@lo:1000:mdt00_000.0 00000100:00100000:3.0:1783441540.619480:0:5791:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a87d87dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+7:5785:x1870073693292544:12345-0@lo:1000:mdt00_000.0 Request processed in 292us (1215us total) trans 4294967324 rc 0/0 00000100:00100000:3.0:1783441540.619490:0:5791:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:1.0:1783441540.619727:0:5785:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff91a8476b2300 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-mdtlov_UUID:5785:1870073693292544:0@lo:1000:mdt00_000.0 00010000:00010000:1.0:1783441540.619824:0:5785:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff91a87da47c00/0xa2426164df2c86d2 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783441540.619836:0:5785:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff91a87da47c00/0xa2426164df2c86d2 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783441540.619864:0:5785:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff91a87da47c00/0xa2426164df2c86d2 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783441540.619872:0:5785:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91a87da47c00 already unused, calling callback (ffffffffc1f9b4f0) 00010000:00010000:1.0:1783441540.619877:0:5785:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91a87da47c00/0xa2426164df2c86d2 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783441540.619887:0:5785:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91a87da47c00/0xa2426164df2c86d2 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783441540.619907:0:5785:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff91a8439b0000) 00010000:00010000:1.0:1783441540.619911:0:5785:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1783441540.619917:0:5785:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff91a87da47c00/0xa2426164df2c86d2 lrc: 2/0,0 mode: --/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783441540.619925:0:5785:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91a87da47c00/0xa2426164df2c86d2 lrc: 0/0,0 mode: --/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783441540.619970:0:5785:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff91a85eaa1200/0xa2426164df2c8615 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210400000020 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783441540.619977:0:5785:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff91a85eaa1200/0xa2426164df2c8615 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210400000020 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783441540.619983:0:5785:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff91a85eaa1200/0xa2426164df2c8615 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210400000020 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783441540.619988:0:5785:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91a85eaa1200 already unused, calling callback (ffffffffc1f9b4f0) 00010000:00010000:1.0:1783441540.619991:0:5785:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91a85eaa1200/0xa2426164df2c8615 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210400000020 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783441540.620008:0:5785:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91a85eaa1200/0xa2426164df2c8615 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40218400000020 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783441540.620017:0:5785:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff91a8429bdd00) 00010000:00010000:1.0:1783441540.620020:0:5785:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1783441540.620028:0:5785:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff91a85fe58600/0xa2426164df2c861c lrc: 2/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.13@tcp remote: 0x633a354aa4df50bc expref: 24 pid: 5786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783441540.620042:0:5785:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff91a85fe58600/0xa2426164df2c861c lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.201.13@tcp remote: 0x633a354aa4df50bc expref: 24 pid: 5786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783441540.620054:0:5785:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91a85fe58600/0xa2426164df2c861c lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.201.13@tcp remote: 0x633a354aa4df50bc expref: 24 pid: 5786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783441540.620098:0:5785:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: mdt-lustre-MDT0000_UUID lock: ffff91a85fe58600/0xa2426164df2c861c lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.13@tcp remote: 0x633a354aa4df50bc expref: 24 pid: 5786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783441540.620114:0:5785:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff91a87d87df80 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5785:1870073693292672:192.168.201.13@tcp:105: 00000100:00100000:1.0:1783441540.620215:0:5785:0:(client.c:2702:ptlrpc_set_wait()) set ffff91a84619e0c0 going to sleep for 11 seconds 00000100:00100000:2.0:1783441540.625118:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.13@tcp (source: 12345-192.168.201.13@tcp) 00000100:00100000:1.0:1783441540.625249:0:5785:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff91a87d87df80 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5785:1870073693292672:192.168.201.13@tcp:105: 00010000:00010000:1.0:1783441540.625291:0:5785:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff91a85eaa1200/0xa2426164df2c8615 lrc: 2/0,0 mode: --/EX res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x44a19400000020 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783441540.625305:0:5785:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91a85eaa1200/0xa2426164df2c8615 lrc: 0/0,0 mode: --/EX res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x44a19400000020 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783441540.625352:0:5785:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff91a87da46600/0xa2426164df2c86d9 lrc: 3/0,1 mode: --/EX res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783441540.625387:0:5785:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91a87da46600/0xa2426164df2c86d9 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783441540.625402:0:5785:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91a87da46600/0xa2426164df2c86d9 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783441540.625416:0:5785:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff91a87da46600/0xa2426164df2c86d9 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783441540.625422:0:5785:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff91a87da46600/0xa2426164df2c86d9 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783441540.625429:0:5785:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff91a87da46600/0xa2426164df2c86d9 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783441540.625431:0:5788:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073673384192 00010000:00010000:1.0:1783441540.625435:0:5785:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91a87da46600 already unused, calling callback (ffffffffc1f9b4f0) 00010000:00010000:1.0:1783441540.625439:0:5785:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91a87da46600/0xa2426164df2c86d9 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783441540.625440:0:5788:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073673384192 00010000:00010000:1.0:1783441540.625447:0:5785:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91a87da46600/0xa2426164df2c86d9 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783441540.625461:0:5785:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff91a8429bdd00) 00010000:00010000:1.0:1783441540.625478:0:5785:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1783441540.625482:0:5785:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff91a87da46600/0xa2426164df2c86d9 lrc: 2/0,0 mode: --/EX res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783441540.625489:0:5785:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91a87da46600/0xa2426164df2c86d9 lrc: 0/0,0 mode: --/EX res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783441540.625504:0:5785:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff91a85fe59600/0xa2426164df2c86cb lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783441540.625505:0:5788:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.13@tcp, seq: 61 00000100:00100000:3.0:1783441540.625516:0:5788:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a745907800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:65454767-383a-4679-a788-eba05c6e0989+25:11574:x1870073673384192:12345-192.168.201.13@tcp:49:lfs.0 00010000:00010000:1.0:1783441540.625516:0:5785:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff91a85fe59600/0xa2426164df2c86cb lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783441540.625523:0:5785:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff91a85fe59600/0xa2426164df2c86cb lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783441540.625528:0:5785:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91a85fe59600 already unused, calling callback (ffffffffc1f9b4f0) 00010000:00010000:1.0:1783441540.625531:0:5785:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91a85fe59600/0xa2426164df2c86cb lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783441540.625700:0:5788:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a745907800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:65454767-383a-4679-a788-eba05c6e0989+25:11574:x1870073673384192:12345-192.168.201.13@tcp:49:lfs.0 Request processed in 183us (596us total) trans 0 rc 0/0 00000100:00100000:3.0:1783441540.625709:0:5788:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.13@tcp, seq: 61 00010000:00010000:1.0:1783441540.627023:0:5785:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91a85fe59600/0xa2426164df2c86cb lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783441540.627074:0:5785:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff91a8429bdd00) 00010000:00010000:1.0:1783441540.627078:0:5785:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:1.0:1783441540.627085:0:5785:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff91a85fe59600/0xa2426164df2c86cb lrc: 2/0,0 mode: --/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783441540.627092:0:5785:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91a85fe59600/0xa2426164df2c86cb lrc: 0/0,0 mode: --/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783441540.627464:0:5785:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a8476b1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:65454767-383a-4679-a788-eba05c6e0989+24:11575:x1870073673383936:12345-192.168.201.13@tcp:57:lhsmtool_posix.0 Request processed in 19294us (19747us total) trans 4294967514 rc 0/0 00000100:00100000:1.0:1783441540.627477:0:5785:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.13@tcp, seq: 230 00000020:00080000:1.0:1783441540.627483:0:5785:0:(tgt_main.c:784:tgt_ses_key_exit()) total 5 transactions per RPC 00000040:00080000:3.0:1783441540.627778:0:11531:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:3.0:1783441540.627784:0:11531:0:(llog_cat.c:841:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1783441540.628209:0:11531:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 64768 count 3 00000040:00080000:3.0:1783441540.628219:0:11531:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:2.0:1783441540.632088:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.13@tcp (source: 12345-192.168.201.13@tcp) 00000100:00100000:2.0:1783441540.632193:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.13@tcp (source: 12345-192.168.201.13@tcp) 00000100:00100000:1.0:1783441540.632590:0:5789:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073673384704 00000100:00100000:1.0:1783441540.632605:0:5789:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073673384704 00000100:00100000:1.0:1783441540.632693:0:5789:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.13@tcp, seq: 62 00000100:00100000:1.0:1783441540.632705:0:5789:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a846865850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:65454767-383a-4679-a788-eba05c6e0989+24:11575:x1870073673384704:12345-192.168.201.13@tcp:35:lhsmtool_posix.0 00000004:00080000:1.0:1783441540.633486:0:5789:0:(mdd_object.c:4010:mdd_close()) Object [0x200000401:0x10:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000001:00080000:1.0:1783441540.633613:0:5789:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967515 00010000:00010000:1.0:1783441540.633673:0:5789:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff91a87da46000/0xa2426164df2c86e0 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5789 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783441540.633694:0:5789:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91a87da46000/0xa2426164df2c86e0 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010080000000 pid: 5789 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783441540.633708:0:5789:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91a87da46000/0xa2426164df2c86e0 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010080000000 pid: 5789 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783441540.633719:0:5789:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff91a87da46000/0xa2426164df2c86e0 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010080000000 pid: 5789 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783441540.633726:0:5789:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff91a87da46000/0xa2426164df2c86e0 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010480000000 pid: 5789 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783441540.633732:0:5789:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff91a87da46000/0xa2426164df2c86e0 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010480000000 pid: 5789 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783441540.633790:0:5789:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:1.0:1783441540.633936:0:5789:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a846865850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:65454767-383a-4679-a788-eba05c6e0989+26:11575:x1870073673384704:12345-192.168.201.13@tcp:35:lhsmtool_posix.0 Request processed in 1230us (1737us total) trans 4294967516 rc 0/0 00000100:00100000:1.0:1783441540.633947:0:5789:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.13@tcp, seq: 62 00000020:00080000:1.0:1783441540.633953:0:5789:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:2.0:1783441540.634775:0:5772:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1783441540.634787:0:5772:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff91a87da46000/0xa2426164df2c86e0 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5789 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783441540.634798:0:5772:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91a87da46000 already unused, calling callback (ffffffffc155ff90) 00010000:00010000:2.0:1783441540.634821:0:5772:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91a87da46000/0xa2426164df2c86e0 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5789 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783441540.634844:0:5772:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91a87da46000/0xa2426164df2c86e0 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 5789 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783441540.634864:0:5772:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff91a858b90a00) 00010000:00010000:2.0:1783441540.634867:0:5772:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:2.0:1783441540.634872:0:5772:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff91a87da46000/0xa2426164df2c86e0 lrc: 1/0,0 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5789 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783441540.634879:0:5772:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91a87da46000/0xa2426164df2c86e0 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5789 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783441540.634908:0:5772:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783441540.634911:0:5772:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783441540.634913:0:5772:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1783441540.636651:0:5786:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073673384448 00000100:00100000:0.0:1783441540.636672:0:5786:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073673384448 00000100:00100000:0.0:1783441540.637009:0:5786:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.13@tcp, seq: 231 00000100:00100000:0.0:1783441540.637023:0:5786:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a745904a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:65454767-383a-4679-a788-eba05c6e0989+26:11574:x1870073673384448:12345-192.168.201.13@tcp:58:lfs.0 00000040:00080000:0.0:1783441540.637382:0:5786:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].6, 136 off9008 00000100:00100000:0.0:1783441540.637510:0:5786:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a745904a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:65454767-383a-4679-a788-eba05c6e0989+26:11574:x1870073673384448:12345-192.168.201.13@tcp:58:lfs.0 Request processed in 490us (5436us total) trans 0 rc 0/0 00000100:00100000:0.0:1783441540.637520:0:5786:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.13@tcp, seq: 231 00000100:00100000:2.0:1783441540.677606:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.13@tcp (source: 12345-192.168.201.13@tcp) 00000100:00100000:3.0:1783441540.677814:0:5787:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073673384832 00000100:00100000:3.0:1783441540.677829:0:5787:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073673384832 00000100:00100000:3.0:1783441540.677916:0:5787:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.13@tcp, seq: 232 00000100:00100000:3.0:1783441540.677939:0:5787:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a745907800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:65454767-383a-4679-a788-eba05c6e0989+26:11577:x1870073673384832:12345-192.168.201.13@tcp:101:lfs.0 00010000:00010000:3.0:1783441540.677995:0:5787:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1783441540.678026:0:5787:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91a841476800/0xa2426164df2c86e7 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x633a354aa4df50f4 expref: -99 pid: 5787 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783441540.678118:0:5787:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff91a841477200/0xa2426164df2c86ee lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783441540.678135:0:5787:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91a841477200/0xa2426164df2c86ee lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783441540.678151:0:5787:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91a841477200/0xa2426164df2c86ee lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783441540.678166:0:5787:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff91a841476e00/0xa2426164df2c86f5 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783441540.678173:0:5787:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91a841476e00/0xa2426164df2c86f5 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783441540.678180:0:5787:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91a841476e00/0xa2426164df2c86f5 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783441540.678577:0:5787:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff91a841477c00/0xa2426164df2c86fc lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783441540.678590:0:5787:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff91a85fe59c00/0xa2426164df2c8607 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.13@tcp remote: 0x633a354aa4df50b5 expref: 27 pid: 5785 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783441540.678600:0:5787:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff91a841477c00/0xa2426164df2c86fc lrc: 4/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783441540.678642:0:5787:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff91a85fe59c00/0xa2426164df2c8607 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.13@tcp remote: 0x633a354aa4df50b5 expref: 27 pid: 5785 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783441540.678665:0:5787:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff91a85fe59c00/0xa2426164df2c8607 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.13@tcp remote: 0x633a354aa4df50b5 expref: 27 pid: 5785 timeout: 478 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783441540.678680:0:5787:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff91a87d792680 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5787:1870073693292800:192.168.201.13@tcp:104: 00000100:00100000:3.0:1783441540.678856:0:5787:0:(client.c:2702:ptlrpc_set_wait()) set ffff91a848632540 going to sleep for 11 seconds 00000100:00100000:2.0:1783441540.685037:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.13@tcp (source: 12345-192.168.201.13@tcp) 00000100:00100000:1.0:1783441540.685154:0:5789:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073673385088 00000100:00100000:1.0:1783441540.685168:0:5789:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073673385088 00000100:00100000:1.0:1783441540.685249:0:5789:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.13@tcp, seq: 63 00000100:00100000:1.0:1783441540.685261:0:5789:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a859084000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:65454767-383a-4679-a788-eba05c6e0989+28:5569:x1870073673385088:12345-192.168.201.13@tcp:35:ldlm_bl.0 00000100:00100000:1.0:1783441540.685585:0:5789:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a859084000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:65454767-383a-4679-a788-eba05c6e0989+29:5569:x1870073673385088:12345-192.168.201.13@tcp:35:ldlm_bl.0 Request processed in 325us (565us total) trans 4294967517 rc 0/0 00000100:00100000:1.0:1783441540.685613:0:5789:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.13@tcp, seq: 63 00000100:00100000:3.0:1783441540.686383:0:5787:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff91a87d792680 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5787:1870073693292800:192.168.201.13@tcp:104: 00010000:00010000:3.0:1783441540.686425:0:5787:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff91a841477c00/0xa2426164df2c86fc lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783441540.695244:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.13@tcp (source: 12345-192.168.201.13@tcp) 00000100:00100000:3.0:1783441540.695579:0:5771:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073673385216 00000100:00100000:3.0:1783441540.695594:0:5771:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073673385216 00010000:00010000:3.0:1783441540.695650:0:5771:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff91a85fe59c00/0xa2426164df2c8607 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.13@tcp remote: 0x633a354aa4df50b5 expref: 29 pid: 5785 timeout: 478 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783441540.698192:0:5771:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.13@tcp, seq: 88 00000100:00100000:2.0:1783441540.698230:0:5771:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a846f74850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:65454767-383a-4679-a788-eba05c6e0989+29:2355:x1870073673385216:12345-192.168.201.13@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1783441540.698260:0:5771:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1783441540.698275:0:5771:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff91a85fe59c00/0xa2426164df2c8607 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.13@tcp remote: 0x633a354aa4df50b5 expref: 29 pid: 5785 timeout: 478 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783441540.698297:0:5771:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff91a85fe59c00/0xa2426164df2c8607 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.13@tcp remote: 0x633a354aa4df50b5 expref: 29 pid: 5785 timeout: 478 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783441540.698330:0:5771:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91a85fe59c00/0xa2426164df2c8607 lrc: 0/0,0 mode: --/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.13@tcp remote: 0x633a354aa4df50b5 expref: 29 pid: 5785 timeout: 478 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783441540.698376:0:5771:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff91a8429bdd00) 00010000:00010000:2.0:1783441540.698382:0:5771:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff91a841477c00/0xa2426164df2c86fc lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783441540.698391:0:5771:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff91a841477c00/0xa2426164df2c86fc lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783441540.698399:0:5771:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91a841477c00/0xa2426164df2c86fc lrc: 4/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783441540.698445:0:5771:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1783441540.698558:0:5771:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a846f74850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:65454767-383a-4679-a788-eba05c6e0989+28:2355:x1870073673385216:12345-192.168.201.13@tcp:103:ldlm_bl.0 Request processed in 350us (3330us total) trans 0 rc 0/0 00000100:00100000:2.0:1783441540.698566:0:5771:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.13@tcp, seq: 88 00010000:00010000:3.0:1783441540.699375:0:5787:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff91a841477c00/0xa2426164df2c86fc lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783441540.699389:0:5787:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91a841477c00/0xa2426164df2c86fc lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1783441540.699450:0:5787:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xe:0x0]: returning size 0 00000004:00200000:3.0:1783441540.699456:0:5787:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:3.0:1783441540.699498:0:5787:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff91a841477c00/0xa2426164df2c86fc lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783441540.699514:0:5787:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91a841477c00/0xa2426164df2c86fc lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783441540.699525:0:5787:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff91a841477200/0xa2426164df2c86ee lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783441540.699556:0:5787:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff91a841477200/0xa2426164df2c86ee lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783441540.699563:0:5787:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff91a841477200/0xa2426164df2c86ee lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783441540.699569:0:5787:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91a841477200 already unused, calling callback (ffffffffc1f9b4f0) 00010000:00010000:3.0:1783441540.699574:0:5787:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91a841477200/0xa2426164df2c86ee lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783441540.699582:0:5787:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91a841477200/0xa2426164df2c86ee lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783441540.699597:0:5787:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff91a8429bdc00) 00010000:00010000:3.0:1783441540.699600:0:5787:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1783441540.699604:0:5787:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff91a841477200/0xa2426164df2c86ee lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783441540.699610:0:5787:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91a841477200/0xa2426164df2c86ee lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783441540.699627:0:5787:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff91a841476e00/0xa2426164df2c86f5 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783441540.699633:0:5787:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff91a841476e00/0xa2426164df2c86f5 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783441540.699638:0:5787:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff91a841476e00/0xa2426164df2c86f5 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783441540.699642:0:5787:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91a841476e00 already unused, calling callback (ffffffffc1f9b4f0) 00010000:00010000:3.0:1783441540.699652:0:5787:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91a841476e00/0xa2426164df2c86f5 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783441540.699658:0:5787:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91a841476e00/0xa2426164df2c86f5 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783441540.699666:0:5787:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff91a85faee600) 00010000:00010000:3.0:1783441540.699669:0:5787:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1783441540.699672:0:5787:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff91a841476e00/0xa2426164df2c86f5 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783441540.699678:0:5787:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91a841476e00/0xa2426164df2c86f5 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783441540.699731:0:5787:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91a841476800/0xa2426164df2c86e7 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.13@tcp remote: 0x633a354aa4df50f4 expref: 28 pid: 5787 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783441540.699801:0:5787:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff91a841477c00/0xa2426164df2c86fc lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.13@tcp remote: 0x633a354aa4df50f4 expref: 27 pid: 5787 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783441540.699810:0:5787:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff91a8429bdd00) 00010000:00010000:3.0:1783441540.699812:0:5787:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1783441540.699815:0:5787:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91a841477c00, rc 0) 00000100:00100000:3.0:1783441540.700128:0:5787:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a745907800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:65454767-383a-4679-a788-eba05c6e0989+27:11577:x1870073673384832:12345-192.168.201.13@tcp:101:lfs.0 Request processed in 22191us (22534us total) trans 0 rc 0/0 00000100:00100000:3.0:1783441540.700138:0:5787:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.13@tcp, seq: 232 00010000:00010000:1.0:1783441541.294054:0:5773:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:0.0:1783441541.674787:0:12357:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:0.0:1783441541.674802:0:12357:0:(llog_cat.c:841:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1783441541.674878:0:12357:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 7 count 4 00000040:00080000:0.0:1783441541.674891:0:12357:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000040:00080000:0.0:1783441541.683052:0:11531:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:0.0:1783441541.683067:0:11531:0:(llog_cat.c:841:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1783441541.683139:0:11531:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 7 count 4 00000040:00080000:0.0:1783441541.683153:0:11531:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:0.0:1783441541.683345:0:11531:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff91a874dc7480 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:11531:1870073693292928:192.168.201.13@tcp:107:hsm_cdtr.0 00000100:00100000:0.0:1783441541.684662:0:11531:0:(client.c:2702:ptlrpc_set_wait()) set ffff91a847066e40 going to sleep for 11 seconds 00000100:00100000:3.0:1783441541.688421:0:11531:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff91a874dc7480 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:11531:1870073693292928:192.168.201.13@tcp:107:hsm_cdtr.0 00000100:00100000:3.0:1783441541.689786:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.13@tcp (source: 12345-192.168.201.13@tcp) 00000100:00100000:3.0:1783441541.689831:0:6605:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073673385344 00000100:00100000:3.0:1783441541.689862:0:6605:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073673385344 00000100:00100000:3.0:1783441541.689943:0:6605:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.13@tcp, seq: 233 00000100:00100000:3.0:1783441541.689956:0:6605:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a87d792680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:65454767-383a-4679-a788-eba05c6e0989+27:11588:x1870073673385344:12345-192.168.201.13@tcp:53:lhsmtool_posix.0 00000004:00000080:3.0:1783441541.690008:0:6605:0:(mdt_handler.c:7960:mdt_fid2path()) path get [0x200000401:0xe:0x0] from 18446744073709551615 #0 00000100:00100000:3.0:1783441541.690155:0:6605:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a87d792680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:65454767-383a-4679-a788-eba05c6e0989+27:11588:x1870073673385344:12345-192.168.201.13@tcp:53:lhsmtool_posix.0 Request processed in 200us (413us total) trans 0 rc 0/0 00000100:00100000:3.0:1783441541.690164:0:6605:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.13@tcp, seq: 233 00000100:00100000:2.0:1783441541.695201:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.13@tcp (source: 12345-192.168.201.13@tcp) 00000100:00100000:3.0:1783441541.695295:0:5785:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073673385600 00000100:00100000:3.0:1783441541.695309:0:5785:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073673385600 00000100:00100000:3.0:1783441541.695624:0:5785:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.13@tcp, seq: 234 00000100:00100000:3.0:1783441541.695639:0:5785:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a859084a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:65454767-383a-4679-a788-eba05c6e0989+27:11588:x1870073673385600:12345-192.168.201.13@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1783441541.695669:0:5785:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1783441541.695698:0:5785:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91a841476800/0xa2426164df2c8703 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x633a354aa4df50fb expref: -99 pid: 5785 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783441541.695856:0:5785:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff91a841476e00/0xa2426164df2c870a lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783441541.695873:0:5785:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91a841476e00/0xa2426164df2c870a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783441541.695887:0:5785:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91a841476e00/0xa2426164df2c870a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1783441541.695900:0:5785:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xe:0x0]: returning size 0 00010000:00010000:3.0:1783441541.696081:0:5785:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91a841476800/0xa2426164df2c8703 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.13@tcp remote: 0x633a354aa4df50fb expref: 30 pid: 5785 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783441541.696102:0:5785:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff91a841476e00/0xa2426164df2c870a lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.13@tcp remote: 0x633a354aa4df50fb expref: 29 pid: 5785 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783441541.696122:0:5785:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff91a8429bdd00) 00010000:00010000:3.0:1783441541.696126:0:5785:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1783441541.696132:0:5785:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91a841476e00, rc 0) 00000100:00100000:3.0:1783441541.696211:0:5785:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a859084a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:65454767-383a-4679-a788-eba05c6e0989+29:11588:x1870073673385600:12345-192.168.201.13@tcp:101:lhsmtool_posix.0 Request processed in 575us (1025us total) trans 4294967518 rc 0/0 00000100:00100000:3.0:1783441541.696219:0:5785:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.13@tcp, seq: 234 00000100:00100000:0.0:1783441541.703893:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.13@tcp (source: 12345-192.168.201.13@tcp) 00000100:00100000:3.0:1783441541.705363:0:5770:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073673385728 00000100:00100000:3.0:1783441541.705377:0:5770:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073673385728 00000100:00100000:3.0:1783441541.708259:0:5770:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.13@tcp, seq: 16 00000100:00100000:3.0:1783441541.708287:0:5770:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a874dc7480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:65454767-383a-4679-a788-eba05c6e0989+29:2353:x1870073673385728:12345-192.168.201.13@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1783441541.708313:0:5770:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1783441541.708352:0:5770:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91a841476e00/0xa2426164df2c870a lrc: 0/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.13@tcp remote: 0x633a354aa4df50fb expref: 29 pid: 5785 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783441541.708374:0:5770:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff91a8429bdd00) 00010000:00010000:3.0:1783441541.708380:0:5770:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1783441541.708485:0:5770:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a874dc7480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:65454767-383a-4679-a788-eba05c6e0989+28:2353:x1870073673385728:12345-192.168.201.13@tcp:103:ldlm_bl.0 Request processed in 208us (4606us total) trans 0 rc 0/0 00000100:00100000:3.0:1783441541.708496:0:5770:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.13@tcp, seq: 16 00000100:00100000:3.0:1783441541.708613:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.13@tcp (source: 12345-192.168.201.13@tcp) 00000100:00100000:3.0:1783441541.708717:0:5786:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073673385984 00000100:00100000:3.0:1783441541.708727:0:5786:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073673385984 00000100:00100000:3.0:1783441541.708800:0:5786:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.13@tcp, seq: 235 00000100:00100000:3.0:1783441541.708807:0:5786:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a87d791c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:65454767-383a-4679-a788-eba05c6e0989+28:11588:x1870073673385984:12345-192.168.201.13@tcp:57:lhsmtool_posix.0 00010000:00010000:3.0:1783441541.708885:0:5786:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff91a841477200/0xa2426164df2c8718 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783441541.708905:0:5786:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91a841477200/0xa2426164df2c8718 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783441541.708916:0:5786:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91a841477200/0xa2426164df2c8718 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783441541.709180:0:5786:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff91a841477200/0xa2426164df2c8718 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783441541.709188:0:5786:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff91a841477200/0xa2426164df2c8718 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783441541.709196:0:5786:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff91a841477200/0xa2426164df2c8718 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783441541.709204:0:5786:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91a841477200 already unused, calling callback (ffffffffc1f9b4f0) 00010000:00010000:3.0:1783441541.709209:0:5786:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91a841477200/0xa2426164df2c8718 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783441541.709215:0:5786:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91a841477200/0xa2426164df2c8718 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783441541.709223:0:5786:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff91a8429bdd00) 00010000:00010000:3.0:1783441541.709225:0:5786:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:3.0:1783441541.709228:0:5786:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff91a841477200/0xa2426164df2c8718 lrc: 2/0,0 mode: --/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783441541.709232:0:5786:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91a841477200/0xa2426164df2c8718 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783441541.709372:0:5786:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a87d791c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:65454767-383a-4679-a788-eba05c6e0989+29:11588:x1870073673385984:12345-192.168.201.13@tcp:57:lhsmtool_posix.0 Request processed in 565us (763us total) trans 4294967519 rc 0/0 00000100:00100000:3.0:1783441541.709384:0:5786:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.13@tcp, seq: 235 00000040:00080000:2.0:1783441541.710604:0:11531:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:2.0:1783441541.710615:0:11531:0:(llog_cat.c:841:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000100:00100000:3.0:1783441541.712826:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.13@tcp (source: 12345-192.168.201.13@tcp) 00000040:00080000:2.0:1783441541.713603:0:11531:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 64768 count 4 00000040:00080000:2.0:1783441541.713620:0:11531:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:1.0:1783441541.713826:0:5789:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073673386240 00000100:00100000:1.0:1783441541.713839:0:5789:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073673386240 00000100:00100000:1.0:1783441541.713982:0:5789:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.13@tcp, seq: 64 00000100:00100000:1.0:1783441541.713995:0:5789:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a87d790380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:65454767-383a-4679-a788-eba05c6e0989+29:11588:x1870073673386240:12345-192.168.201.13@tcp:35:lhsmtool_posix.0 00000100:00100000:1.0:1783441541.714597:0:5789:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a87d790380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:65454767-383a-4679-a788-eba05c6e0989+30:11588:x1870073673386240:12345-192.168.201.13@tcp:35:lhsmtool_posix.0 Request processed in 601us (1783us total) trans 4294967520 rc 0/0 00000100:00100000:1.0:1783441541.714607:0:5789:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.13@tcp, seq: 64 00000001:00080000:3.0:1783441542.061332:0:7492:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967310 is committed 00000001:00080000:3.0:1783441542.061359:0:7492:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967308 is committed 00010000:00010000:2.0:1783441542.316986:0:5772:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783441543.342566:0:5773:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1783441543.544169:0:3304:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff91a87d792d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:6c1ddb50-5795-40c6-a2b6-8f58add9da62:3304:1870073693293056:0@lo:400:kworker.0 00000100:00100000:3.0:1783441543.544270:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783441543.544327:0:3304:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff91a87d791180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3304:1870073693293568:0@lo:400:kworker.0 00000100:00100000:3.0:1783441543.544360:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783441543.545146:0:3304:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1783441543.545164:0:3304:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff91a87d793b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3304:1870073693293440:0@lo:400:kworker.0 00000100:00100000:3.0:1783441543.545219:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783441543.545273:0:3305:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff91a87d792300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3305:1870073693293184:0@lo:400:kworker.0 00000100:00100000:3.0:1783441543.545306:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783441543.545326:0:3305:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff91a846f24a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3305:1870073693293696:0@lo:400:kworker.0 00000100:00100000:3.0:1783441543.545350:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783441543.545371:0:3305:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1783441543.545378:0:3305:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff91a87d792a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3305:1870073693293312:0@lo:400:kworker.0 00000100:00100000:3.0:1783441543.545402:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783441543.545446:0:5778:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073693293056 00000100:00100000:3.0:1783441543.545457:0:5778:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073693293056 00000100:00100000:0.0:1783441543.547173:0:6605:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073693293568 00000100:00100000:0.0:1783441543.547192:0:6605:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073693293568 00000100:00100000:0.0:1783441543.547259:0:6605:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073693293184 00000100:00100000:0.0:1783441543.547263:0:6605:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073693293184 00000100:00100000:0.0:1783441543.547279:0:6605:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073693293312 00000100:00100000:0.0:1783441543.547282:0:6605:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073693293312 00000100:00100000:0.0:1783441543.547307:0:6605:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 173 00000100:00100000:0.0:1783441543.547318:0:6605:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a846f27100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3304:x1870073693293568:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1783441543.547453:0:6605:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a846f27100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3304:x1870073693293568:12345-0@lo:400:kworker.0 Request processed in 137us (3091us total) trans 0 rc 0/0 00000100:00100000:0.0:1783441543.547462:0:6605:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 173 00000100:00100000:0.0:1783441543.547483:0:6605:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 174 00000100:00100000:0.0:1783441543.547499:0:6605:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a745902a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3305:x1870073693293184:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1783441543.547554:0:6605:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a745902a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3305:x1870073693293184:12345-0@lo:400:kworker.0 Request processed in 64us (2246us total) trans 0 rc 0/0 00000100:00100000:0.0:1783441543.547561:0:6605:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 174 00000100:00100000:0.0:1783441543.547574:0:6605:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 175 00000100:00100000:0.0:1783441543.547581:0:6605:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a87d645880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3305:x1870073693293312:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1783441543.547610:0:6605:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a87d645880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3305:x1870073693293312:12345-0@lo:400:kworker.0 Request processed in 29us (2207us total) trans 0 rc 0/0 00000100:00100000:0.0:1783441543.547616:0:6605:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 175 00000100:00080000:0.0:1783441543.547634:0:5781:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1783441543.548627:0:5778:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 300 00000100:00100000:3.0:1783441543.548646:0:5778:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a848f35850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6c1ddb50-5795-40c6-a2b6-8f58add9da62+19:3304:x1870073693293056:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1783441543.548708:0:5778:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a848f35850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6c1ddb50-5795-40c6-a2b6-8f58add9da62+19:3304:x1870073693293056:12345-0@lo:400:kworker.0 Request processed in 70us (4439us total) trans 0 rc 0/0 00000100:00100000:3.0:1783441543.548715:0:5778:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 300 00000100:00100000:3.0:1783441543.548800:0:6581:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073693293440 00000100:00100000:3.0:1783441543.548807:0:6581:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073693293440 00000100:00100000:3.0:1783441543.548855:0:6581:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073693293696 00000100:00100000:3.0:1783441543.548858:0:6581:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073693293696 00000100:00100000:3.0:1783441543.548884:0:6581:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 98 00000100:00100000:3.0:1783441543.548891:0:6581:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a745900000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+7:3304:x1870073693293440:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1783441543.548929:0:6581:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a745900000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+7:3304:x1870073693293440:12345-0@lo:400:kworker.0 Request processed in 39us (3710us total) trans 0 rc 0/0 00000100:00100000:3.0:1783441543.548935:0:6581:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 98 00000100:00100000:3.0:1783441543.548947:0:6581:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 99 00000100:00100000:3.0:1783441543.548953:0:6581:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a87d647b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3305:x1870073693293696:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1783441543.548981:0:6581:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a87d647b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3305:x1870073693293696:12345-0@lo:400:kworker.0 Request processed in 29us (3630us total) trans 0 rc 0/0 00000100:00100000:3.0:1783441543.548988:0:6581:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 99 00000100:00100000:3.0:1783441543.549058:0:3304:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff91a87d793b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3304:1870073693293440:0@lo:400:kworker.0 00000100:00100000:3.0:1783441543.549071:0:3304:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff91a87d792d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:6c1ddb50-5795-40c6-a2b6-8f58add9da62:3304:1870073693293056:0@lo:400:kworker.0 00000100:00100000:3.0:1783441543.549084:0:3304:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff91a87d791180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3304:1870073693293568:0@lo:400:kworker.0 00000100:00100000:3.0:1783441543.549137:0:3305:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff91a87d792a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3305:1870073693293312:0@lo:400:kworker.0 00000100:00100000:3.0:1783441543.549151:0:3305:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff91a87d792300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3305:1870073693293184:0@lo:400:kworker.0 00000100:00100000:3.0:1783441543.549161:0:3305:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967310 gen 2 00000004:00080000:3.0:1783441543.549168:0:3305:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff91a87d4eb100, transno 4294967307 00000004:00080000:3.0:1783441543.549186:0:3305:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967309 committed transno 4294967310 00000004:00080000:3.0:1783441543.549204:0:3305:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff91a87d683480, transno 4294967310 00000100:00100000:3.0:1783441543.549209:0:3305:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff91a846f24a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3305:1870073693293696:0@lo:400:kworker.0 00000100:00080000:3.0:1783441543.549581:0:5781:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1783441543.549585:0:5781:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000040:00080000:2.0:1783441543.707676:0:12409:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:2.0:1783441543.707690:0:12409:0:(llog_cat.c:841:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1783441543.708860:0:12409:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 7 count 4 00000040:00080000:2.0:1783441543.708870:0:12409:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000040:00080000:2.0:1783441543.789108:0:11531:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:2.0:1783441543.789123:0:11531:0:(llog_cat.c:841:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1783441543.789168:0:11531:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 7 count 4 00000040:00080000:2.0:1783441543.789176:0:11531:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:3.0:1783441543.911188:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.13@tcp (source: 12345-192.168.201.13@tcp) 00000100:00100000:3.0:1783441543.911226:0:6605:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073673386496 00000100:00100000:3.0:1783441543.911236:0:6605:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073673386496 00000100:00100000:3.0:1783441543.911300:0:6605:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.13@tcp, seq: 236 00000100:00100000:3.0:1783441543.911311:0:6605:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a87d4eb100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:65454767-383a-4679-a788-eba05c6e0989+30:11609:x1870073673386496:12345-192.168.201.13@tcp:101:lfs.0 00010000:00010000:3.0:1783441543.911341:0:6605:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1783441543.911361:0:6605:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91a841476000/0xa2426164df2c871f lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x633a354aa4df5102 expref: -99 pid: 6605 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783441543.911467:0:6605:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff91a841477200/0xa2426164df2c8726 lrc: 3/1,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6605 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783441543.911492:0:6605:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91a841477200/0xa2426164df2c8726 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xe:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6605 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783441543.911506:0:6605:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91a841477200/0xa2426164df2c8726 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xe:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6605 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1783441543.911519:0:6605:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xe:0x0]: returning size 0 00010000:00010000:3.0:1783441543.911649:0:6605:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91a841476000/0xa2426164df2c871f lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.13@tcp remote: 0x633a354aa4df5102 expref: 33 pid: 6605 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783441543.911668:0:6605:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff91a841477200/0xa2426164df2c8726 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xe:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.13@tcp remote: 0x633a354aa4df5102 expref: 32 pid: 6605 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783441543.911678:0:6605:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff91a8429bdd00) 00010000:00010000:3.0:1783441543.911681:0:6605:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint d 00010000:00010000:3.0:1783441543.911695:0:6605:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91a841477200, rc 0) 00000100:00100000:3.0:1783441543.911774:0:6605:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a87d4eb100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:65454767-383a-4679-a788-eba05c6e0989+32:11609:x1870073673386496:12345-192.168.201.13@tcp:101:lfs.0 Request processed in 464us (597us total) trans 4294967521 rc 0/0 00000100:00100000:3.0:1783441543.911781:0:6605:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.13@tcp, seq: 236 00000100:00080000:3.0:1783441543.911804:0:5781:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1783441543.921430:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.13@tcp (source: 12345-192.168.201.13@tcp) 00000100:00100000:3.0:1783441543.921466:0:5785:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073673386624 00000100:00100000:3.0:1783441543.921475:0:5785:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073673386624 00000100:00100000:3.0:1783441543.921537:0:5785:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.13@tcp, seq: 237 00000100:00100000:3.0:1783441543.921547:0:5785:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a846f24a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:65454767-383a-4679-a788-eba05c6e0989+32:11609:x1870073673386624:12345-192.168.201.13@tcp:54:lfs.0 00010000:00010000:3.0:1783441543.921616:0:5785:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff91a841476e00/0xa2426164df2c8734 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783441543.921635:0:5785:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91a841476e00/0xa2426164df2c8734 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783441543.921646:0:5785:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91a841476e00/0xa2426164df2c8734 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783441543.921675:0:5785:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff91a841476e00/0xa2426164df2c8734 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783441543.921681:0:5785:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff91a841476e00/0xa2426164df2c8734 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783441543.921687:0:5785:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff91a841476e00/0xa2426164df2c8734 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783441543.921692:0:5785:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91a841476e00 already unused, calling callback (ffffffffc1f9b4f0) 00010000:00010000:3.0:1783441543.921696:0:5785:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91a841476e00/0xa2426164df2c8734 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783441543.921716:0:5785:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91a841476e00/0xa2426164df2c8734 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783441543.921728:0:5785:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff91a8429bdd00) 00010000:00010000:3.0:1783441543.921731:0:5785:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1783441543.921736:0:5785:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff91a841476e00/0xa2426164df2c8734 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783441543.921767:0:5785:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91a841476e00/0xa2426164df2c8734 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783441543.921833:0:5785:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a846f24a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:65454767-383a-4679-a788-eba05c6e0989+32:11609:x1870073673386624:12345-192.168.201.13@tcp:54:lfs.0 Request processed in 287us (412us total) trans 0 rc 0/0 00000100:00100000:3.0:1783441543.921841:0:5785:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.13@tcp, seq: 237 00000100:00100000:3.0:1783441544.032872:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.13@tcp (source: 12345-192.168.201.13@tcp) 00000100:00100000:1.0:1783441544.033075:0:12319:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073673386752 00000100:00100000:1.0:1783441544.033087:0:12319:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073673386752 00000100:00100000:1.0:1783441544.033173:0:12319:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.13@tcp, seq: 72 00000100:00100000:1.0:1783441544.033184:0:12319:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a87d792300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:65454767-383a-4679-a788-eba05c6e0989+7:2355:x1870073673386752:12345-192.168.201.13@tcp:101:cat.0 00010000:00010000:1.0:1783441544.033203:0:12319:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1783441544.033228:0:12319:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000725429ac/0xa2426164df2c873b lrc: 2/0,0 mode: --/PR res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x633a354aa4df5109 expref: -99 pid: 12319 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1783441544.033259:0:12319:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x6:0x0] initial LVB size: 13, mtime: 0x6a4d2884, atime: 0x6a4d2884, ctime: 0x6a4d2884, blocks: 0xb 00010000:00010000:1.0:1783441544.033282:0:12319:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x6:0x0].0x0 since=381s v=(0 0) 00010000:00010000:1.0:1783441544.033287:0:12319:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1783441544.033296:0:12319:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000725429ac/0xa2426164df2c873b lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.13@tcp remote: 0x633a354aa4df5109 expref: 8 pid: 12319 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783441544.033314:0:12319:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000725429ac/0xa2426164df2c873b lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.13@tcp remote: 0x633a354aa4df5109 expref: 8 pid: 12319 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783441544.033343:0:12319:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91a87da47c00, rc 0) 00000100:00100000:1.0:1783441544.033416:0:12319:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a87d792300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:65454767-383a-4679-a788-eba05c6e0989+8:2355:x1870073673386752:12345-192.168.201.13@tcp:101:cat.0 Request processed in 234us (556us total) trans 0 rc 0/0 00000100:00100000:1.0:1783441544.033424:0:12319:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.13@tcp, seq: 72 00000100:00080000:3.0:1783441544.034235:0:5781:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1783441544.037102:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.13@tcp (source: 12345-192.168.201.13@tcp) 00000100:00100000:1.0:1783441544.037306:0:6588:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073673386880 00000100:00100000:1.0:1783441544.037324:0:6588:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073673386880 00002000:00100000:1.0:1783441544.037389:0:6588:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x6:0x0] (0->4095) req@ffff91a87d792a00 x1870073673386880/t0(0) o3->65454767-383a-4679-a788-eba05c6e0989@192.168.201.13@tcp:185/0 lens 488/0 e 0 to 0 dl 1783441555 ref 1 fl New:/600/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1783441544.037399:0:6588:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff91a87d792a00 with x1870073673386880 ext(0->4095) 00002000:00010000:1.0:1783441544.037404:0:6588:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff91a87d792a00 00000100:00100000:1.0:1783441544.037652:0:6588:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.13@tcp, seq: 7 00000100:00100000:1.0:1783441544.037664:0:6588:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a87d792a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:65454767-383a-4679-a788-eba05c6e0989+8:2354:x1870073673386880:12345-192.168.201.13@tcp:3:cat.0 00000100:00100000:1.0:1783441544.037997:0:6588:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a87d792a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:65454767-383a-4679-a788-eba05c6e0989+8:2354:x1870073673386880:12345-192.168.201.13@tcp:3:cat.0 Request processed in 334us (974us total) trans 0 rc 4096/4096 00000100:00100000:1.0:1783441544.038006:0:6588:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.13@tcp, seq: 7 00002000:00100000:1.0:1783441544.038013:0:6588:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x6:0x0] (0->4095) req@ffff91a87d792a00 x1870073673386880/t0(0) o3->65454767-383a-4679-a788-eba05c6e0989@192.168.201.13@tcp:185/0 lens 488/4536 e 0 to 0 dl 1783441555 ref 1 fl Complete:/600/0 rc 4096/4096 job:'cat.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1783441544.038021:0:6588:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff91a87d792a00 with x1870073673386880 ext(0->4095) 00002000:00010000:1.0:1783441544.038025:0:6588:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff91a87d792a00 00000100:00100000:1.0:1783441544.046467:0:3306:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff91a859087480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3306:1870073693293824:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1783441544.046546:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783441544.047875:0:6584:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073693293824 00000100:00100000:2.0:1783441544.047888:0:6584:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073693293824 00000100:00100000:2.0:1783441544.047952:0:6584:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 76 00000100:00100000:2.0:1783441544.047963:0:6584:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a87d87df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3306:x1870073693293824:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1783441544.048002:0:6584:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 51052544 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1783441544.048090:0:6584:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a87d87df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3306:x1870073693293824:12345-0@lo:13:osp-pre-1-0.0 Request processed in 130us (1544us total) trans 0 rc 0/0 00000100:00100000:2.0:1783441544.048213:0:6584:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 76 00000100:00100000:0.0:1783441544.048338:0:3306:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff91a859087480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3306:1870073693293824:0@lo:13:osp-pre-1-0.0 00010000:00010000:2.0:1783441544.365330:0:5772:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1783441545.069148:0:3304:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1783441545.069173:0:3304:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff91a87d87f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3304:1870073693293952:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1783441545.069230:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783441545.073532:0:6584:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073693293952 00000100:00100000:1.0:1783441545.073546:0:6584:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073693293952 00000100:00100000:1.0:1783441545.073640:0:6584:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 77 00000100:00100000:1.0:1783441545.073650:0:6584:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a87d791180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3304:x1870073693293952:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1783441545.073694:0:6584:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1783441545.073799:0:6584:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a87d791180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3304:x1870073693293952:12345-0@lo:13:osp-pre-0-0.0 Request processed in 151us (4567us total) trans 0 rc 0/0 00000100:00100000:1.0:1783441545.073807:0:6584:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 77 00000100:00080000:3.0:1783441545.073885:0:5781:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1783441545.073938:0:3304:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff91a87d87f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3304:1870073693293952:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1783441545.087070:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.13@tcp (source: 12345-192.168.201.13@tcp) 00000100:00100000:3.0:1783441545.087127:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.13@tcp (source: 12345-192.168.201.13@tcp) 00000100:00100000:3.0:1783441545.087161:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.13@tcp (source: 12345-192.168.201.13@tcp) 00000100:00100000:2.0:1783441545.087197:0:6582:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073673387264 00000100:00100000:2.0:1783441545.087212:0:6582:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073673387264 00000100:00100000:3.0:1783441545.087223:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.13@tcp (source: 12345-192.168.201.13@tcp) 00000100:00100000:3.0:1783441545.087260:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.13@tcp (source: 12345-192.168.201.13@tcp) 00000100:00100000:2.0:1783441545.087276:0:6582:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073673387392 00000100:00100000:2.0:1783441545.087281:0:6582:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073673387392 00000100:00100000:1.0:1783441545.087292:0:5780:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073673387008 00000100:00100000:1.0:1783441545.087300:0:5780:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073673387008 00000100:00100000:3.0:1783441545.087308:0:6605:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073673387520 00000100:00100000:3.0:1783441545.087324:0:6605:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073673387520 00000100:00100000:2.0:1783441545.087351:0:6582:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.13@tcp, seq: 100 00000100:00100000:1.0:1783441545.087359:0:5780:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.13@tcp, seq: 301 00000100:00100000:1.0:1783441545.087373:0:5780:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a848f37050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:51c2a82e-e792-4f56-84e8-12cc033e9e70+13:2355:x1870073673387008:12345-192.168.201.13@tcp:400:kworker.0 00000100:00100000:3.0:1783441545.087386:0:6605:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073673387136 00000100:00100000:3.0:1783441545.087400:0:6605:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073673387136 00000100:00100000:2.0:1783441545.087416:0:6582:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a87d792d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:65454767-383a-4679-a788-eba05c6e0989+8:2355:x1870073673387264:12345-192.168.201.13@tcp:400:kworker.0 00000100:00100000:3.0:1783441545.087444:0:6605:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.13@tcp, seq: 176 00000100:00100000:3.0:1783441545.087476:0:6605:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a87d793b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:d5aa2a25-c618-49e9-a833-85b3b4747e53+5:2355:x1870073673387520:12345-192.168.201.13@tcp:400:kworker.0 00000100:00100000:1.0:1783441545.087479:0:5780:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a848f37050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:51c2a82e-e792-4f56-84e8-12cc033e9e70+13:2355:x1870073673387008:12345-192.168.201.13@tcp:400:kworker.0 Request processed in 107us (422us total) trans 0 rc 0/0 00000100:00100000:1.0:1783441545.087494:0:5780:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.13@tcp, seq: 301 00000100:00100000:0.0:1783441545.091126:0:6583:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.13@tcp, seq: 101 00000100:00100000:0.0:1783441545.091144:0:6583:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a745a78a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:65454767-383a-4679-a788-eba05c6e0989+5:2355:x1870073673387392:12345-192.168.201.13@tcp:400:kworker.0 00000100:00100000:2.0:1783441545.091283:0:6582:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a87d792d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:65454767-383a-4679-a788-eba05c6e0989+8:2355:x1870073673387264:12345-192.168.201.13@tcp:400:kworker.0 Request processed in 3872us (4154us total) trans 0 rc 0/0 00000100:00100000:2.0:1783441545.091293:0:6582:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.13@tcp, seq: 100 00000100:00100000:3.0:1783441545.094043:0:6605:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a87d793b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:d5aa2a25-c618-49e9-a833-85b3b4747e53+5:2355:x1870073673387520:12345-192.168.201.13@tcp:400:kworker.0 Request processed in 6394us (6684us total) trans 0 rc 0/0 00000100:00100000:3.0:1783441545.094063:0:6605:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.13@tcp, seq: 176 00000100:00100000:3.0:1783441545.094115:0:6605:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.13@tcp, seq: 177 00000100:00100000:3.0:1783441545.094136:0:6605:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a745a7ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:65454767-383a-4679-a788-eba05c6e0989+32:2355:x1870073673387136:12345-192.168.201.13@tcp:400:kworker.0 00000100:00100000:3.0:1783441545.094238:0:6605:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a745a7ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:65454767-383a-4679-a788-eba05c6e0989+32:2355:x1870073673387136:12345-192.168.201.13@tcp:400:kworker.0 Request processed in 114us (7017us total) trans 0 rc 0/0 00000100:00100000:3.0:1783441545.094245:0:6605:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.13@tcp, seq: 177 00000100:00100000:0.0:1783441545.095452:0:6583:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a745a78a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:65454767-383a-4679-a788-eba05c6e0989+5:2355:x1870073673387392:12345-192.168.201.13@tcp:400:kworker.0 Request processed in 4301us (8179us total) trans 0 rc 0/0 00000100:00100000:0.0:1783441545.095483:0:6583:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.13@tcp, seq: 101 00000100:00080000:0.0:1783441545.095615:0:5781:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1783441545.095621:0:5781:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00010000:1.0:1783441545.389614:0:5773:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:0.0:1783441545.677252:0:6613:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967322 is committed 00000001:00080000:0.0:1783441545.677279:0:6613:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967324 is committed 00000001:00080000:0.0:1783441545.677287:0:6613:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967323 is committed 00000001:00080000:1.0:1783441545.685140:0:5807:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967510 is committed 00000001:00080000:1.0:1783441545.685164:0:5807:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967520 is committed 00000020:00080000:1.0:1783441545.685184:0:5807:0:(update_trans.c:60:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff91a84619ed80 refcount 2 committed 0 result 0 batchid 8 00000020:00080000:1.0:1783441545.685191:0:5807:0:(update_trans.c:68:top_multiple_thandle_dump()) st ffff91a847b0a900 obd lustre-OST0000-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff91a84619ef00 00000020:00080000:1.0:1783441545.685195:0:5807:0:(update_trans.c:68:top_multiple_thandle_dump()) st ffff91a847b0a200 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff91a875314800 00000020:00080000:1.0:1783441545.685224:0:5807:0:(update_trans.c:1341:distribute_txn_batchid_cb()) lustre-MDT0000: 7 batchid updated 00000001:00080000:1.0:1783441545.685233:0:5807:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967521 is committed 00000020:00080000:0.0:1783441545.685311:0:5818:0:(update_trans.c:1581:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 8 committed batchid 7 00000020:00080000:0.0:1783441545.685635:0:5818:0:(update_trans.c:1581:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 7 00010000:00010000:2.0:1783441546.413164:0:5772:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783441547.440105:0:5773:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783441548.461023:0:5772:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1783441548.655308:0:3304:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff91a745a7aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:6c1ddb50-5795-40c6-a2b6-8f58add9da62:3304:1870073693294080:0@lo:400:kworker.0 00000100:00100000:2.0:1783441548.655416:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783441548.655665:0:5779:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073693294080 00000100:00100000:0.0:1783441548.655675:0:5779:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073693294080 00000100:00100000:0.0:1783441548.655771:0:5779:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 302 00000100:00100000:0.0:1783441548.655782:0:5779:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a848f34050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6c1ddb50-5795-40c6-a2b6-8f58add9da62+19:3304:x1870073693294080:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1783441548.658229:0:3306:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff91a745a78700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3306:1870073693294336:0@lo:400:kworker.0 00000100:00100000:1.0:1783441548.658337:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783441548.658399:0:3306:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1783441548.658421:0:3306:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff91a745a79f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3306:1870073693294208:0@lo:400:kworker.0 00000100:00100000:1.0:1783441548.658457:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783441548.658523:0:6605:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073693294336 00000100:00100000:1.0:1783441548.658534:0:6605:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073693294336 00000100:00100000:1.0:1783441548.658599:0:6605:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073693294208 00000100:00100000:1.0:1783441548.658603:0:6605:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073693294208 00000100:00100000:1.0:1783441548.658623:0:6605:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 178 00000100:00100000:1.0:1783441548.658632:0:6605:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a87d87e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3306:x1870073693294336:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1783441548.658695:0:6605:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a87d87e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3306:x1870073693294336:12345-0@lo:400:kworker.0 Request processed in 63us (359us total) trans 0 rc 0/0 00000100:00100000:1.0:1783441548.658702:0:6605:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 178 00000100:00100000:1.0:1783441548.658720:0:6605:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 179 00000100:00100000:1.0:1783441548.658725:0:6605:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a87d87f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3306:x1870073693294208:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1783441548.658772:0:6605:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a87d87f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3306:x1870073693294208:12345-0@lo:400:kworker.0 Request processed in 47us (314us total) trans 0 rc 0/0 00000100:00100000:1.0:1783441548.658779:0:6605:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 179 00000100:00100000:1.0:1783441548.658830:0:3306:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff91a745a79f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3306:1870073693294208:0@lo:400:kworker.0 00000100:00100000:1.0:1783441548.658841:0:3306:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff91a745a78700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3306:1870073693294336:0@lo:400:kworker.0 00000100:00100000:0.0:1783441548.659114:0:5779:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a848f34050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6c1ddb50-5795-40c6-a2b6-8f58add9da62+19:3304:x1870073693294080:12345-0@lo:400:kworker.0 Request processed in 3332us (3696us total) trans 0 rc 0/0 00000100:00100000:0.0:1783441548.659125:0:5779:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 302 00000100:00080000:0.0:1783441548.659169:0:5781:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1783441548.659253:0:3304:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff91a745a7aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:6c1ddb50-5795-40c6-a2b6-8f58add9da62:3304:1870073693294080:0@lo:400:kworker.0 00000100:00100000:2.0:1783441548.659274:0:3304:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1783441548.659280:0:3304:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff91a745a79c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3304:1870073693294464:0@lo:400:kworker.0 00000100:00100000:2.0:1783441548.659317:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783441548.659441:0:6581:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073693294464 00000100:00100000:0.0:1783441548.659454:0:6581:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073693294464 00000100:00100000:0.0:1783441548.659519:0:6581:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 102 00000100:00100000:0.0:1783441548.659527:0:6581:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a859085500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3304:x1870073693294464:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1783441548.659568:0:6581:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a859085500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3304:x1870073693294464:12345-0@lo:400:kworker.0 Request processed in 42us (251us total) trans 0 rc 0/0 00000100:00100000:0.0:1783441548.659575:0:6581:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 102 00000100:00100000:2.0:1783441548.659683:0:3304:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967324 gen 2 00000004:00080000:2.0:1783441548.659690:0:3304:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff91a87d681f80, transno 4294967322 00000004:00080000:2.0:1783441548.659707:0:3304:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967324 committed transno 4294967324 00000100:00100000:2.0:1783441548.659727:0:3304:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff91a745a79c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3304:1870073693294464:0@lo:400:kworker.0 00000100:00080000:1.0:1783441548.663630:0:5781:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1783441548.664766:0:3303:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1783441548.664915:0:3305:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff91a745a78e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3305:1870073693294720:0@lo:400:kworker.0 00000100:00100000:3.0:1783441548.665003:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783441548.665069:0:12319:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073693294720 00000100:00100000:3.0:1783441548.665079:0:12319:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073693294720 00000100:00100000:3.0:1783441548.665147:0:12319:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 103 00000100:00100000:3.0:1783441548.665157:0:12319:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a745a7a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+5:3305:x1870073693294720:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1783441548.665211:0:12319:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a745a7a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+5:3305:x1870073693294720:12345-0@lo:400:kworker.0 Request processed in 55us (208us total) trans 0 rc 0/0 00000100:00100000:3.0:1783441548.665218:0:12319:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 103 00000100:00080000:3.0:1783441548.665239:0:5781:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1783441548.665274:0:3305:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff91a745a78e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3305:1870073693294720:0@lo:400:kworker.0 00000100:00100000:0.0:1783441548.670633:0:3303:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff91a745a7b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3303:1870073693294592:0@lo:400:kworker.0 00000100:00100000:0.0:1783441548.670734:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783441548.671714:0:6605:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073693294592 00000100:00100000:1.0:1783441548.671728:0:6605:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073693294592 00000100:00100000:1.0:1783441548.671846:0:6605:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 180 00000100:00100000:1.0:1783441548.671858:0:6605:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a874dc5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3303:x1870073693294592:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1783441548.671945:0:6605:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a874dc5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3303:x1870073693294592:12345-0@lo:400:kworker.0 Request processed in 90us (1211us total) trans 0 rc 0/0 00000100:00100000:1.0:1783441548.671954:0:6605:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 180 00000100:00100000:1.0:1783441548.672011:0:3303:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff91a745a7b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3303:1870073693294592:0@lo:400:kworker.0 00000100:00080000:0.0:1783441548.672104:0:5781:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1783441549.169312:0:3306:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff91a859086680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3306:1870073693294848:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1783441549.169445:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783441549.169539:0:6584:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073693294848 00000100:00100000:3.0:1783441549.169549:0:6584:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073693294848 00000100:00100000:3.0:1783441549.169611:0:6584:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 78 00000100:00100000:3.0:1783441549.169634:0:6584:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a745a78e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3306:x1870073693294848:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1783441549.169682:0:6584:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 51052544 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1783441549.169769:0:6584:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a745a78e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3306:x1870073693294848:12345-0@lo:13:osp-pre-1-0.0 Request processed in 106us (293us total) trans 0 rc 0/0 00000100:00100000:3.0:1783441549.169778:0:6584:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 78 00000100:00100000:2.0:1783441549.170406:0:3306:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff91a859086680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3306:1870073693294848:0@lo:13:osp-pre-1-0.0 00010000:00010000:2.0:1783441549.485056:0:5773:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1783441549.503000:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.13@tcp (source: 12345-192.168.201.13@tcp) 00000100:00100000:1.0:1783441549.503112:0:5786:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073673387648 00000100:00100000:1.0:1783441549.503126:0:5786:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073673387648 00000100:00100000:1.0:1783441549.503237:0:5786:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.13@tcp, seq: 238 00000100:00100000:1.0:1783441549.503249:0:5786:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a745a7b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:65454767-383a-4679-a788-eba05c6e0989+19:11262:x1870073673387648:12345-192.168.201.13@tcp:60:lhsmtool_posix.0 00000100:00100000:1.0:1783441549.503407:0:5786:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a745a7b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:65454767-383a-4679-a788-eba05c6e0989+19:11262:x1870073673387648:12345-192.168.201.13@tcp:60:lhsmtool_posix.0 Request processed in 160us (425us total) trans 0 rc 0/0 00000100:00100000:1.0:1783441549.503416:0:5786:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.13@tcp, seq: 238 00000100:00080000:0.0:1783441549.503556:0:5781:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1783441549.508236:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.13@tcp (source: 12345-192.168.201.13@tcp) 00000100:00100000:1.0:1783441549.508364:0:5789:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073673387904 00000100:00100000:1.0:1783441549.508379:0:5789:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073673387904 00000100:00100000:1.0:1783441549.508468:0:5789:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.13@tcp, seq: 65 00000100:00100000:1.0:1783441549.508480:0:5789:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a87d681f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:65454767-383a-4679-a788-eba05c6e0989+19:11262:x1870073673387904:12345-192.168.201.13@tcp:35:lhsmtool_posix.0 00000100:00100000:2.0:1783441549.516356:0:5789:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a87d681f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:65454767-383a-4679-a788-eba05c6e0989+20:11262:x1870073673387904:12345-192.168.201.13@tcp:35:lhsmtool_posix.0 Request processed in 7862us (8121us total) trans 4294967522 rc 0/0 00000100:00100000:2.0:1783441549.516374:0:5789:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.13@tcp, seq: 65 00000100:00100000:3.0:1783441549.685590:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.13@tcp (source: 12345-192.168.201.13@tcp) 00000100:00100000:1.0:1783441549.685910:0:6605:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073673388032 00000100:00100000:1.0:1783441549.685925:0:6605:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073673388032 00000100:00100000:1.0:1783441549.686034:0:6605:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.13@tcp, seq: 239 00000100:00100000:1.0:1783441549.686046:0:6605:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a745a79500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:d5aa2a25-c618-49e9-a833-85b3b4747e53+5:12061:x1870073673388032:12345-192.168.201.13@tcp:101:lsof.0 00010000:00010000:1.0:1783441549.686074:0:6605:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1783441549.686103:0:6605:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91a87da47800/0xa2426164df2c8742 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x633a354aa4df5110 expref: -99 pid: 6605 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783441549.686186:0:6605:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff91a87da47200/0xa2426164df2c8749 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6605 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783441549.686201:0:6605:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91a87da47200/0xa2426164df2c8749 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6605 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783441549.686214:0:6605:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91a87da47200/0xa2426164df2c8749 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6605 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00080000:0.0:1783441549.686540:0:5781:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000004:00200000:1.0:1783441549.686852:0:6605:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 7680 00000004:00200000:1.0:1783441549.686857:0:6605:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 3 stripe count 1 MDT count 1 00000004:00010000:1.0:1783441549.686953:0:6605:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff91a87da47200/0xa2426164df2c8749 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6605 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783441549.686989:0:6605:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91a87da47800/0xa2426164df2c8742 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.13@tcp remote: 0x633a354aa4df5110 expref: 7 pid: 6605 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783441549.687012:0:6605:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff91a87da47200/0xa2426164df2c8749 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.13@tcp remote: 0x633a354aa4df5110 expref: 6 pid: 6605 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783441549.687022:0:6605:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff91a8429bd400) 00010000:00010000:1.0:1783441549.687026:0:6605:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1783441549.687030:0:6605:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91a87da47200, rc 0) 00000100:00100000:1.0:1783441549.687116:0:6605:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a745a79500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:d5aa2a25-c618-49e9-a833-85b3b4747e53+6:12061:x1870073673388032:12345-192.168.201.13@tcp:101:lsof.0 Request processed in 1072us (1542us total) trans 0 rc 0/0 00000100:00100000:1.0:1783441549.687126:0:6605:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.13@tcp, seq: 239 00000100:00100000:1.0:1783441550.189262:0:3303:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff91a745a78000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3303:1870073693294976:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1783441550.189372:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783441550.189647:0:6584:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073693294976 00000100:00100000:3.0:1783441550.189659:0:6584:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073693294976 00000100:00100000:3.0:1783441550.189792:0:6584:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 79 00000100:00100000:3.0:1783441550.189805:0:6584:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a875424e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3303:x1870073693294976:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1783441550.189855:0:6584:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1783441550.189929:0:6584:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a875424e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3303:x1870073693294976:12345-0@lo:13:osp-pre-0-0.0 Request processed in 127us (557us total) trans 0 rc 0/0 00000100:00100000:3.0:1783441550.189938:0:6584:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 79 00000100:00080000:1.0:1783441550.190806:0:5781:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1783441550.190891:0:3303:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff91a745a78000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3303:1870073693294976:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1783441550.199508:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.13@tcp (source: 12345-192.168.201.13@tcp) 00000100:00100000:0.0:1783441550.199568:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.13@tcp (source: 12345-192.168.201.13@tcp) 00000100:00100000:0.0:1783441550.199610:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.13@tcp (source: 12345-192.168.201.13@tcp) 00000100:00100000:2.0:1783441550.199788:0:6581:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073673388416 00000100:00100000:2.0:1783441550.199802:0:6581:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073673388416 00000100:00100000:2.0:1783441550.199910:0:6581:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073673388288 00000100:00100000:2.0:1783441550.199914:0:6581:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073673388288 00000100:00100000:2.0:1783441550.199949:0:6581:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.13@tcp, seq: 104 00000100:00100000:2.0:1783441550.199961:0:6581:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a87d683480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:65454767-383a-4679-a788-eba05c6e0989+5:2354:x1870073673388416:12345-192.168.201.13@tcp:400:kworker.0 00000100:00100000:2.0:1783441550.200059:0:6581:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a87d683480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:65454767-383a-4679-a788-eba05c6e0989+5:2354:x1870073673388416:12345-192.168.201.13@tcp:400:kworker.0 Request processed in 100us (489us total) trans 0 rc 0/0 00000100:00100000:2.0:1783441550.200067:0:6581:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.13@tcp, seq: 104 00000100:00100000:2.0:1783441550.200090:0:6581:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.13@tcp, seq: 105 00000100:00100000:2.0:1783441550.200098:0:6581:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a87d681c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:65454767-383a-4679-a788-eba05c6e0989+7:2354:x1870073673388288:12345-192.168.201.13@tcp:400:kworker.0 00000100:00100000:2.0:1783441550.200130:0:6581:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a87d681c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:65454767-383a-4679-a788-eba05c6e0989+7:2354:x1870073673388288:12345-192.168.201.13@tcp:400:kworker.0 Request processed in 33us (520us total) trans 0 rc 0/0 00000100:00100000:2.0:1783441550.200137:0:6581:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.13@tcp, seq: 105 00000100:00080000:0.0:1783441550.200590:0:5781:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1783441550.200595:0:5781:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1783441550.200662:0:5778:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073673388160 00000100:00100000:3.0:1783441550.200668:0:5778:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073673388160 00000100:00100000:3.0:1783441550.200721:0:5778:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.13@tcp, seq: 303 00000100:00100000:3.0:1783441550.200729:0:5778:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a848f34450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:51c2a82e-e792-4f56-84e8-12cc033e9e70+13:2354:x1870073673388160:12345-192.168.201.13@tcp:400:kworker.0 00000100:00100000:3.0:1783441550.200805:0:5778:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a848f34450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:51c2a82e-e792-4f56-84e8-12cc033e9e70+13:2354:x1870073673388160:12345-192.168.201.13@tcp:400:kworker.0 Request processed in 77us (1313us total) trans 0 rc 0/0 00000100:00100000:3.0:1783441550.200812:0:5778:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.13@tcp, seq: 303 00010000:00010000:2.0:1783441550.509205:0:5772:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00080000:1.0:1783441550.772311:0:5807:0:(update_trans.c:1341:distribute_txn_batchid_cb()) lustre-MDT0000: 8 batchid updated 00000020:00080000:2.0:1783441550.772384:0:5818:0:(update_trans.c:1581:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 8 00000020:00080000:2.0:1783441550.772422:0:5818:0:(update_trans.c:1581:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 8 00000001:00080000:1.0:1783441550.772659:0:5807:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967522 is committed 00010000:00010000:2.0:1783441551.538186:0:5773:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783441552.557226:0:5772:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:0.0:1783441553.005080:0:11531:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:0.0:1783441553.005093:0:11531:0:(llog_cat.c:841:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1783441553.005705:0:11531:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 6 count 1 00000040:00080000:0.0:1783441553.005716:0:11531:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00010000:00010000:3.0:1783441553.581986:0:5773:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:2.0:1783441553.598581:0:12611:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: == sanity-pcc test 1c: Test automated attach using Project ID with manual HSM restore ========================================================== 12:25:52 (1783441552) 00000100:00100000:3.0:1783441553.773241:0:3305:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff91a745a7b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3305:1870073693295232:0@lo:400:kworker.0 00000100:00100000:1.0:1783441553.773346:0:3303:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff91a745a7a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3303:1870073693295488:0@lo:400:kworker.0 00000100:00100000:1.0:1783441553.773443:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783441553.773508:0:3303:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:1.0:1783441553.773535:0:3303:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff91a745a78380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:6c1ddb50-5795-40c6-a2b6-8f58add9da62:3303:1870073693295104:0@lo:400:kworker.0 00000100:00100000:1.0:1783441553.773565:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783441553.773590:0:3303:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff91a745a7bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3303:1870073693295616:0@lo:400:kworker.0 00000100:00100000:1.0:1783441553.773616:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783441553.773646:0:5779:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073693295104 00000100:00100000:1.0:1783441553.773653:0:5779:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073693295104 00000100:00100000:1.0:1783441553.773698:0:5779:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 304 00000100:00100000:1.0:1783441553.773707:0:5779:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a848f37450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6c1ddb50-5795-40c6-a2b6-8f58add9da62+19:3303:x1870073693295104:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1783441553.773781:0:5779:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a848f37450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6c1ddb50-5795-40c6-a2b6-8f58add9da62+19:3303:x1870073693295104:12345-0@lo:400:kworker.0 Request processed in 73us (213us total) trans 0 rc 0/0 00000100:00100000:1.0:1783441553.773787:0:5779:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 304 00000100:00100000:1.0:1783441553.773819:0:5786:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073693295616 00000100:00100000:1.0:1783441553.773823:0:5786:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073693295616 00000100:00100000:1.0:1783441553.773856:0:5786:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 181 00000100:00100000:1.0:1783441553.773863:0:5786:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a87d4dd500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3303:x1870073693295616:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1783441553.773892:0:5786:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a87d4dd500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3303:x1870073693295616:12345-0@lo:400:kworker.0 Request processed in 30us (277us total) trans 0 rc 0/0 00000100:00100000:1.0:1783441553.773898:0:5786:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 181 00000100:00080000:1.0:1783441553.773913:0:5781:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1783441553.773938:0:3303:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff91a745a78380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:6c1ddb50-5795-40c6-a2b6-8f58add9da62:3303:1870073693295104:0@lo:400:kworker.0 00000100:00100000:1.0:1783441553.773951:0:3303:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff91a745a7bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3303:1870073693295616:0@lo:400:kworker.0 00000100:00100000:3.0:1783441553.774477:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783441553.774662:0:3305:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff91a745a79180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3305:1870073693295744:0@lo:400:kworker.0 00000100:00100000:3.0:1783441553.774691:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783441553.774719:0:3305:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1783441553.774727:0:3305:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff91a745a79880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3305:1870073693295360:0@lo:400:kworker.0 00000100:00100000:3.0:1783441553.774767:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783441553.774801:0:6583:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073693295488 00000100:00100000:3.0:1783441553.774806:0:6583:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073693295488 00000100:00100000:3.0:1783441553.774841:0:6583:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073693295744 00000100:00100000:3.0:1783441553.774844:0:6583:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073693295744 00000100:00100000:3.0:1783441553.774867:0:6583:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 106 00000100:00100000:3.0:1783441553.774873:0:6583:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a87d4df800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3303:x1870073693295488:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1783441553.774915:0:6583:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a87d4df800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3303:x1870073693295488:12345-0@lo:400:kworker.0 Request processed in 42us (1478us total) trans 0 rc 0/0 00000100:00100000:3.0:1783441553.774922:0:6583:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 106 00000100:00100000:3.0:1783441553.774936:0:6583:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 107 00000100:00100000:3.0:1783441553.774941:0:6583:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a745a78380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3305:x1870073693295744:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1783441553.774969:0:6583:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a745a78380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3305:x1870073693295744:12345-0@lo:400:kworker.0 Request processed in 28us (278us total) trans 0 rc 0/0 00000100:00100000:3.0:1783441553.774975:0:6583:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 107 00000100:00100000:3.0:1783441553.774993:0:6605:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073693295232 00000100:00100000:3.0:1783441553.774996:0:6605:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073693295232 00000100:00100000:3.0:1783441553.775016:0:6605:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073693295360 00000100:00100000:3.0:1783441553.775018:0:6605:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073693295360 00000100:00100000:3.0:1783441553.775031:0:6605:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 182 00000100:00100000:3.0:1783441553.775036:0:6605:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a745a7bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3305:x1870073693295232:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1783441553.775189:0:5787:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 183 00000100:00100000:2.0:1783441553.775199:0:5787:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a745a78000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3305:x1870073693295360:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1783441553.789814:0:5787:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a745a78000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3305:x1870073693295360:12345-0@lo:400:kworker.0 Request processed in 14605us (15033us total) trans 0 rc 0/0 00000100:00100000:2.0:1783441553.789832:0:5787:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 183 00000100:00080000:2.0:1783441553.789921:0:5781:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1783441553.789928:0:5781:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1783441553.789932:0:5781:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1783441553.789992:0:3303:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff91a745a7a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3303:1870073693295488:0@lo:400:kworker.0 00000100:00100000:2.0:1783441553.790032:0:3305:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff91a745a79880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3305:1870073693295360:0@lo:400:kworker.0 00000100:00100000:2.0:1783441553.790046:0:3305:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff91a745a79180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3305:1870073693295744:0@lo:400:kworker.0 00000100:00100000:3.0:1783441553.796804:0:6605:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a745a7bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3305:x1870073693295232:12345-0@lo:400:kworker.0 Request processed in 21756us (22315us total) trans 0 rc 0/0 00000100:00100000:3.0:1783441553.796821:0:6605:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 182 00000100:00100000:2.0:1783441553.796970:0:3305:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff91a745a7b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3305:1870073693295232:0@lo:400:kworker.0 00000100:00100000:1.0:1783441554.286736:0:3306:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff91a87d6f3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3306:1870073693295872:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1783441554.287087:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783441554.287135:0:6584:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073693295872 00000100:00100000:3.0:1783441554.287143:0:6584:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073693295872 00000100:00100000:3.0:1783441554.287193:0:6584:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 80 00000100:00100000:3.0:1783441554.287203:0:6584:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a87d4ded80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3306:x1870073693295872:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1783441554.287239:0:6584:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 51052544 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1783441554.287288:0:6584:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a87d4ded80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3306:x1870073693295872:12345-0@lo:13:osp-pre-1-0.0 Request processed in 87us (201us total) trans 0 rc 0/0 00000100:00100000:3.0:1783441554.287296:0:6584:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 80 00000100:00100000:1.0:1783441554.287447:0:3306:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff91a87d6f3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3306:1870073693295872:0@lo:13:osp-pre-1-0.0 00010000:00010000:3.0:1783441554.607452:0:5772:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1783441555.309061:0:3304:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1783441555.309089:0:3304:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff91a745551880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3304:1870073693296000:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1783441555.309156:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783441555.309577:0:6584:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073693296000 00000100:00100000:1.0:1783441555.309586:0:6584:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073693296000 00000100:00100000:1.0:1783441555.309648:0:6584:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 81 00000100:00100000:1.0:1783441555.309657:0:6584:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a745552680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3304:x1870073693296000:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1783441555.309695:0:6584:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1783441555.309760:0:6584:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a745552680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3304:x1870073693296000:12345-0@lo:13:osp-pre-0-0.0 Request processed in 84us (583us total) trans 0 rc 0/0 00000100:00100000:1.0:1783441555.309768:0:6584:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 81 00000100:00100000:1.0:1783441555.309811:0:3304:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff91a745551880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3304:1870073693296000:0@lo:13:osp-pre-0-0.0 00000100:00080000:0.0:1783441555.311093:0:5781:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1783441555.322039:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.13@tcp (source: 12345-192.168.201.13@tcp) 00000100:00100000:0.0:1783441555.322077:0:5780:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073673388544 00000100:00100000:0.0:1783441555.322085:0:5780:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073673388544 00000100:00100000:0.0:1783441555.322125:0:5780:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.13@tcp, seq: 305 00000100:00100000:0.0:1783441555.322133:0:5780:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a848f35c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:51c2a82e-e792-4f56-84e8-12cc033e9e70+13:2355:x1870073673388544:12345-192.168.201.13@tcp:400:kworker.0 00000100:00100000:0.0:1783441555.322190:0:5780:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a848f35c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:51c2a82e-e792-4f56-84e8-12cc033e9e70+13:2355:x1870073673388544:12345-192.168.201.13@tcp:400:kworker.0 Request processed in 59us (159us total) trans 0 rc 0/0 00000100:00100000:0.0:1783441555.322197:0:5780:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.13@tcp, seq: 305 00000100:00100000:0.0:1783441555.322239:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.13@tcp (source: 12345-192.168.201.13@tcp) 00000100:00100000:0.0:1783441555.322472:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.13@tcp (source: 12345-192.168.201.13@tcp) 00000100:00100000:0.0:1783441555.322499:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.13@tcp (source: 12345-192.168.201.13@tcp) 00000100:00100000:0.0:1783441555.322517:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.13@tcp (source: 12345-192.168.201.13@tcp) 00000100:00100000:0.0:1783441555.322536:0:12319:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073673388800 00000100:00100000:0.0:1783441555.322539:0:12319:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073673388800 00000100:00100000:0.0:1783441555.322569:0:12319:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073673388928 00000100:00100000:0.0:1783441555.322571:0:12319:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073673388928 00000100:00100000:0.0:1783441555.322588:0:12319:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.13@tcp, seq: 108 00000100:00100000:0.0:1783441555.322593:0:12319:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a87d6f0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:65454767-383a-4679-a788-eba05c6e0989+7:2355:x1870073673388800:12345-192.168.201.13@tcp:400:kworker.0 00000100:00100000:0.0:1783441555.322623:0:12319:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a87d6f0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:65454767-383a-4679-a788-eba05c6e0989+7:2355:x1870073673388800:12345-192.168.201.13@tcp:400:kworker.0 Request processed in 30us (383us total) trans 0 rc 0/0 00000100:00100000:0.0:1783441555.322629:0:12319:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.13@tcp, seq: 108 00000100:00100000:0.0:1783441555.322640:0:12319:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.13@tcp, seq: 109 00000100:00100000:0.0:1783441555.322645:0:12319:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a877fafb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:65454767-383a-4679-a788-eba05c6e0989+5:2355:x1870073673388928:12345-192.168.201.13@tcp:400:kworker.0 00000100:00100000:0.0:1783441555.322663:0:12319:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a877fafb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:65454767-383a-4679-a788-eba05c6e0989+5:2355:x1870073673388928:12345-192.168.201.13@tcp:400:kworker.0 Request processed in 18us (145us total) trans 0 rc 0/0 00000100:00100000:0.0:1783441555.322669:0:12319:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.13@tcp, seq: 109 00000100:00080000:0.0:1783441555.322721:0:5781:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1783441555.322730:0:5781:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1783441555.323456:0:5785:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073673389056 00000100:00100000:2.0:1783441555.323463:0:5785:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073673389056 00000100:00100000:2.0:1783441555.323501:0:5785:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073673388672 00000100:00100000:2.0:1783441555.323504:0:5785:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073673388672 00000100:00100000:2.0:1783441555.323536:0:5785:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.13@tcp, seq: 184 00000100:00100000:2.0:1783441555.323544:0:5785:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a87d6f3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d5aa2a25-c618-49e9-a833-85b3b4747e53+6:2355:x1870073673389056:12345-192.168.201.13@tcp:400:kworker.0 00000100:00100000:2.0:1783441555.323598:0:5785:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a87d6f3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d5aa2a25-c618-49e9-a833-85b3b4747e53+6:2355:x1870073673389056:12345-192.168.201.13@tcp:400:kworker.0 Request processed in 55us (1126us total) trans 0 rc 0/0 00000100:00100000:2.0:1783441555.323604:0:5785:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.13@tcp, seq: 184 00000100:00100000:2.0:1783441555.323626:0:5785:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.13@tcp, seq: 185 00000100:00100000:2.0:1783441555.323633:0:5785:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a87da6b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:65454767-383a-4679-a788-eba05c6e0989+19:2355:x1870073673388672:12345-192.168.201.13@tcp:400:kworker.0 00000100:00100000:2.0:1783441555.323668:0:5785:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a87da6b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:65454767-383a-4679-a788-eba05c6e0989+19:2355:x1870073673388672:12345-192.168.201.13@tcp:400:kworker.0 Request processed in 36us (1168us total) trans 0 rc 0/0 00000100:00100000:2.0:1783441555.323673:0:5785:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.13@tcp, seq: 185 00000100:00080000:2.0:1783441555.323729:0:5781:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:3.0:1783441555.628903:0:5773:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783441556.653539:0:5772:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783441557.677171:0:5773:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1783441558.082105:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.13@tcp (source: 12345-192.168.201.13@tcp) 00000100:00100000:2.0:1783441558.082599:0:5789:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073673389312 00000100:00100000:2.0:1783441558.082615:0:5789:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073673389312 00000100:00100000:2.0:1783441558.082707:0:5789:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.13@tcp, seq: 66 00000100:00100000:2.0:1783441558.082724:0:5789:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a877faed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:65454767-383a-4679-a788-eba05c6e0989+19:12282:x1870073673389312:12345-192.168.201.13@tcp:35:umount.0 00000100:00080000:0.0:1783441558.083199:0:5781:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1783441558.083375:0:5789:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a877faed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:65454767-383a-4679-a788-eba05c6e0989+20:12282:x1870073673389312:12345-192.168.201.13@tcp:35:umount.0 Request processed in 654us (1294us total) trans 4294967523 rc 0/0 00000100:00100000:2.0:1783441558.083384:0:5789:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.13@tcp, seq: 66 00000100:00100000:2.0:1783441558.086664:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.13@tcp (source: 12345-192.168.201.13@tcp) 00000100:00100000:1.0:1783441558.086805:0:5788:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073673389568 00000100:00100000:1.0:1783441558.086825:0:5788:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073673389568 00000100:00100000:1.0:1783441558.087242:0:5788:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.13@tcp, seq: 67 00000100:00100000:1.0:1783441558.087265:0:5788:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a859086680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:65454767-383a-4679-a788-eba05c6e0989+20:12282:x1870073673389568:12345-192.168.201.13@tcp:35:umount.0 00000100:00100000:1.0:1783441558.088312:0:5788:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a859086680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:65454767-383a-4679-a788-eba05c6e0989+21:12282:x1870073673389568:12345-192.168.201.13@tcp:35:umount.0 Request processed in 1040us (1648us total) trans 4294967524 rc 0/0 00000100:00100000:1.0:1783441558.088329:0:5788:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.13@tcp, seq: 67 00000100:00100000:3.0:1783441558.093419:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.13@tcp (source: 12345-192.168.201.13@tcp) 00000100:00100000:2.0:1783441558.093553:0:5789:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073673389824 00000100:00100000:2.0:1783441558.093569:0:5789:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073673389824 00000100:00100000:2.0:1783441558.093645:0:5789:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.13@tcp, seq: 68 00000100:00100000:2.0:1783441558.093656:0:5789:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a846867050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:65454767-383a-4679-a788-eba05c6e0989+21:12282:x1870073673389824:12345-192.168.201.13@tcp:35:umount.0 00000100:00100000:2.0:1783441558.094202:0:5789:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a846867050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:65454767-383a-4679-a788-eba05c6e0989+22:12282:x1870073673389824:12345-192.168.201.13@tcp:35:umount.0 Request processed in 545us (795us total) trans 4294967525 rc 0/0 00000100:00100000:2.0:1783441558.094211:0:5789:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.13@tcp, seq: 68 00000100:00100000:0.0:1783441558.099228:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.13@tcp (source: 12345-192.168.201.13@tcp) 00000100:00100000:1.0:1783441558.099457:0:5788:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073673390080 00000100:00100000:1.0:1783441558.099472:0:5788:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073673390080 00000100:00100000:1.0:1783441558.099563:0:5788:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.13@tcp, seq: 69 00000100:00100000:1.0:1783441558.099577:0:5788:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a877face00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:65454767-383a-4679-a788-eba05c6e0989+22:12282:x1870073673390080:12345-192.168.201.13@tcp:35:umount.0 00000100:00100000:1.0:1783441558.100412:0:5788:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a877face00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:65454767-383a-4679-a788-eba05c6e0989+23:12282:x1870073673390080:12345-192.168.201.13@tcp:35:umount.0 Request processed in 833us (1194us total) trans 4294967526 rc 0/0 00000100:00100000:1.0:1783441558.100424:0:5788:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.13@tcp, seq: 69 00000100:00100000:3.0:1783441558.105043:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.13@tcp (source: 12345-192.168.201.13@tcp) 00000100:00100000:1.0:1783441558.110781:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.13@tcp (source: 12345-192.168.201.13@tcp) 00000100:00100000:2.0:1783441558.110861:0:6582:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073673390336 00000100:00100000:2.0:1783441558.110879:0:6582:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073673390336 00000100:00100000:2.0:1783441558.110988:0:6582:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.13@tcp, seq: 73 00000100:00100000:2.0:1783441558.111000:0:6582:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a745551880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:65454767-383a-4679-a788-eba05c6e0989+5:2351:x1870073673390336:12345-192.168.201.13@tcp:9:umount.0 00000020:00000080:2.0:1783441558.111058:0:6582:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xa2426164df2c7a99 00000100:00080000:2.0:1783441558.111068:0:6582:0:(import.c:65:import_set_state_nolock()) ffff91a8431d2000 : changing import state from FULL to CLOSED 00000001:00000004:2.0:1783441558.111111:0:6582:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 4294967310 00000100:00100000:2.0:1783441558.111404:0:6582:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a745551880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:65454767-383a-4679-a788-eba05c6e0989+2:2351:x1870073673390336:12345-192.168.201.13@tcp:9:umount.0 Request processed in 406us (672us total) trans 0 rc 0/0 00000100:00100000:2.0:1783441558.111413:0:6582:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.13@tcp, seq: 73 00000100:00100000:1.0:1783441558.111595:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.13@tcp (source: 12345-192.168.201.13@tcp) 00000100:00080000:3.0:1783441558.111709:0:5781:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00010000:3.0:1783441558.111722:0:5772:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1783441558.113408:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.13@tcp (source: 12345-192.168.201.13@tcp) 00000100:00100000:0.0:1783441558.118178:0:11015:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073673390208 00000100:00100000:0.0:1783441558.118202:0:11015:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073673390208 00000100:00100000:0.0:1783441558.118321:0:11015:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073673390464 00000100:00100000:0.0:1783441558.118325:0:11015:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073673390464 00000100:00100000:0.0:1783441558.118390:0:11514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.13@tcp, seq: 17 00000100:00100000:0.0:1783441558.118404:0:11514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a745a7b100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:51c2a82e-e792-4f56-84e8-12cc033e9e70+14:2352:x1870073673390208:12345-192.168.201.13@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1783441558.118430:0:11514:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1783441558.118462:0:11514:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff91a87da46800/0xa2426164df2c77c1 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x44801000000000 nid: 192.168.201.13@tcp remote: 0x633a354aa4df4c9b expref: 14 pid: 5778 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783441558.118489:0:11514:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1783441558.118592:0:11514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a745a7b100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:51c2a82e-e792-4f56-84e8-12cc033e9e70+13:2352:x1870073673390208:12345-192.168.201.13@tcp:103:ldlm_bl.0 Request processed in 191us (13566us total) trans 0 rc 0/0 00000100:00100000:0.0:1783441558.118601:0:11514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.13@tcp, seq: 17 00000100:00100000:0.0:1783441558.118637:0:11514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.13@tcp, seq: 18 00000100:00100000:0.0:1783441558.118645:0:11514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a745553b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:51c2a82e-e792-4f56-84e8-12cc033e9e70+12:2353:x1870073673390464:12345-192.168.201.13@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1783441558.118655:0:11514:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1783441558.118672:0:11514:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff91a87da47400/0xa2426164df2c79d5 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x44801000000000 nid: 192.168.201.13@tcp remote: 0x633a354aa4df4d66 expref: 12 pid: 5780 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783441558.118687:0:11514:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1783441558.118711:0:11514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a745553b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:51c2a82e-e792-4f56-84e8-12cc033e9e70+11:2353:x1870073673390464:12345-192.168.201.13@tcp:103:ldlm_bl.0 Request processed in 65us (7119us total) trans 0 rc 0/0 00000100:00100000:0.0:1783441558.118722:0:11514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.13@tcp, seq: 18 00000100:00100000:1.0:1783441558.119277:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.13@tcp (source: 12345-192.168.201.13@tcp) 00000100:00100000:0.0:1783441558.119402:0:5769:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073673390592 00000100:00100000:0.0:1783441558.119408:0:5769:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073673390592 00000100:00100000:0.0:1783441558.119459:0:5769:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.13@tcp, seq: 19 00000100:00100000:0.0:1783441558.119466:0:5769:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a745551180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:51c2a82e-e792-4f56-84e8-12cc033e9e70+11:2352:x1870073673390592:12345-192.168.201.13@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1783441558.119478:0:5769:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1783441558.119490:0:5769:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff91a87da46a00/0xa2426164df2c7727 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x44801000000000 nid: 192.168.201.13@tcp remote: 0x633a354aa4df4c63 expref: 11 pid: 5780 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783441558.119515:0:5769:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1783441558.119550:0:5769:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a745551180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:51c2a82e-e792-4f56-84e8-12cc033e9e70+10:2352:x1870073673390592:12345-192.168.201.13@tcp:103:ldlm_bl.0 Request processed in 84us (6152us total) trans 0 rc 0/0 00000100:00100000:0.0:1783441558.119557:0:5769:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.13@tcp, seq: 19 00000100:00100000:0.0:1783441558.119580:0:6583:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073673390976 00000100:00100000:0.0:1783441558.119584:0:6583:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073673390976 00000100:00100000:0.0:1783441558.119627:0:6583:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.13@tcp, seq: 74 00000100:00100000:0.0:1783441558.119636:0:6583:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a745552d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:65454767-383a-4679-a788-eba05c6e0989+7:2351:x1870073673390976:12345-192.168.201.13@tcp:9:umount.0 00000100:00080000:3.0:1783441558.119655:0:5781:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000020:00000080:0.0:1783441558.119671:0:6583:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xa2426164df2c7cfa 00000020:00010000:0.0:1783441558.119683:0:6583:0:(genops.c:1944:obd_stale_export_put()) Put export ffff91a8433dc000: total 0 00000100:00080000:0.0:1783441558.119690:0:6583:0:(import.c:65:import_set_state_nolock()) ffff91a8433df000 : changing import state from FULL to CLOSED 00000001:00000004:0.0:1783441558.119775:0:6583:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 4294967324 00000100:00100000:0.0:1783441558.120228:0:6583:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a745552d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:65454767-383a-4679-a788-eba05c6e0989+5:2351:x1870073673390976:12345-192.168.201.13@tcp:9:umount.0 Request processed in 591us (952us total) trans 0 rc 0/0 00000100:00100000:0.0:1783441558.120235:0:6583:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.13@tcp, seq: 74 00000020:00010000:0.0:1783441558.120291:0:5773:0:(genops.c:1930:obd_stale_export_get()) Get export ffff91a8433dc000: total 0 00010000:00010000:0.0:1783441558.120314:0:5773:0:(ldlm_lock.c:2652:ldlm_export_cancel_blocked_locks()) Export ffff91a8433dc000, canceled 0 locks, left on hash table 2. 00010000:00010000:0.0:1783441558.120369:0:5773:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000ddebac60/0xa2426164df2c809d lrc: 0/0,0 mode: --/PR res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801000000000 nid: 192.168.201.13@tcp remote: 0x633a354aa4df4f3b expref: 4 pid: 6582 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783441558.120433:0:5773:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000725429ac/0xa2426164df2c873b lrc: 0/0,0 mode: --/PR res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801000000000 nid: 192.168.201.13@tcp remote: 0x633a354aa4df5109 expref: 3 pid: 12319 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783441558.120451:0:5773:0:(ldlm_lock.c:2680:ldlm_export_cancel_locks()) Export ffff91a8433dc000, canceled 2 locks, left on hash table 0. 00010000:00010000:0.0:1783441558.120463:0:5773:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783441558.120465:0:5773:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783441558.120467:0:5773:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1783441558.135159:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.13@tcp (source: 12345-192.168.201.13@tcp) 00000100:00100000:2.0:1783441558.135610:0:5785:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073673392000 00000100:00100000:2.0:1783441558.135620:0:5785:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073673392000 00000100:00100000:0.0:1783441558.135980:0:5787:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.13@tcp, seq: 240 00000100:00100000:0.0:1783441558.136005:0:5787:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a745a79c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:65454767-383a-4679-a788-eba05c6e0989+23:2351:x1870073673392000:12345-192.168.201.13@tcp:39:umount.0 00000020:00000080:0.0:1783441558.136052:0:5787:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xa2426164df2c7735 00000020:00010000:0.0:1783441558.136077:0:5787:0:(genops.c:1944:obd_stale_export_put()) Put export ffff91a744384800: total 0 00000100:00080000:0.0:1783441558.136082:0:5787:0:(import.c:65:import_set_state_nolock()) ffff91a7450eb000 : changing import state from FULL to CLOSED 00000001:00000004:0.0:1783441558.136130:0:5787:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 1, last_transno is 4294967526 00000020:00010000:3.0:1783441558.137416:0:5772:0:(genops.c:1930:obd_stale_export_get()) Get export ffff91a744384800: total 0 00010000:00010000:3.0:1783441558.137434:0:5772:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783441558.137569:0:5772:0:(ldlm_lock.c:2652:ldlm_export_cancel_blocked_locks()) Export ffff91a744384800, canceled 0 locks, left on hash table 14. 00010000:00010000:3.0:1783441558.137611:0:5772:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff91a8439b0300) 00010000:00010000:3.0:1783441558.137616:0:5772:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:3.0:1783441558.137627:0:5772:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91a85fe59e00/0xa2426164df2c7a6f lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.13@tcp remote: 0x633a354aa4df4d90 expref: 22 pid: 6605 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783441558.137689:0:5772:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff91a8429bdd00) 00010000:00010000:3.0:1783441558.137692:0:5772:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1783441558.137698:0:5772:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91a85fe58600/0xa2426164df2c861c lrc: 0/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.13@tcp remote: 0x633a354aa4df50bc expref: 21 pid: 5786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783441558.137712:0:5772:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff91a85faeeb00) 00010000:00010000:3.0:1783441558.137714:0:5772:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1783441558.137719:0:5772:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91a87da46200/0xa2426164df2c7f7e lrc: 0/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.13@tcp remote: 0x633a354aa4df4eee expref: 20 pid: 6605 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783441558.138345:0:5787:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a745a79c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:65454767-383a-4679-a788-eba05c6e0989+19:2351:x1870073673392000:12345-192.168.201.13@tcp:39:umount.0 Request processed in 2340us (3184us total) trans 4294967527 rc 0/0 00000100:00100000:0.0:1783441558.138360:0:5787:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.13@tcp, seq: 240 00010000:00010000:3.0:1783441558.139399:0:5772:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff91a85faeeb00) 00010000:00010000:3.0:1783441558.139420:0:5772:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1783441558.139440:0:5772:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91a85fe58200/0xa2426164df2c807a lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.13@tcp remote: 0x633a354aa4df4f2d expref: 18 pid: 5786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783441558.142164:0:5772:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff91a8429bdd00) 00010000:00010000:3.0:1783441558.142175:0:5772:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1783441558.142188:0:5772:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91a841477c00/0xa2426164df2c86fc lrc: 0/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.13@tcp remote: 0x633a354aa4df50f4 expref: 17 pid: 5787 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783441558.142231:0:5772:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff91a8429bd400) 00010000:00010000:3.0:1783441558.142234:0:5772:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1783441558.142238:0:5772:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91a85f83d000/0xa2426164df2c80ff lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.13@tcp remote: 0x633a354aa4df4f57 expref: 16 pid: 5786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783441558.144302:0:5772:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff91a858b90e00) 00010000:00010000:3.0:1783441558.144311:0:5772:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1783441558.144345:0:5772:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91a87da46400/0xa2426164df2c7a1b lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.13@tcp remote: 0x633a354aa4df4d7b expref: 15 pid: 5787 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783441558.144375:0:5772:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff91a85faeeb00) 00010000:00010000:3.0:1783441558.144377:0:5772:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:3.0:1783441558.144382:0:5772:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91a85f83ca00/0xa2426164df2c8050 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1a/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.13@tcp remote: 0x633a354aa4df4f26 expref: 14 pid: 5785 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783441558.144395:0:5772:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff91a85faeeb00) 00010000:00010000:3.0:1783441558.144397:0:5772:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint d 00010000:00010000:3.0:1783441558.144401:0:5772:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91a85f83c600/0xa2426164df2c8088 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0xd/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.13@tcp remote: 0x633a354aa4df4f34 expref: 13 pid: 5785 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783441558.144417:0:5772:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff91a8429bdd00) 00010000:00010000:3.0:1783441558.144420:0:5772:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint d 00010000:00010000:3.0:1783441558.144423:0:5772:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91a841477200/0xa2426164df2c8726 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0xd/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.13@tcp remote: 0x633a354aa4df5102 expref: 12 pid: 6605 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783441558.144438:0:5772:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff91a8439b0300) 00010000:00010000:3.0:1783441558.144440:0:5772:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:3.0:1783441558.144444:0:5772:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91a87da47e00/0xa2426164df2c7d5c lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.13@tcp remote: 0x633a354aa4df4e62 expref: 11 pid: 6605 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783441558.144473:0:5772:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x0 (ffff91a85faeee00) 00010000:00010000:3.0:1783441558.144476:0:5772:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1783441558.144480:0:5772:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91a841476400/0xa2426164df2c79ff lrc: 0/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.13@tcp remote: 0x633a354aa4df4d74 expref: 10 pid: 5786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783441558.144498:0:5772:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff91a8429bdc00) 00010000:00010000:3.0:1783441558.144507:0:5772:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:3.0:1783441558.144512:0:5772:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91a85f83cc00/0xa2426164df2c811b lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.13@tcp remote: 0x633a354aa4df4f5e expref: 9 pid: 5787 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783441558.144526:0:5772:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff91a8429bdc00) 00010000:00010000:3.0:1783441558.144529:0:5772:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:3.0:1783441558.144532:0:5772:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91a85eb3c200/0xa2426164df2c83fa lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.13@tcp remote: 0x633a354aa4df5030 expref: 8 pid: 5785 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783441558.144548:0:5772:0:(ldlm_lock.c:2680:ldlm_export_cancel_locks()) Export ffff91a744384800, canceled 14 locks, left on hash table 0. 00010000:00010000:3.0:1783441558.144584:0:5772:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783441558.144587:0:5772:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783441558.144589:0:5772:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783441558.700934:0:5773:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1783441558.894724:0:3305:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff91a745a78700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3305:1870073693296256:0@lo:400:kworker.0 00000100:00100000:3.0:1783441558.894824:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783441558.894885:0:3305:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff91a745a79880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3305:1870073693296768:0@lo:400:kworker.0 00000100:00100000:3.0:1783441558.894932:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783441558.894967:0:3305:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1783441558.894974:0:3305:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff91a745a79f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3305:1870073693296384:0@lo:400:kworker.0 00000100:00100000:3.0:1783441558.895000:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783441558.895036:0:5786:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073693296256 00000100:00100000:3.0:1783441558.895044:0:5786:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073693296256 00000100:00100000:3.0:1783441558.895104:0:5786:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 186 00000100:00100000:3.0:1783441558.895113:0:5786:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a745a7a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3305:x1870073693296256:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1783441558.895172:0:5786:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a745a7a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3305:x1870073693296256:12345-0@lo:400:kworker.0 Request processed in 60us (348us total) trans 0 rc 0/0 00000100:00100000:3.0:1783441558.895179:0:5786:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 186 00000100:00100000:3.0:1783441558.895208:0:5786:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073693296384 00000100:00100000:3.0:1783441558.895211:0:5786:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073693296384 00000100:00100000:3.0:1783441558.895254:0:5786:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 187 00000100:00100000:3.0:1783441558.895260:0:5786:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a874dcc700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3305:x1870073693296384:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1783441558.895290:0:5786:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a874dcc700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3305:x1870073693296384:12345-0@lo:400:kworker.0 Request processed in 31us (290us total) trans 0 rc 0/0 00000100:00100000:3.0:1783441558.895296:0:5786:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 187 00000100:00100000:3.0:1783441558.895315:0:8557:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073693296768 00000100:00100000:3.0:1783441558.895318:0:8557:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073693296768 00000100:00100000:3.0:1783441558.895345:0:8557:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 110 00000100:00100000:3.0:1783441558.895352:0:8557:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a874dcdf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3305:x1870073693296768:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1783441558.895379:0:8557:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a874dcdf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3305:x1870073693296768:12345-0@lo:400:kworker.0 Request processed in 29us (447us total) trans 0 rc 0/0 00000100:00100000:3.0:1783441558.895385:0:8557:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 110 00000100:00080000:3.0:1783441558.895613:0:5781:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1783441558.895618:0:5781:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1783441558.895651:0:3305:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff91a745a79f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3305:1870073693296384:0@lo:400:kworker.0 00000100:00100000:3.0:1783441558.895661:0:3305:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff91a745a78700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3305:1870073693296256:0@lo:400:kworker.0 00000100:00100000:3.0:1783441558.895669:0:3305:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff91a745a79880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3305:1870073693296768:0@lo:400:kworker.0 00000100:00100000:1.0:1783441558.895779:0:3304:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff91a745a7aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:6c1ddb50-5795-40c6-a2b6-8f58add9da62:3304:1870073693296128:0@lo:400:kworker.0 00000100:00100000:1.0:1783441558.895818:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783441558.895854:0:3304:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff91a745a79180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3304:1870073693296640:0@lo:400:kworker.0 00000100:00100000:1.0:1783441558.895876:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783441558.895895:0:3304:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1783441558.895900:0:3304:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff91a745a7b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3304:1870073693296512:0@lo:400:kworker.0 00000100:00100000:1.0:1783441558.895919:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783441558.895941:0:5786:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073693296640 00000100:00100000:1.0:1783441558.895945:0:5786:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073693296640 00000100:00100000:1.0:1783441558.895975:0:5786:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 188 00000100:00100000:1.0:1783441558.895980:0:5786:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a745550a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3304:x1870073693296640:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1783441558.896014:0:5786:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a745550a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3304:x1870073693296640:12345-0@lo:400:kworker.0 Request processed in 34us (137us total) trans 0 rc 0/0 00000100:00100000:1.0:1783441558.896021:0:5786:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 188 00000100:00080000:1.0:1783441558.896036:0:5781:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1783441558.896051:0:3304:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff91a745a79180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3304:1870073693296640:0@lo:400:kworker.0 00000100:00100000:2.0:1783441558.896376:0:12319:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073693296512 00000100:00100000:2.0:1783441558.896381:0:12319:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073693296512 00000100:00100000:2.0:1783441558.896438:0:12319:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 111 00000100:00100000:2.0:1783441558.896447:0:12319:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a745552a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+5:3304:x1870073693296512:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1783441558.896493:0:12319:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a745552a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+5:3304:x1870073693296512:12345-0@lo:400:kworker.0 Request processed in 49us (572us total) trans 0 rc 0/0 00000100:00100000:2.0:1783441558.896499:0:12319:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 111 00000100:00100000:2.0:1783441558.896526:0:3304:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff91a745a7b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3304:1870073693296512:0@lo:400:kworker.0 00000100:00100000:3.0:1783441558.896761:0:5778:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073693296128 00000100:00100000:3.0:1783441558.896766:0:5778:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073693296128 00000100:00100000:3.0:1783441558.896799:0:5778:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 306 00000100:00100000:3.0:1783441558.896806:0:5778:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a848f35050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6c1ddb50-5795-40c6-a2b6-8f58add9da62+19:3304:x1870073693296128:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1783441558.896851:0:5778:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a848f35050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6c1ddb50-5795-40c6-a2b6-8f58add9da62+19:3304:x1870073693296128:12345-0@lo:400:kworker.0 Request processed in 45us (1031us total) trans 0 rc 0/0 00000100:00100000:3.0:1783441558.896857:0:5778:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 306 00000100:00100000:2.0:1783441558.897021:0:3304:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff91a745a7aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:6c1ddb50-5795-40c6-a2b6-8f58add9da62:3304:1870073693296128:0@lo:400:kworker.0 00000100:00080000:1.0:1783441558.897086:0:5781:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1783441559.405165:0:3306:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff91a877faed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3306:1870073693296896:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1783441559.405250:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783441559.405526:0:6584:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073693296896 00000100:00100000:2.0:1783441559.405534:0:6584:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073693296896 00000100:00100000:2.0:1783441559.405585:0:6584:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 82 00000100:00100000:2.0:1783441559.405595:0:6584:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a745551f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3306:x1870073693296896:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1783441559.405643:0:6584:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1783441559.405700:0:6584:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a745551f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3306:x1870073693296896:12345-0@lo:13:osp-pre-1-0.0 Request processed in 106us (450us total) trans 0 rc 0/0 00000100:00100000:2.0:1783441559.405717:0:6584:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 82 00000100:00100000:1.0:1783441559.405961:0:3306:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff91a877faed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3306:1870073693296896:0@lo:13:osp-pre-1-0.0 00010000:00010000:3.0:1783441559.725011:0:5772:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1783441560.429093:0:3304:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1783441560.429118:0:3304:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff91a745550700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3304:1870073693297024:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1783441560.429192:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783441560.429359:0:6584:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073693297024 00000100:00100000:1.0:1783441560.429368:0:6584:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073693297024 00000100:00100000:1.0:1783441560.429453:0:6584:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 83 00000100:00100000:1.0:1783441560.429463:0:6584:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a874dcdc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3304:x1870073693297024:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1783441560.429497:0:6584:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1783441560.429544:0:6584:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a874dcdc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3304:x1870073693297024:12345-0@lo:13:osp-pre-0-0.0 Request processed in 83us (352us total) trans 0 rc 0/0 00000100:00100000:1.0:1783441560.429550:0:6584:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 83 00000100:00080000:3.0:1783441560.429909:0:5781:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1783441560.429949:0:3304:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff91a745550700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3304:1870073693297024:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1783441560.437036:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.13@tcp (source: 12345-192.168.201.13@tcp) 00000100:00100000:3.0:1783441560.437086:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.13@tcp (source: 12345-192.168.201.13@tcp) 00000100:00100000:1.0:1783441560.437378:0:5779:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073673392128 00000100:00100000:1.0:1783441560.437388:0:5779:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073673392128 00000100:00100000:1.0:1783441560.437445:0:5779:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.13@tcp, seq: 307 00000100:00100000:1.0:1783441560.437455:0:5779:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a848f34c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:51c2a82e-e792-4f56-84e8-12cc033e9e70+10:2354:x1870073673392128:12345-192.168.201.13@tcp:400:kworker.0 00000100:00100000:1.0:1783441560.437538:0:5779:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a848f34c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:51c2a82e-e792-4f56-84e8-12cc033e9e70+10:2354:x1870073673392128:12345-192.168.201.13@tcp:400:kworker.0 Request processed in 83us (512us total) trans 0 rc 0/0 00000100:00100000:1.0:1783441560.437545:0:5779:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.13@tcp, seq: 307 00000100:00100000:2.0:1783441560.437936:0:5785:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073673392256 00000100:00100000:2.0:1783441560.437954:0:5785:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073673392256 00000100:00080000:3.0:1783441560.437993:0:5781:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1783441560.438002:0:5785:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.13@tcp, seq: 189 00000100:00100000:2.0:1783441560.438011:0:5785:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a874dcf100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d5aa2a25-c618-49e9-a833-85b3b4747e53+6:2354:x1870073673392256:12345-192.168.201.13@tcp:400:kworker.0 00000100:00100000:2.0:1783441560.438065:0:5785:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a874dcf100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d5aa2a25-c618-49e9-a833-85b3b4747e53+6:2354:x1870073673392256:12345-192.168.201.13@tcp:400:kworker.0 Request processed in 56us (978us total) trans 0 rc 0/0 00000100:00100000:2.0:1783441560.438071:0:5785:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.13@tcp, seq: 189 00000100:00100000:3.0:1783441560.675559:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.13@tcp (source: 12345-192.168.201.13@tcp) 00000100:00100000:3.0:1783441560.675602:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.13@tcp (source: 12345-192.168.201.13@tcp) 00000100:00100000:3.0:1783441560.675644:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.13@tcp (source: 12345-192.168.201.13@tcp) 00000100:00100000:0.0:1783441560.675775:0:11514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073673392384 00000100:00100000:0.0:1783441560.675785:0:11514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073673392384 00000100:00100000:0.0:1783441560.675842:0:11514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073673392640 00000100:00100000:0.0:1783441560.675845:0:11514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073673392640 00000100:00100000:0.0:1783441560.675865:0:11514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073673392512 00000100:00100000:0.0:1783441560.675868:0:11514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073673392512 00000100:00100000:0.0:1783441560.675884:0:11514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.13@tcp, seq: 20 00000100:00100000:0.0:1783441560.675893:0:11514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a874dcce00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:51c2a82e-e792-4f56-84e8-12cc033e9e70+12:2354:x1870073673392384:12345-192.168.201.13@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1783441560.675909:0:11514:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1783441560.675943:0:11514:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff91a85eb3c600/0xa2426164df2c7807 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x44801000000000 nid: 192.168.201.13@tcp remote: 0x633a354aa4df4cb0 expref: 12 pid: 5779 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783441560.675964:0:11514:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1783441560.676016:0:11514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a874dcce00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:51c2a82e-e792-4f56-84e8-12cc033e9e70+11:2354:x1870073673392384:12345-192.168.201.13@tcp:103:ldlm_bl.0 Request processed in 124us (466us total) trans 0 rc 0/0 00000100:00100000:0.0:1783441560.676023:0:11514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.13@tcp, seq: 20 00000100:00100000:0.0:1783441560.676039:0:11514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.13@tcp, seq: 21 00000100:00100000:0.0:1783441560.676046:0:11514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a874dce300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:51c2a82e-e792-4f56-84e8-12cc033e9e70+10:2354:x1870073673392640:12345-192.168.201.13@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1783441560.676055:0:11514:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1783441560.676064:0:11514:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff91a841477400/0xa2426164df2c79ce lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x44801000000000 nid: 192.168.201.13@tcp remote: 0x633a354aa4df4d5f expref: 10 pid: 5779 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783441560.676073:0:11514:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1783441560.676090:0:11514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a874dce300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:51c2a82e-e792-4f56-84e8-12cc033e9e70+9:2354:x1870073673392640:12345-192.168.201.13@tcp:103:ldlm_bl.0 Request processed in 44us (488us total) trans 0 rc 0/0 00000100:00100000:0.0:1783441560.676096:0:11514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.13@tcp, seq: 21 00000100:00100000:0.0:1783441560.676109:0:11514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.13@tcp, seq: 22 00000100:00100000:0.0:1783441560.676115:0:11514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a846f76450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:51c2a82e-e792-4f56-84e8-12cc033e9e70+8:2354:x1870073673392512:12345-192.168.201.13@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1783441560.676137:0:11514:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1783441560.676147:0:11514:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff91a85eb3dc00/0xa2426164df2c780e lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801000000000 nid: 192.168.201.13@tcp remote: 0x633a354aa4df4cda expref: 8 pid: 5779 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783441560.676156:0:11514:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1783441560.676174:0:11514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a846f76450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:51c2a82e-e792-4f56-84e8-12cc033e9e70+7:2354:x1870073673392512:12345-192.168.201.13@tcp:103:ldlm_bl.0 Request processed in 59us (529us total) trans 0 rc 0/0 00000100:00100000:0.0:1783441560.676181:0:11514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.13@tcp, seq: 22 00000100:00100000:0.0:1783441560.683291:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.13@tcp (source: 12345-192.168.201.13@tcp) 00000100:00100000:1.0:1783441560.683453:0:6605:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073673392896 00000100:00100000:1.0:1783441560.683463:0:6605:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073673392896 00000100:00100000:1.0:1783441560.683526:0:6605:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.13@tcp, seq: 241 00000100:00100000:1.0:1783441560.683536:0:6605:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a877faed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:d5aa2a25-c618-49e9-a833-85b3b4747e53+6:2351:x1870073673392896:12345-192.168.201.13@tcp:39:umount.0 00000020:00000080:1.0:1783441560.683580:0:6605:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xa2426164df2c781c 00000020:00010000:1.0:1783441560.683590:0:6605:0:(genops.c:1944:obd_stale_export_put()) Put export ffff91a8655b1000: total 0 00000100:00080000:1.0:1783441560.683603:0:6605:0:(import.c:65:import_set_state_nolock()) ffff91a8655b2800 : changing import state from FULL to CLOSED 00000001:00000004:1.0:1783441560.683632:0:6605:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 1, last_transno is 4294967527 00000100:00100000:1.0:1783441560.683882:0:6605:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a877faed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:d5aa2a25-c618-49e9-a833-85b3b4747e53+5:2351:x1870073673392896:12345-192.168.201.13@tcp:39:umount.0 Request processed in 347us (601us total) trans 4294967528 rc 0/0 00000100:00100000:1.0:1783441560.683890:0:6605:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.13@tcp, seq: 241 00000020:00010000:3.0:1783441560.684965:0:5773:0:(genops.c:1930:obd_stale_export_get()) Get export ffff91a8655b1000: total 0 00010000:00010000:3.0:1783441560.685012:0:5773:0:(ldlm_lock.c:2652:ldlm_export_cancel_blocked_locks()) Export ffff91a8655b1000, canceled 0 locks, left on hash table 1. 00010000:00010000:3.0:1783441560.685045:0:5773:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff91a8429bd400) 00010000:00010000:3.0:1783441560.685049:0:5773:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1783441560.685067:0:5773:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91a87da47200/0xa2426164df2c8749 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.13@tcp remote: 0x633a354aa4df5110 expref: 4 pid: 6605 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783441560.685089:0:5773:0:(ldlm_lock.c:2680:ldlm_export_cancel_locks()) Export ffff91a8655b1000, canceled 1 locks, left on hash table 0. 00010000:00010000:3.0:1783441560.685099:0:5773:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783441560.685101:0:5773:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783441560.685103:0:5773:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1783441560.723577:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.13@tcp (source: 12345-192.168.201.13@tcp) 00000100:00100000:1.0:1783441560.724113:0:5780:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073673393152 00000100:00100000:1.0:1783441560.724125:0:5780:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073673393152 00000100:00100000:1.0:1783441560.724425:0:5780:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.13@tcp, seq: 308 00000100:00100000:1.0:1783441560.724451:0:5780:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a8655e5450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:51c2a82e-e792-4f56-84e8-12cc033e9e70+7:2351:x1870073673393152:12345-192.168.201.13@tcp:251:umount.0 00000020:00000080:1.0:1783441560.724502:0:5780:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xa2426164df2c7712 00000020:00010000:1.0:1783441560.724510:0:5780:0:(genops.c:1944:obd_stale_export_put()) Put export ffff91a744383000: total 0 00000100:00080000:1.0:1783441560.724532:0:5780:0:(import.c:65:import_set_state_nolock()) ffff91a744385000 : changing import state from FULL to CLOSED 00000100:00100000:1.0:1783441560.724615:0:5780:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a8655e5450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:51c2a82e-e792-4f56-84e8-12cc033e9e70+3:2351:x1870073673393152:12345-192.168.201.13@tcp:251:umount.0 Request processed in 166us (1048us total) trans 0 rc 0/0 00000100:00100000:1.0:1783441560.724623:0:5780:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.13@tcp, seq: 308 00000020:00010000:3.0:1783441560.724695:0:5772:0:(genops.c:1930:obd_stale_export_get()) Get export ffff91a744383000: total 0 00010000:00010000:3.0:1783441560.724699:0:5772:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783441560.725554:0:5772:0:(ldlm_lock.c:2652:ldlm_export_cancel_blocked_locks()) Export ffff91a744383000, canceled 0 locks, left on hash table 1. 00010000:00010000:3.0:1783441560.725605:0:5772:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff91a85f83dc00/0xa2426164df2c77c8 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x44801000000000 nid: 192.168.201.13@tcp remote: 0x633a354aa4df4ca2 expref: 2 pid: 5780 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783441560.725639:0:5772:0:(ldlm_lock.c:2680:ldlm_export_cancel_locks()) Export ffff91a744383000, canceled 1 locks, left on hash table 0. 00000020:00000080:3.0:1783441560.725654:0:5772:0:(genops.c:906:class_export_put()) final put ffff91a744383000/51c2a82e-e792-4f56-84e8-12cc033e9e70 00010000:00010000:3.0:1783441560.725672:0:5772:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783441560.725674:0:5772:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783441560.725676:0:5772:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:3.0:1783441560.725690:0:33:0:(genops.c:865:class_export_destroy()) destroying export ffff91a744383000/51c2a82e-e792-4f56-84e8-12cc033e9e70 for MGS 00000020:00000080:3.0:1783441560.725735:0:33:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff91a744385000 for MGS 00010000:00010000:3.0:1783441560.748971:0:5773:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:2.0:1783441560.992164:0:6613:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of 65454767-383a-4679-a788-eba05c6e0989 00000020:00000080:2.0:1783441560.992172:0:6613:0:(genops.c:906:class_export_put()) final put ffff91a8433dc000/65454767-383a-4679-a788-eba05c6e0989 00000020:00000080:2.0:1783441560.992211:0:27:0:(genops.c:865:class_export_destroy()) destroying export ffff91a8433dc000/65454767-383a-4679-a788-eba05c6e0989 for lustre-OST0000 00000020:00000080:2.0:1783441560.992251:0:27:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff91a8433df000 for lustre-OST0000 00000001:00100000:1.0:1783441561.010937:0:5807:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of 65454767-383a-4679-a788-eba05c6e0989 00000001:00080000:1.0:1783441561.010954:0:5807:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967527 is committed 00000001:00100000:1.0:1783441561.010963:0:5807:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of d5aa2a25-c618-49e9-a833-85b3b4747e53 00000001:00080000:1.0:1783441561.010968:0:5807:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967528 is committed 00000020:00000080:1.0:1783441561.010971:0:5807:0:(genops.c:906:class_export_put()) final put ffff91a8655b1000/d5aa2a25-c618-49e9-a833-85b3b4747e53 00000020:00000080:1.0:1783441561.010990:0:5807:0:(genops.c:906:class_export_put()) final put ffff91a744384800/65454767-383a-4679-a788-eba05c6e0989 00000020:00000080:1.0:1783441561.011002:0:59:0:(genops.c:865:class_export_destroy()) destroying export ffff91a8655b1000/d5aa2a25-c618-49e9-a833-85b3b4747e53 for lustre-MDT0000 00000020:00000080:1.0:1783441561.011119:0:59:0:(genops.c:865:class_export_destroy()) destroying export ffff91a744384800/65454767-383a-4679-a788-eba05c6e0989 for lustre-MDT0000 00000020:00000080:1.0:1783441561.011167:0:59:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff91a8655b2800 for lustre-MDT0000 00000020:00000080:1.0:1783441561.011172:0:59:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff91a7450eb000 for lustre-MDT0000 00010000:00010000:3.0:1783441561.773890:0:5772:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:0.0:1783441562.558119:0:7492:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of 65454767-383a-4679-a788-eba05c6e0989 00000020:00000080:0.0:1783441562.558129:0:7492:0:(genops.c:906:class_export_put()) final put ffff91a8431d7000/65454767-383a-4679-a788-eba05c6e0989 00000020:00000080:0.0:1783441562.558155:0:53:0:(genops.c:865:class_export_destroy()) destroying export ffff91a8431d7000/65454767-383a-4679-a788-eba05c6e0989 for lustre-OST0001 00000020:00000080:0.0:1783441562.558206:0:53:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff91a8431d2000 for lustre-OST0001 00000020:01000004:3.0:1783441562.566010:0:12812:0:(tgt_mount.c:2193:server_umount_begin()) umount -f 00000020:01000004:3.0:1783441562.581868:0:12812:0:(tgt_mount.c:2063:server_put_super()) server put_super lustre-MDT0000 00010000:00010000:3.0:1783441562.581917:0:12812:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.113@tcp lock: ffff91a85eb3de00/0xa2426164df2c7797 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0xa2426164df2c779e expref: -99 pid: 5783 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783441562.581933:0:12812:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.113@tcp lock: ffff91a85eb3de00/0xa2426164df2c7797 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0xa2426164df2c779e expref: -99 pid: 5783 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783441562.581941:0:12812:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.113@tcp lock: ffff91a85eb3de00/0xa2426164df2c7797 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000400000000 nid: local remote: 0xa2426164df2c779e expref: -99 pid: 5783 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783441562.581948:0:12812:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.201.113@tcp lock: ffff91a85eb3de00/0xa2426164df2c7797 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000400000000 nid: local remote: 0xa2426164df2c779e expref: -99 pid: 5783 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783441562.581968:0:12812:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:3.0:1783441562.581973:0:12812:0:(mgc_request.c:547:config_log_end()) end config log lustre-client (0) 00000100:00080000:3.0:1783441562.581991:0:12812:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:3.0:1783441562.581995:0:12812:0:(client.c:3112:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0000: committing for last_committed 0 gen 3 00000100:00080000:3.0:1783441562.582001:0:12812:0:(pinger.c:399:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-lwp-MDT0000_UUID->lustre-MDT0000_UUID 00000100:00080000:3.0:1783441562.582023:0:12812:0:(import.c:65:import_set_state_nolock()) ffff91a881c7f000 lustre-MDT0000_UUID: changing import state from FULL to CONNECTING 00010000:00010000:1.0:1783441562.582870:0:5773:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1783441562.582878:0:5773:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.113@tcp lock: ffff91a85eb3de00/0xa2426164df2c7797 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000400000000 nid: local remote: 0xa2426164df2c779e expref: -99 pid: 5783 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783441562.582887:0:5773:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91a85eb3de00 already unused, calling callback (ffffffffc1b78c20) 10000000:00010000:1.0:1783441562.582892:0:5773:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.113@tcp lock: ffff91a85eb3de00/0xa2426164df2c7797 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000400000000 nid: local remote: 0xa2426164df2c779e expref: -99 pid: 5783 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783441562.582902:0:5773:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.113@tcp lock: ffff91a85eb3de00/0xa2426164df2c7797 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1008400000000 nid: local remote: 0xa2426164df2c779e expref: -99 pid: 5783 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1783441562.582922:0:5773:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.113@tcp lock: ffff91a85eb3de00/0xa2426164df2c7797 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1009400000000 nid: local remote: 0xa2426164df2c779e expref: -99 pid: 5783 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1783441562.582928:0:5773:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:1.0:1783441562.582930:0:5773:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-client: stopping, won't requeue 10000000:01000000:1.0:1783441562.582932:0:5773:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-client 00010000:00010000:1.0:1783441562.582961:0:5773:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.113@tcp lock: ffff91a85eb3de00/0xa2426164df2c7797 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5809400000020 nid: local remote: 0xa2426164df2c779e expref: -99 pid: 5783 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783441562.582968:0:5773:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00000100:00100000:3.0:1783441562.583025:0:3304:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff91a745551c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:6c1ddb50-5795-40c6-a2b6-8f58add9da62:3304:1870073693297280:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1783441562.583122:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1783441562.583261:0:5773:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.113@tcp lock: ffff91a85eb3de00/0xa2426164df2c7797 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5809400000020 nid: local remote: 0xa2426164df2c779e expref: -99 pid: 5783 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783441562.583269:0:5773:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.113@tcp lock: ffff91a85eb3de00/0xa2426164df2c7797 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5809400000020 nid: local remote: 0xa2426164df2c779e expref: -99 pid: 5783 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783441562.583282:0:5773:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783441562.583283:0:5773:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783441562.583285:0:5773:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1783441562.583298:0:3302:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff91a874dcf800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3302:1870073693297152:0@lo:39:umount.0 00000100:00100000:1.0:1783441562.583332:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783441562.583378:0:5785:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073693297152 00000100:00100000:1.0:1783441562.583387:0:5785:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073693297152 00000100:00100000:1.0:1783441562.583480:0:5785:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 242 00000100:00100000:1.0:1783441562.583493:0:5785:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a745553100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3302:x1870073693297152:12345-0@lo:39:umount.0 00000020:00000080:1.0:1783441562.583518:0:5785:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xa2426164df2c7521 00000100:00080000:1.0:1783441562.583525:0:5785:0:(import.c:65:import_set_state_nolock()) ffff91a8756ae800 : changing import state from FULL to CLOSED 00000100:00100000:1.0:1783441562.583585:0:5785:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a745553100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+1:3302:x1870073693297152:12345-0@lo:39:umount.0 Request processed in 94us (251us total) trans 0 rc 0/0 00000100:00100000:1.0:1783441562.583601:0:5785:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 242 00000020:00000080:1.0:1783441562.583612:0:5785:0:(genops.c:906:class_export_put()) final put ffff91a8756ab800/lustre-MDT0000-lwp-MDT0000_UUID 00010000:00010000:1.0:1783441562.583635:0:5772:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:1.0:1783441562.583645:0:59:0:(genops.c:865:class_export_destroy()) destroying export ffff91a8756ab800/lustre-MDT0000-lwp-MDT0000_UUID for lustre-MDT0000 00000020:00000080:1.0:1783441562.583687:0:59:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff91a8756ae800 for lustre-MDT0000 00000100:00080000:1.0:1783441562.583720:0:3302:0:(import.c:65:import_set_state_nolock()) ffff91a881c7f000 lustre-MDT0000_UUID: changing import state from CONNECTING to CLOSED 00000100:00100000:1.0:1783441562.583731:0:3302:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff91a874dcf800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3302:1870073693297152:0@lo:39:umount.0 00000100:00100000:0.0:1783441562.585718:0:11514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073693297280 00000100:00100000:0.0:1783441562.585732:0:11514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073693297280 00000100:00100000:0.0:1783441562.585813:0:11514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:0.0:1783441562.585822:0:11514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a874dcd500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:6c1ddb50-5795-40c6-a2b6-8f58add9da62+19:3304:x1870073693297280:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1783441562.585837:0:11514:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1783441562.585856:0:11514:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff91a87da46e00/0xa2426164df2c779e lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xa2426164df2c7797 expref: 19 pid: 5778 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783441562.585877:0:11514:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1783441562.588406:0:11514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a874dcd500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:6c1ddb50-5795-40c6-a2b6-8f58add9da62+18:3304:x1870073693297280:12345-0@lo:103:ldlm_bl.0 Request processed in 2574us (5273us total) trans 0 rc 0/0 00000100:00100000:0.0:1783441562.588422:0:11514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00100000:3.0:1783441562.588654:0:3304:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff91a745551c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:6c1ddb50-5795-40c6-a2b6-8f58add9da62:3304:1870073693297280:0@lo:103:ldlm_bl.0 00000100:00080000:3.0:1783441562.588686:0:12812:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:3.0:1783441562.588690:0:12812:0:(client.c:3112:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0000: committing for last_committed 0 gen 4 00000100:00100000:3.0:1783441562.588695:0:12812:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00010000:00010000:3.0:1783441562.589943:0:12812:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.113@tcp lock: ffff91a840030400/0xa2426164df2c77a5 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0xa2426164df2c77ac expref: -99 pid: 5783 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783441562.589958:0:12812:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.113@tcp lock: ffff91a840030400/0xa2426164df2c77a5 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0xa2426164df2c77ac expref: -99 pid: 5783 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783441562.589965:0:12812:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.113@tcp lock: ffff91a840030400/0xa2426164df2c77a5 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000400000000 nid: local remote: 0xa2426164df2c77ac expref: -99 pid: 5783 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783441562.589970:0:12812:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.201.113@tcp lock: ffff91a840030400/0xa2426164df2c77a5 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000400000000 nid: local remote: 0xa2426164df2c77ac expref: -99 pid: 5783 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783441562.590031:0:12812:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1783441562.590037:0:12812:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.113@tcp lock: ffff91a840031400/0xa2426164df2c76cc lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xa2426164df2c76d3 expref: -99 pid: 5783 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783441562.590043:0:12812:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.113@tcp lock: ffff91a840031400/0xa2426164df2c76cc lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xa2426164df2c76d3 expref: -99 pid: 5783 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783441562.590049:0:12812:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.113@tcp lock: ffff91a840031400/0xa2426164df2c76cc lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0xa2426164df2c76d3 expref: -99 pid: 5783 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783441562.590055:0:12812:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.201.113@tcp lock: ffff91a840031400/0xa2426164df2c76cc lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0xa2426164df2c76d3 expref: -99 pid: 5783 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783441562.590286:0:5773:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1783441562.590294:0:5773:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.113@tcp lock: ffff91a840030400/0xa2426164df2c77a5 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000400000000 nid: local remote: 0xa2426164df2c77ac expref: -99 pid: 5783 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783441562.590301:0:5773:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91a840030400 already unused, calling callback (ffffffffc1b78c20) 10000000:00010000:2.0:1783441562.590304:0:5773:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.113@tcp lock: ffff91a840030400/0xa2426164df2c77a5 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000400000000 nid: local remote: 0xa2426164df2c77ac expref: -99 pid: 5783 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783441562.590312:0:5773:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.113@tcp lock: ffff91a840030400/0xa2426164df2c77a5 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1008400000000 nid: local remote: 0xa2426164df2c77ac expref: -99 pid: 5783 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1783441562.590319:0:5773:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.113@tcp lock: ffff91a840030400/0xa2426164df2c77a5 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1009400000000 nid: local remote: 0xa2426164df2c77ac expref: -99 pid: 5783 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1783441562.590324:0:5773:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:2.0:1783441562.590326:0:5773:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-MDT0000: stopping, won't requeue 00010000:00010000:2.0:1783441562.593281:0:5773:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.113@tcp lock: ffff91a840030400/0xa2426164df2c77a5 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5809400000020 nid: local remote: 0xa2426164df2c77ac expref: -99 pid: 5783 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783441562.593319:0:5773:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1783441562.593356:0:5773:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.113@tcp lock: ffff91a840030400/0xa2426164df2c77a5 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5809400000020 nid: local remote: 0xa2426164df2c77ac expref: -99 pid: 5783 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783441562.593363:0:5773:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.113@tcp lock: ffff91a840030400/0xa2426164df2c77a5 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5809400000020 nid: local remote: 0xa2426164df2c77ac expref: -99 pid: 5783 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783441562.593377:0:5773:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1783441562.593382:0:5773:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.113@tcp lock: ffff91a840031400/0xa2426164df2c76cc lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0xa2426164df2c76d3 expref: -99 pid: 5783 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783441562.593388:0:5773:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91a840031400 already unused, calling callback (ffffffffc1b78c20) 10000000:00010000:2.0:1783441562.593392:0:5773:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.113@tcp lock: ffff91a840031400/0xa2426164df2c76cc lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0xa2426164df2c76d3 expref: -99 pid: 5783 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783441562.593401:0:5773:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.113@tcp lock: ffff91a840031400/0xa2426164df2c76cc lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1008400000000 nid: local remote: 0xa2426164df2c76d3 expref: -99 pid: 5783 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1783441562.593406:0:5773:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.113@tcp lock: ffff91a840031400/0xa2426164df2c76cc lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1009400000000 nid: local remote: 0xa2426164df2c76d3 expref: -99 pid: 5783 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1783441562.593412:0:5773:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 10000000:01000000:2.0:1783441562.593414:0:5773:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-mdtir: stopping, won't requeue 00010000:00010000:2.0:1783441562.593448:0:5773:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.113@tcp lock: ffff91a840031400/0xa2426164df2c76cc lrc: 3/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000020 nid: local remote: 0xa2426164df2c76d3 expref: -99 pid: 5783 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783441562.593453:0:5773:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1783441562.593459:0:5773:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.113@tcp lock: ffff91a840031400/0xa2426164df2c76cc lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000020 nid: local remote: 0xa2426164df2c76d3 expref: -99 pid: 5783 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783441562.593476:0:5773:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783441562.593477:0:5773:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783441562.593480:0:5773:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1783441562.593555:0:3306:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff91a859086680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:6c1ddb50-5795-40c6-a2b6-8f58add9da62:3306:1870073693297536:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1783441562.593627:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783441562.593682:0:3306:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1783441562.593689:0:3306:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff91a859084000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:6c1ddb50-5795-40c6-a2b6-8f58add9da62:3306:1870073693297408:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1783441562.593710:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783441562.593764:0:5771:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073693297536 00000100:00100000:1.0:1783441562.593771:0:5771:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073693297536 00000100:00100000:1.0:1783441562.593814:0:5771:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073693297408 00000100:00100000:1.0:1783441562.593817:0:5771:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073693297408 00000100:00100000:1.0:1783441562.593837:0:5771:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:1.0:1783441562.593845:0:5771:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a745550e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:6c1ddb50-5795-40c6-a2b6-8f58add9da62+19:3306:x1870073693297536:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1783441562.593857:0:5771:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1783441562.593872:0:5771:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff91a85eb3c800/0xa2426164df2c76d3 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xa2426164df2c76cc expref: 19 pid: 5780 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783441562.593890:0:5771:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1783441562.593925:0:5771:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a745550e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:6c1ddb50-5795-40c6-a2b6-8f58add9da62+18:3306:x1870073693297536:12345-0@lo:103:ldlm_bl.0 Request processed in 80us (297us total) trans 0 rc 0/0 00000100:00100000:1.0:1783441562.593932:0:5771:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00100000:1.0:1783441562.593958:0:5771:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:1.0:1783441562.593964:0:5771:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a745552300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:6c1ddb50-5795-40c6-a2b6-8f58add9da62+17:3306:x1870073693297408:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1783441562.593972:0:5771:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1783441562.593980:0:5771:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff91a85eb3c000/0xa2426164df2c77ac lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xa2426164df2c77a5 expref: 17 pid: 5780 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783441562.593989:0:5771:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1783441562.594011:0:5771:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a745552300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:6c1ddb50-5795-40c6-a2b6-8f58add9da62+16:3306:x1870073693297408:12345-0@lo:103:ldlm_bl.0 Request processed in 47us (299us total) trans 0 rc 0/0 00000100:00100000:1.0:1783441562.594017:0:5771:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:1.0:1783441562.594056:0:3306:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff91a859084000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:6c1ddb50-5795-40c6-a2b6-8f58add9da62:3306:1870073693297408:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1783441562.594064:0:3306:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff91a859086680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:6c1ddb50-5795-40c6-a2b6-8f58add9da62:3306:1870073693297536:0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1783441562.594834:0:12812:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:3.0:1783441562.594844:0:12812:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.113@tcp lock: ffff91a840031400/0xa2426164df2c76cc lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000020 nid: local remote: 0xa2426164df2c76d3 expref: -99 pid: 5783 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1783441562.594862:0:12812:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-mdtir 00010000:00010000:3.0:1783441562.594872:0:12812:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.113@tcp lock: ffff91a841477600/0xa2426164df2c79c0 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xa2426164df2c79c7 expref: -99 pid: 5783 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783441562.594879:0:12812:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.113@tcp lock: ffff91a841477600/0xa2426164df2c79c0 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0xa2426164df2c79c7 expref: -99 pid: 5783 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783441562.594886:0:12812:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.113@tcp lock: ffff91a841477600/0xa2426164df2c79c0 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000400000000 nid: local remote: 0xa2426164df2c79c7 expref: -99 pid: 5783 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783441562.594893:0:12812:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.201.113@tcp lock: ffff91a841477600/0xa2426164df2c79c0 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000400000000 nid: local remote: 0xa2426164df2c79c7 expref: -99 pid: 5783 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783441562.594908:0:12812:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1783441562.594914:0:12812:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.113@tcp lock: ffff91a840030e00/0xa2426164df2c7480 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xa2426164df2c7487 expref: -99 pid: 5765 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783441562.594920:0:12812:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.113@tcp lock: ffff91a840030e00/0xa2426164df2c7480 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xa2426164df2c7487 expref: -99 pid: 5765 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783441562.594925:0:12812:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.113@tcp lock: ffff91a840030e00/0xa2426164df2c7480 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0xa2426164df2c7487 expref: -99 pid: 5765 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783441562.594931:0:12812:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.201.113@tcp lock: ffff91a840030e00/0xa2426164df2c7480 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0xa2426164df2c7487 expref: -99 pid: 5765 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783441562.594951:0:12812:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 10000000:01000000:3.0:1783441562.594954:0:12812:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-MDT0000 10000000:01000000:3.0:1783441562.594958:0:12812:0:(mgc_request.c:547:config_log_end()) end config log lustre-MDT0000 (0) 00000020:01000004:3.0:1783441562.594984:0:12812:0:(tgt_mount.c:2113:server_put_super()) stopping lustre-MDT0000 00000020:01000000:3.0:1783441562.594988:0:12812:0:(obd_config.c:2475:class_manual_cleanup()) Manual cleanup of lustre-MDT0000 (flags='F') 00000020:00000080:3.0:1783441562.594992:0:12812:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:3.0:1783441562.594999:0:12812:0:(obd_config.c:955:class_cleanup()) lustre-MDT0000: forcing exports to disconnect: 2/5 00000020:00080000:3.0:1783441562.595004:0:12812:0:(genops.c:1840:print_export_data()) lustre-MDT0000: ACTIVE ffff91a745261000 lustre-MDT0000-lwp-OST0001_UUID 0@lo 4 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:3.0:1783441562.595010:0:12812:0:(genops.c:1840:print_export_data()) lustre-MDT0000: ACTIVE ffff91a744228800 lustre-MDT0000-lwp-OST0000_UUID 0@lo 4 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:3.0:1783441562.595015:0:12812:0:(genops.c:1574:class_disconnect_exports()) OBD device 5 (ffff91a8756bcd40) has exports, disconnecting them 00000020:00080000:3.0:1783441562.595019:0:12812:0:(genops.c:1549:class_disconnect_export_list()) lustre-MDT0000: disconnecting export at 0@lo (ffff91a745261000), last request at 1783441558 00000020:00000080:3.0:1783441562.595026:0:12812:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xa2426164df2c7694 00000100:00080000:3.0:1783441562.595043:0:12812:0:(import.c:65:import_set_state_nolock()) ffff91a745264800 : changing import state from FULL to CLOSED 00000020:00080000:3.0:1783441562.595085:0:12812:0:(genops.c:1554:class_disconnect_export_list()) disconnected export at 0@lo (ffff91a745261000): rc 0 00000020:00000080:3.0:1783441562.595087:0:12812:0:(genops.c:906:class_export_put()) final put ffff91a745261000/lustre-MDT0000-lwp-OST0001_UUID 00000020:00080000:3.0:1783441562.595094:0:12812:0:(genops.c:1549:class_disconnect_export_list()) lustre-MDT0000: disconnecting export at 0@lo (ffff91a744228800), last request at 1783441558 00000020:00000080:3.0:1783441562.595097:0:12812:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xa2426164df2c75bb 00010000:00010000:2.0:1783441562.596254:0:5773:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1783441562.596263:0:5773:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.113@tcp lock: ffff91a841477600/0xa2426164df2c79c0 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000400000000 nid: local remote: 0xa2426164df2c79c7 expref: -99 pid: 5783 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783441562.596274:0:5773:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91a841477600 already unused, calling callback (ffffffffc1b78c20) 10000000:00010000:2.0:1783441562.596278:0:5773:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.113@tcp lock: ffff91a841477600/0xa2426164df2c79c0 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000400000000 nid: local remote: 0xa2426164df2c79c7 expref: -99 pid: 5783 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783441562.596288:0:5773:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.113@tcp lock: ffff91a841477600/0xa2426164df2c79c0 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1008400000000 nid: local remote: 0xa2426164df2c79c7 expref: -99 pid: 5783 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1783441562.596296:0:5773:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.113@tcp lock: ffff91a841477600/0xa2426164df2c79c0 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1009400000000 nid: local remote: 0xa2426164df2c79c7 expref: -99 pid: 5783 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1783441562.596302:0:5773:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 10000000:01000000:2.0:1783441562.596305:0:5773:0:(mgc_request.c:944:mgc_blocking_ast()) log params: stopping, won't requeue 10000000:01000000:2.0:1783441562.596308:0:5773:0:(mgc_request.c:130:config_log_put()) dropping config log params 00010000:00010000:2.0:1783441562.596343:0:5773:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.113@tcp lock: ffff91a841477600/0xa2426164df2c79c0 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000020 nid: local remote: 0xa2426164df2c79c7 expref: -99 pid: 5783 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783441562.596349:0:5773:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1783441562.596374:0:5773:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.113@tcp lock: ffff91a841477600/0xa2426164df2c79c0 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000020 nid: local remote: 0xa2426164df2c79c7 expref: -99 pid: 5783 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783441562.596382:0:5773:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.113@tcp lock: ffff91a841477600/0xa2426164df2c79c0 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000020 nid: local remote: 0xa2426164df2c79c7 expref: -99 pid: 5783 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783441562.596411:0:5773:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1783441562.596415:0:5773:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.113@tcp lock: ffff91a840030e00/0xa2426164df2c7480 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0xa2426164df2c7487 expref: -99 pid: 5765 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783441562.596421:0:5773:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91a840030e00 already unused, calling callback (ffffffffc1b78c20) 10000000:00010000:2.0:1783441562.596425:0:5773:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.113@tcp lock: ffff91a840030e00/0xa2426164df2c7480 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0xa2426164df2c7487 expref: -99 pid: 5765 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783441562.596432:0:5773:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.113@tcp lock: ffff91a840030e00/0xa2426164df2c7480 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1008400000000 nid: local remote: 0xa2426164df2c7487 expref: -99 pid: 5765 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1783441562.596439:0:5773:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.113@tcp lock: ffff91a840030e00/0xa2426164df2c7480 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1009400000000 nid: local remote: 0xa2426164df2c7487 expref: -99 pid: 5765 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1783441562.596444:0:5773:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x5:0x0].0x0 (lustre) 10000000:01000000:2.0:1783441562.596446:0:5773:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-barrier: stopping, won't requeue 10000000:01000000:2.0:1783441562.596448:0:5773:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-barrier 00010000:00010000:2.0:1783441562.596461:0:5773:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.113@tcp lock: ffff91a840030e00/0xa2426164df2c7480 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000020 nid: local remote: 0xa2426164df2c7487 expref: -99 pid: 5765 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783441562.596468:0:5773:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1783441562.596475:0:5773:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.113@tcp lock: ffff91a840030e00/0xa2426164df2c7480 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000020 nid: local remote: 0xa2426164df2c7487 expref: -99 pid: 5765 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783441562.596482:0:5773:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.113@tcp lock: ffff91a840030e00/0xa2426164df2c7480 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000020 nid: local remote: 0xa2426164df2c7487 expref: -99 pid: 5765 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783441562.596493:0:5773:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783441562.596494:0:5773:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783441562.596502:0:5773:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1783441562.596519:0:3304:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff91a859086680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:6c1ddb50-5795-40c6-a2b6-8f58add9da62:3304:1870073693297792:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1783441562.596575:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783441562.596617:0:3304:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1783441562.596623:0:3304:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff91a859085880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:6c1ddb50-5795-40c6-a2b6-8f58add9da62:3304:1870073693297664:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1783441562.596642:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1783441562.598225:0:5772:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1783441562.598250:0:5771:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073693297792 00000100:00100000:1.0:1783441562.598260:0:5771:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073693297792 00000100:00100000:1.0:1783441562.598326:0:5771:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073693297664 00000100:00100000:1.0:1783441562.598329:0:5771:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073693297664 00000100:00100000:1.0:1783441562.598352:0:5771:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:1.0:1783441562.598360:0:5771:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a859084000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:6c1ddb50-5795-40c6-a2b6-8f58add9da62+17:3304:x1870073693297792:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1783441562.598374:0:5771:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1783441562.598389:0:5771:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff91a85eb3d800/0xa2426164df2c7487 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xa2426164df2c7480 expref: 17 pid: 5779 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783441562.598408:0:5771:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1783441562.598464:0:5771:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a859084000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:6c1ddb50-5795-40c6-a2b6-8f58add9da62+16:3304:x1870073693297792:12345-0@lo:103:ldlm_bl.0 Request processed in 104us (1889us total) trans 0 rc 0/0 00000100:00100000:1.0:1783441562.598470:0:5771:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:1.0:1783441562.598502:0:5771:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:1.0:1783441562.598507:0:5771:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a859087480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:6c1ddb50-5795-40c6-a2b6-8f58add9da62+15:3304:x1870073693297664:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1783441562.598516:0:5771:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1783441562.598524:0:5771:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff91a85fe59400/0xa2426164df2c79c7 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xa2426164df2c79c0 expref: 15 pid: 5778 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783441562.598533:0:5771:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1783441562.598555:0:5771:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a859087480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:6c1ddb50-5795-40c6-a2b6-8f58add9da62+14:3304:x1870073693297664:12345-0@lo:103:ldlm_bl.0 Request processed in 48us (1912us total) trans 0 rc 0/0 00000100:00100000:1.0:1783441562.598560:0:5771:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:1.0:1783441562.598599:0:3304:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff91a859085880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:6c1ddb50-5795-40c6-a2b6-8f58add9da62:3304:1870073693297664:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1783441562.598608:0:3304:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff91a859086680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:6c1ddb50-5795-40c6-a2b6-8f58add9da62:3304:1870073693297792:0@lo:103:ldlm_bl.0 00000100:00080000:3.0:1783441562.598998:0:12812:0:(import.c:65:import_set_state_nolock()) ffff91a74422f000 : changing import state from FULL to CLOSED 00000020:00000080:3.0:1783441562.599040:0:33:0:(genops.c:865:class_export_destroy()) destroying export ffff91a745261000/lustre-MDT0000-lwp-OST0001_UUID for lustre-MDT0000 00000020:00000080:3.0:1783441562.599082:0:33:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff91a745264800 for lustre-MDT0000 00010000:00010000:2.0:1783441562.599222:0:5773:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00080000:3.0:1783441562.599248:0:12812:0:(genops.c:1554:class_disconnect_export_list()) disconnected export at 0@lo (ffff91a744228800): rc 0 00000020:00000080:3.0:1783441562.599252:0:12812:0:(genops.c:906:class_export_put()) final put ffff91a744228800/lustre-MDT0000-lwp-OST0000_UUID 00000004:00000080:3.0:1783441562.599263:0:12812:0:(mdd_device.c:2302:mdd_iocontrol()) lustre-MDD0000: cmd=400866e7 len=0 karg=ffffaa8583ce7ae0 00000020:00000080:3.0:1783441562.599274:0:33:0:(genops.c:865:class_export_destroy()) destroying export ffff91a744228800/lustre-MDT0000-lwp-OST0000_UUID for lustre-MDT0000 00000020:00000080:3.0:1783441562.599298:0:33:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff91a74422f000 for lustre-MDT0000 00000100:00080000:3.0:1783441562.599318:0:12812:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0000_UUID INVALID 00000100:00100000:3.0:1783441562.599323:0:12812:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967324 gen 3 00000004:00080000:3.0:1783441562.599349:0:12812:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00080000:3.0:1783441562.599418:0:12812:0:(pinger.c:399:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID 00000100:00080000:3.0:1783441562.599437:0:12812:0:(import.c:65:import_set_state_nolock()) ffff91a7466c7800 lustre-OST0000_UUID: changing import state from FULL to CONNECTING 00000100:00080000:3.0:1783441562.599459:0:12812:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0001_UUID INVALID 00000100:00100000:3.0:1783441562.599461:0:12812:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967310 gen 3 00000004:00080000:3.0:1783441562.599471:0:12812:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00080000:3.0:1783441562.599528:0:12812:0:(pinger.c:399:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID 00000100:00080000:3.0:1783441562.599537:0:12812:0:(import.c:65:import_set_state_nolock()) ffff91a8748ed000 lustre-OST0001_UUID: changing import state from FULL to CONNECTING 00000020:00080000:3.0:1783441562.599565:0:12812:0:(genops.c:1579:class_disconnect_exports()) OBD device 5 (ffff91a8756bcd40) has no exports 00000100:00100000:2.0:1783441562.599684:0:3302:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff91a874dcc000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3302:1870073693297920:0@lo:9:umount.0 00000100:00100000:2.0:1783441562.599726:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783441562.599777:0:3302:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff91a874dcc380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3302:1870073693298048:0@lo:9:umount.0 00000100:00100000:2.0:1783441562.599798:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783441562.599829:0:8557:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073693297920 00000100:00100000:2.0:1783441562.599834:0:8557:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073693297920 00000100:00100000:2.0:1783441562.599872:0:8557:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073693298048 00000100:00100000:2.0:1783441562.599876:0:8557:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073693298048 00000100:00100000:2.0:1783441562.599896:0:8557:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 75 00000100:00100000:2.0:1783441562.599904:0:8557:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a859086680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3302:x1870073693297920:12345-0@lo:9:umount.0 00000020:00000080:2.0:1783441562.599926:0:8557:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xa2426164df2c7624 00000100:00080000:2.0:1783441562.599932:0:8557:0:(import.c:65:import_set_state_nolock()) ffff91a74422e800 : changing import state from FULL to CLOSED 00000001:00000004:2.0:1783441562.599963:0:8557:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 4294967324 00000100:00100000:2.0:1783441562.600316:0:8557:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a859086680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+2:3302:x1870073693297920:12345-0@lo:9:umount.0 Request processed in 412us (588us total) trans 0 rc 0/0 00000100:00100000:2.0:1783441562.600324:0:8557:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 75 00000100:00100000:2.0:1783441562.600342:0:8557:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 76 00000100:00100000:2.0:1783441562.600349:0:8557:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a859085880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3302:x1870073693298048:12345-0@lo:9:umount.0 00000020:00000080:2.0:1783441562.600362:0:8557:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xa2426164df2c76fd 00000100:00080000:2.0:1783441562.600367:0:8557:0:(import.c:65:import_set_state_nolock()) ffff91a8748ed800 : changing import state from FULL to CLOSED 00000001:00000004:2.0:1783441562.600397:0:8557:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 4294967310 00000100:00100000:2.0:1783441562.600583:0:8557:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a859085880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+2:3302:x1870073693298048:12345-0@lo:9:umount.0 Request processed in 234us (782us total) trans 0 rc 0/0 00000100:00100000:2.0:1783441562.600590:0:8557:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 76 00000100:00080000:2.0:1783441562.600608:0:5781:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1783441562.600611:0:5781:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1783441562.600639:0:3302:0:(import.c:65:import_set_state_nolock()) ffff91a7466c7800 lustre-OST0000_UUID: changing import state from CONNECTING to CLOSED 00000004:00080000:2.0:1783441562.600645:0:3302:0:(osp_dev.c:1618:osp_import_event()) got disconnected 00000004:00080000:2.0:1783441562.600646:0:3302:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:2.0:1783441562.600650:0:3302:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff91a874dcc000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3302:1870073693297920:0@lo:9:umount.0 00000100:00080000:2.0:1783441562.600659:0:3302:0:(import.c:65:import_set_state_nolock()) ffff91a8748ed000 lustre-OST0001_UUID: changing import state from CONNECTING to CLOSED 00000004:00080000:2.0:1783441562.600662:0:3302:0:(osp_dev.c:1618:osp_import_event()) got disconnected 00000004:00080000:2.0:1783441562.600664:0:3302:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:2.0:1783441562.600666:0:3302:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff91a874dcc380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3302:1870073693298048:0@lo:9:umount.0 00010000:00010000:2.0:1783441562.600685:0:5773:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783441562.601025:0:5772:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00080000:3.0:1783441562.610538:0:12812:0:(genops.c:1579:class_disconnect_exports()) OBD device 5 (ffff91a8756bcd40) has no exports 00000020:00000080:3.0:1783441562.720409:0:12812:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xa2426164df2c74db 00000020:00000080:3.0:1783441562.720425:0:12812:0:(genops.c:906:class_export_put()) final put ffff91a875640000/lustre-QMT0000_UUID 00000020:01000000:3.0:1783441562.720435:0:12812:0:(obd_config.c:2475:class_manual_cleanup()) Manual cleanup of lustre-QMT0000 (flags='') 00000020:00000080:3.0:1783441562.720503:0:33:0:(genops.c:865:class_export_destroy()) destroying export ffff91a875640000/lustre-QMT0000_UUID for lustre-QMT0000 00000020:00000080:2.0:1783441562.722276:0:12812:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1783441562.722290:0:12812:0:(obd_config.c:955:class_cleanup()) lustre-QMT0000: forcing exports to disconnect: 0/1 00000020:00080000:2.0:1783441562.722294:0:12812:0:(genops.c:1579:class_disconnect_exports()) OBD device 7 (ffff91a851573380) has no exports 00000020:00000080:2.0:1783441562.722945:0:12812:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xa2426164df2c74d4 00000020:00000080:2.0:1783441562.722955:0:12812:0:(genops.c:906:class_export_put()) final put ffff91a875588800/lustre-MDT0000-osd_UUID 00000020:00000080:2.0:1783441562.722975:0:27:0:(genops.c:865:class_export_destroy()) destroying export ffff91a875588800/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00000080:2.0:1783441562.723023:0:12812:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1783441562.723032:0:12812:0:(obd_config.c:883:class_detach()) detach on obd lustre-QMT0000 (uuid lustre-QMT0000_UUID) 00000020:00000080:2.0:1783441562.723035:0:12812:0:(genops.c:906:class_export_put()) final put ffff91a87558c800/lustre-QMT0000_UUID 00000020:00000080:2.0:1783441562.723037:0:12812:0:(genops.c:865:class_export_destroy()) destroying export ffff91a87558c800/lustre-QMT0000_UUID for lustre-QMT0000 00000020:01000000:2.0:1783441562.723043:0:12812:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-QMT0000 (lustre-QMT0000_UUID) 00000020:01000000:2.0:1783441562.723184:0:12812:0:(lprocfs_status_server.c:306:lprocfs_free_client_stats()) stat ffff91a8748b2cc0 - data ffff91a8627e00d8/ffff91a87537fc00 00000020:01000000:2.0:1783441562.723314:0:12812:0:(lprocfs_status_server.c:306:lprocfs_free_client_stats()) stat ffff91a859071600 - data ffff91a86246f1b0/ffff91a875a55000 00000001:00000004:0.0:1783441562.745421:0:12812:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 1, last_transno is 4294967528 00010000:00010000:2.0:1783441562.802456:0:5773:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:2.0:1783441562.859491:0:12812:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0000_UUID INVALID 00000100:00100000:2.0:1783441562.859518:0:12812:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967324 gen 4 00000004:00080000:2.0:1783441562.859608:0:12812:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:2.0:1783441562.859612:0:12812:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000004:00080000:1.0:1783441562.866353:0:6610:0:(osp_sync.c:1324:osp_sync_process_queues()) stop llog processing 00000040:00080000:1.0:1783441562.866361:0:6610:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x3:0x0] index 8 count 1 00000040:00080000:1.0:1783441562.866377:0:6610:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x1:0x2:0x0] index 1 count 2 00000100:00080000:2.0:1783441562.867413:0:12812:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0001_UUID INVALID 00000100:00100000:2.0:1783441562.867420:0:12812:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967310 gen 4 00000004:00080000:2.0:1783441562.867430:0:12812:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:2.0:1783441562.867432:0:12812:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000004:00080000:1.0:1783441562.868944:0:7786:0:(osp_sync.c:1324:osp_sync_process_queues()) stop llog processing 00000040:00080000:1.0:1783441562.868951:0:7786:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x6:0x0] index 5 count 1 00000040:00080000:1.0:1783441562.868962:0:7786:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x1:0x5:0x0] index 1 count 2 00000020:00000080:2.0:1783441562.937381:0:12812:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xa2426164df2c74a3 00000020:00000080:2.0:1783441562.937397:0:12812:0:(genops.c:906:class_export_put()) final put ffff91a8756aa000/lustre-MDT0000-osd_UUID 00000020:00000080:2.0:1783441562.939320:0:12812:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xa2426164df2c74b8 00000020:00000080:2.0:1783441562.939332:0:12812:0:(genops.c:906:class_export_put()) final put ffff91a8756d1000/lustre-MDT0000-mdtlov_UUID 00000020:01000000:2.0:1783441562.939341:0:12812:0:(obd_config.c:2475:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-mdtlov (flags='') 00000020:00000080:2.0:1783441562.939347:0:12812:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1783441562.939356:0:12812:0:(obd_config.c:955:class_cleanup()) lustre-MDT0000-mdtlov: forcing exports to disconnect: 0/2 00000020:00080000:2.0:1783441562.939360:0:12812:0:(genops.c:1579:class_disconnect_exports()) OBD device 4 (ffff91a8756b8000) has no exports 00000004:01000000:2.0:1783441562.939531:0:12812:0:(lod_lov.c:59:lod_putref()) destroying 2 ltd desc 00000020:00000080:2.0:1783441562.939540:0:12812:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xa2426164df2c76f6 00000020:00000080:2.0:1783441562.939544:0:12812:0:(genops.c:906:class_export_put()) final put ffff91a8655b1800/lustre-MDT0000-mdtlov_UUID 00000020:01000000:2.0:1783441562.939548:0:12812:0:(obd_config.c:2475:class_manual_cleanup()) Manual cleanup of lustre-OST0001-osc-MDT0000 (flags='') 00000020:00000080:2.0:1783441562.939552:0:12812:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1783441562.939558:0:12812:0:(obd_config.c:955:class_cleanup()) lustre-OST0001-osc-MDT0000: forcing exports to disconnect: 0/3 00000020:00080000:2.0:1783441562.939560:0:12812:0:(genops.c:1579:class_disconnect_exports()) OBD device 17 (ffff91a74438b380) has no exports 00000020:00000080:2.0:1783441562.939566:0:12812:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xa2426164df2c76ef 00000020:00000080:2.0:1783441562.939569:0:12812:0:(genops.c:906:class_export_put()) final put ffff91a8748ef000/lustre-MDT0000-osd_UUID 00010000:01000000:2.0:1783441562.941064:0:12812:0:(obd_class.h:671:obd_cleanup_client_import()) lustre-OST0001-osc-MDT0000: client import never connected 00000100:00080000:2.0:1783441562.941071:0:12812:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0001_UUID INVALID 00000100:00100000:2.0:1783441562.941076:0:12812:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967310 gen 5 00000004:00080000:2.0:1783441562.941083:0:12812:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:2.0:1783441562.941085:0:12812:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:2.0:1783441562.941191:0:12812:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1783441562.941201:0:12812:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0001-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:2.0:1783441562.941209:0:12812:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xa2426164df2c7601 00000020:00000080:2.0:1783441562.941216:0:12812:0:(genops.c:906:class_export_put()) final put ffff91a8492bf800/lustre-MDT0000-mdtlov_UUID 00000020:01000000:2.0:1783441562.941234:0:12812:0:(obd_config.c:2475:class_manual_cleanup()) Manual cleanup of lustre-OST0000-osc-MDT0000 (flags='') 00000020:00000080:2.0:1783441562.941238:0:12812:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1783441562.941243:0:12812:0:(obd_config.c:955:class_cleanup()) lustre-OST0000-osc-MDT0000: forcing exports to disconnect: 0/3 00000020:00080000:2.0:1783441562.941246:0:12812:0:(genops.c:1579:class_disconnect_exports()) OBD device 13 (ffff91a850218000) has no exports 00000020:00000080:2.0:1783441562.941252:0:12812:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xa2426164df2c75fa 00000020:00000080:2.0:1783441562.941256:0:12812:0:(genops.c:906:class_export_put()) final put ffff91a7466c1800/lustre-MDT0000-osd_UUID 00010000:01000000:2.0:1783441562.941600:0:12812:0:(obd_class.h:671:obd_cleanup_client_import()) lustre-OST0000-osc-MDT0000: client import never connected 00000100:00080000:2.0:1783441562.941604:0:12812:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0000_UUID INVALID 00000100:00100000:2.0:1783441562.941606:0:12812:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967324 gen 5 00000004:00080000:2.0:1783441562.941609:0:12812:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:2.0:1783441562.941611:0:12812:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:2.0:1783441562.941637:0:12812:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1783441562.941641:0:12812:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0000-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:2.0:1783441562.941673:0:12812:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1783441562.941676:0:12812:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-mdtlov (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:2.0:1783441562.941703:0:12812:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xa2426164df2c74bf 00000020:00000080:2.0:1783441562.941708:0:12812:0:(genops.c:906:class_export_put()) final put ffff91a8756d4800/lustre-MDD0000_UUID 00000020:01000000:2.0:1783441562.941712:0:12812:0:(obd_config.c:2475:class_manual_cleanup()) Manual cleanup of lustre-MDD0000 (flags='') 00000020:00000080:2.0:1783441562.941716:0:12812:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1783441562.941719:0:12812:0:(obd_config.c:955:class_cleanup()) lustre-MDD0000: forcing exports to disconnect: 0/2 00000020:00080000:2.0:1783441562.941721:0:12812:0:(genops.c:1579:class_disconnect_exports()) OBD device 6 (ffff91a8756b99c0) has no exports 00000020:00000080:2.0:1783441562.945706:0:12812:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1783441562.945724:0:12812:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDD0000 (uuid lustre-MDD0000_UUID) 00000020:00000080:2.0:1783441562.945734:0:12812:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xa2426164df2c74c6 00000020:00000080:2.0:1783441562.945826:0:12812:0:(genops.c:906:class_export_put()) final put ffff91a8756d5000/lustre-MDT0000-osd_UUID 00000020:01000004:2.0:1783441562.945842:0:12812:0:(tgt_mount.c:187:server_put_mount()) put mount ffff91a84869e800 from lustre-MDT0000, refs=3 00000020:01000004:2.0:1783441562.945845:0:12812:0:(obd_mount.c:710:lustre_put_lsi()) put ffff91a84869e800 3 00000020:01000004:2.0:1783441562.945848:0:12812:0:(tgt_mount.c:120:server_deregister_mount()) deregister mount ffff91a84869e800 from lustre-MDT0000 00000020:00000080:2.0:1783441562.945876:0:12812:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1783441562.945881:0:12812:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000 (uuid lustre-MDT0000_UUID) 00000020:00000080:2.0:1783441562.945883:0:12812:0:(genops.c:906:class_export_put()) final put ffff91a8756af000/lustre-MDT0000_UUID 00000020:00000080:2.0:1783441562.945886:0:12812:0:(genops.c:865:class_export_destroy()) destroying export ffff91a8756af000/lustre-MDT0000_UUID for lustre-MDT0000 00000020:01000000:2.0:1783441562.945899:0:12812:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000 (lustre-MDT0000_UUID) 00000020:01000004:2.0:1783441562.945985:0:12812:0:(obd_mount.c:578:lustre_stop_mgc()) MGC still has 2 references. 00000020:01000004:2.0:1783441562.945989:0:12812:0:(tgt_mount.c:255:server_stop_mgs()) Stop MGS service MGS 00000020:01000000:2.0:1783441562.945993:0:12812:0:(obd_config.c:2475:class_manual_cleanup()) Manual cleanup of MGS (flags='F') 00000020:00000080:2.0:1783441562.945997:0:12812:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1783441562.946001:0:12812:0:(obd_config.c:955:class_cleanup()) MGS: forcing exports to disconnect: 1/3 00000020:00080000:2.0:1783441562.946008:0:12812:0:(genops.c:1840:print_export_data()) MGS: ACTIVE ffff91a848690800 6c1ddb50-5795-40c6-a2b6-8f58add9da62 0@lo 13 (0 0 8) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:2.0:1783441562.946013:0:12812:0:(genops.c:1574:class_disconnect_exports()) OBD device 1 (ffff91a847678000) has exports, disconnecting them 00000020:00080000:2.0:1783441562.946018:0:12812:0:(genops.c:1549:class_disconnect_export_list()) MGS: disconnecting export at 0@lo (ffff91a848690800), last request at 1783441322 00000020:00000080:2.0:1783441562.946031:0:12812:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xa2426164df2c7464 00000020:00010000:2.0:1783441562.946035:0:12812:0:(genops.c:1944:obd_stale_export_put()) Put export ffff91a848690800: total 8 00000100:00080000:2.0:1783441562.946038:0:12812:0:(import.c:65:import_set_state_nolock()) ffff91a846fe4000 : changing import state from FULL to CLOSED 00000020:00080000:2.0:1783441562.946198:0:12812:0:(genops.c:1554:class_disconnect_export_list()) disconnected export at 0@lo (ffff91a848690800): rc 0 00000020:00080000:2.0:1783441562.946205:0:12812:0:(genops.c:1579:class_disconnect_exports()) OBD device 1 (ffff91a847678000) has no exports 00000100:00100000:2.0:1783441562.946271:0:5779:0:(service.c:3183:ptlrpc_main()) ll_mgs_0001: service thread [ffff91a8655d3800:5779] 1 exiting: rc = 0 00000020:00000080:2.0:1783441562.946343:0:27:0:(genops.c:865:class_export_destroy()) destroying export ffff91a8756aa000/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00000080:2.0:1783441562.946382:0:27:0:(genops.c:865:class_export_destroy()) destroying export ffff91a8756d1000/lustre-MDT0000-mdtlov_UUID for lustre-MDT0000-mdtlov 00000020:00000080:2.0:1783441562.946386:0:27:0:(genops.c:906:class_export_put()) final put ffff91a8756aa800/lustre-MDT0000-mdtlov_UUID 00000020:00000080:2.0:1783441562.946388:0:27:0:(genops.c:865:class_export_destroy()) destroying export ffff91a8756aa800/lustre-MDT0000-mdtlov_UUID for lustre-MDT0000-mdtlov 00000020:01000000:2.0:1783441562.946391:0:27:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-mdtlov (lustre-MDT0000-mdtlov_UUID) 00000020:00000080:2.0:1783441562.946488:0:27:0:(genops.c:865:class_export_destroy()) destroying export ffff91a8655b1800/lustre-MDT0000-mdtlov_UUID for lustre-OST0001-osc-MDT0000 00000020:00000080:2.0:1783441562.946494:0:27:0:(genops.c:865:class_export_destroy()) destroying export ffff91a8748ef000/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00000080:2.0:1783441562.946502:0:27:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff91a8748ed000 for lustre-OST0001-osc-MDT0000 00000020:00000080:2.0:1783441562.946507:0:27:0:(genops.c:906:class_export_put()) final put ffff91a745261800/lustre-MDT0000-mdtlov_UUID 00000020:00000080:2.0:1783441562.946509:0:27:0:(genops.c:865:class_export_destroy()) destroying export ffff91a745261800/lustre-MDT0000-mdtlov_UUID for lustre-OST0001-osc-MDT0000 00000020:01000000:2.0:1783441562.946513:0:27:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0001-osc-MDT0000 (lustre-MDT0000-mdtlov_UUID) 00000020:00000080:2.0:1783441562.946537:0:27:0:(genops.c:865:class_export_destroy()) destroying export ffff91a8492bf800/lustre-MDT0000-mdtlov_UUID for lustre-OST0000-osc-MDT0000 00000020:00000080:2.0:1783441562.946542:0:27:0:(genops.c:865:class_export_destroy()) destroying export ffff91a7466c1800/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00000080:2.0:1783441562.946546:0:27:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff91a7466c7800 for lustre-OST0000-osc-MDT0000 00000020:00000080:2.0:1783441562.946558:0:27:0:(genops.c:906:class_export_put()) final put ffff91a74494a800/lustre-MDT0000-mdtlov_UUID 00000020:00000080:2.0:1783441562.946560:0:27:0:(genops.c:865:class_export_destroy()) destroying export ffff91a74494a800/lustre-MDT0000-mdtlov_UUID for lustre-OST0000-osc-MDT0000 00000020:01000000:2.0:1783441562.946566:0:27:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0000-osc-MDT0000 (lustre-MDT0000-mdtlov_UUID) 00000020:00000080:2.0:1783441562.946627:0:27:0:(genops.c:865:class_export_destroy()) destroying export ffff91a8756d4800/lustre-MDD0000_UUID for lustre-MDD0000 00000020:00000080:2.0:1783441562.946631:0:27:0:(genops.c:906:class_export_put()) final put ffff91a8756a9800/lustre-MDD0000_UUID 00000020:00000080:2.0:1783441562.946632:0:27:0:(genops.c:865:class_export_destroy()) destroying export ffff91a8756a9800/lustre-MDD0000_UUID for lustre-MDD0000 00000020:01000000:2.0:1783441562.946639:0:27:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDD0000 (lustre-MDD0000_UUID) 00000100:00100000:0.0:1783441562.946990:0:5778:0:(service.c:3183:ptlrpc_main()) ll_mgs_0000: service thread [ffff91a845019200:5778] 0 exiting: rc = 1 00000020:00000080:2.0:1783441562.947060:0:27:0:(genops.c:865:class_export_destroy()) destroying export ffff91a8756d5000/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00010000:1.0:1783441562.947469:0:5772:0:(genops.c:1930:obd_stale_export_get()) Get export ffff91a848690800: total 0 00010000:00010000:1.0:1783441562.947505:0:5772:0:(ldlm_lock.c:2652:ldlm_export_cancel_blocked_locks()) Export ffff91a848690800, canceled 0 locks, left on hash table 8. 00010000:00010000:1.0:1783441562.947535:0:5772:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff91a85f83d400/0xa2426164df2c79b9 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xa2426164df2c79b2 expref: 9 pid: 5778 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783441562.947550:0:5772:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff91a840030c00/0xa2426164df2c756e lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xa2426164df2c7567 expref: 8 pid: 5780 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783441562.947563:0:5772:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff91a87da47a00/0xa2426164df2c79ab lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xa2426164df2c79a4 expref: 7 pid: 5780 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783441562.947594:0:5772:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff91a87da47600/0xa2426164df2c77ba lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xa2426164df2c77b3 expref: 6 pid: 5778 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783441562.947605:0:5772:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff91a85eb3d400/0xa2426164df2c7774 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xa2426164df2c776d expref: 5 pid: 5780 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783441562.947614:0:5772:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff91a840030600/0xa2426164df2c7766 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xa2426164df2c775f expref: 4 pid: 5779 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783441562.947624:0:5772:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff91a840031800/0xa2426164df2c7782 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xa2426164df2c777b expref: 3 pid: 5778 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783441562.947634:0:5772:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff91a85f83c800/0xa2426164df2c7790 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xa2426164df2c7789 expref: 2 pid: 5779 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783441562.947643:0:5772:0:(ldlm_lock.c:2680:ldlm_export_cancel_locks()) Export ffff91a848690800, canceled 8 locks, left on hash table 0. 00000020:00000080:1.0:1783441562.947655:0:5772:0:(genops.c:906:class_export_put()) final put ffff91a848690800/6c1ddb50-5795-40c6-a2b6-8f58add9da62 00010000:00010000:1.0:1783441562.947666:0:5772:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783441562.947669:0:5772:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783441562.947670:0:5772:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1783441562.947698:0:5780:0:(service.c:3183:ptlrpc_main()) ll_mgs_0002: service thread [ffff91a8484d1a00:5780] 2 exiting: rc = 0 00000020:00000080:1.0:1783441562.947776:0:59:0:(genops.c:865:class_export_destroy()) destroying export ffff91a848690800/6c1ddb50-5795-40c6-a2b6-8f58add9da62 for MGS 00000020:00000080:1.0:1783441562.947803:0:59:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff91a846fe4000 for MGS 00000100:00100000:2.0:1783441562.948253:0:12812:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783441562.948261:0:12812:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783441562.948268:0:12812:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783441562.948275:0:12812:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783441562.948280:0:12812:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783441562.948286:0:12812:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783441562.948292:0:12812:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783441562.948298:0:12812:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783441562.948305:0:12812:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783441562.948311:0:12812:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783441562.948317:0:12812:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783441562.948323:0:12812:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783441562.948331:0:12812:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783441562.948337:0:12812:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783441562.948344:0:12812:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783441562.948350:0:12812:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783441562.948355:0:12812:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783441562.948362:0:12812:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783441562.948368:0:12812:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783441562.948375:0:12812:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783441562.948381:0:12812:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783441562.948386:0:12812:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783441562.948392:0:12812:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783441562.948398:0:12812:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783441562.948404:0:12812:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783441562.948419:0:12812:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783441562.948425:0:12812:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783441562.948430:0:12812:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783441562.948435:0:12812:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783441562.948441:0:12812:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783441562.948446:0:12812:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783441562.948451:0:12812:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783441562.948457:0:12812:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783441562.948462:0:12812:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783441562.948467:0:12812:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783441562.948473:0:12812:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783441562.948478:0:12812:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783441562.948483:0:12812:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783441562.948487:0:12812:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783441562.948493:0:12812:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783441562.948497:0:12812:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783441562.948503:0:12812:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783441562.948508:0:12812:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783441562.948513:0:12812:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783441562.948519:0:12812:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783441562.948524:0:12812:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783441562.948530:0:12812:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783441562.948535:0:12812:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783441562.948540:0:12812:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783441562.948545:0:12812:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783441562.948549:0:12812:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783441562.948555:0:12812:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783441562.948560:0:12812:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783441562.948565:0:12812:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783441562.948570:0:12812:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783441562.948575:0:12812:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783441562.948580:0:12812:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783441562.948586:0:12812:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783441562.948591:0:12812:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783441562.948596:0:12812:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783441562.948608:0:12812:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783441562.948614:0:12812:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783441562.948619:0:12812:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783441562.948624:0:12812:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 20000000:01000000:0.0:1783441562.949267:0:12812:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping . 20000000:01000000:0.0:1783441562.949270:0:12812:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping .. 00000020:01000000:0.0:1783441562.950226:0:12812:0:(lprocfs_status_server.c:306:lprocfs_free_client_stats()) stat ffff91a875379c60 - data ffff91a747020af8/ffff91a87d7cf000 00000020:01000000:0.0:1783441562.950336:0:12812:0:(lprocfs_status_server.c:306:lprocfs_free_client_stats()) stat ffff91a845035480 - data ffff91a872f626c0/ffff91a8506bbc00 00000020:00000080:0.0:1783441562.950909:0:12812:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xa2426164df2c7448 00000020:00000080:0.0:1783441562.950916:0:12812:0:(genops.c:906:class_export_put()) final put ffff91a848698000/lustre-MDT0000-osd_UUID 00000020:00000080:0.0:1783441562.950931:0:53:0:(genops.c:865:class_export_destroy()) destroying export ffff91a848698000/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:01000004:0.0:1783441562.950944:0:12812:0:(tgt_mount.c:187:server_put_mount()) put mount ffff91a84869e800 from MGS, refs=2 00000020:01000004:0.0:1783441562.950956:0:12812:0:(obd_mount.c:710:lustre_put_lsi()) put ffff91a84869e800 2 00000020:01000004:0.0:1783441562.950960:0:12812:0:(tgt_mount.c:120:server_deregister_mount()) deregister mount ffff91a84869e800 from MGS 00000020:00000080:0.0:1783441562.950988:0:12812:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1783441562.950995:0:12812:0:(obd_config.c:883:class_detach()) detach on obd MGS (uuid MGS) 00000020:00000080:0.0:1783441562.950998:0:12812:0:(genops.c:906:class_export_put()) final put ffff91a84869d800/MGS 00000020:00000080:0.0:1783441562.950999:0:12812:0:(genops.c:865:class_export_destroy()) destroying export ffff91a84869d800/MGS for MGS 00000020:01000000:0.0:1783441562.951005:0:12812:0:(genops.c:441:class_free_dev()) finishing cleanup of obd MGS (MGS) 00000020:01000000:0.0:1783441562.951059:0:12812:0:(obd_config.c:2475:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-lwp-MDT0000 (flags='F') 00000020:00000080:0.0:1783441562.951064:0:12812:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1783441562.951069:0:12812:0:(obd_config.c:955:class_cleanup()) lustre-MDT0000-lwp-MDT0000: forcing exports to disconnect: 1/3 00000020:00080000:0.0:1783441562.951075:0:12812:0:(genops.c:1840:print_export_data()) lustre-MDT0000-lwp-MDT0000: ACTIVE ffff91a881c7a000 lustre-MDT0000-lwp-MDT0000 0@lo 3 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:0.0:1783441562.951081:0:12812:0:(genops.c:1574:class_disconnect_exports()) OBD device 8 (ffff91a8502199c0) has exports, disconnecting them 00000020:00080000:0.0:1783441562.951086:0:12812:0:(genops.c:1549:class_disconnect_export_list()) lustre-MDT0000-lwp-MDT0000: disconnecting export at 0@lo (ffff91a881c7a000), last request at 1783441323 00000020:00000080:0.0:1783441562.951090:0:12812:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xa2426164df2c7513 00000020:00080000:0.0:1783441562.952201:0:12812:0:(genops.c:1554:class_disconnect_export_list()) disconnected export at 0@lo (ffff91a881c7a000): rc 0 00000020:00000080:0.0:1783441562.952208:0:12812:0:(genops.c:906:class_export_put()) final put ffff91a881c7a000/lustre-MDT0000-lwp-MDT0000 00000020:00000080:0.0:1783441562.952242:0:53:0:(genops.c:865:class_export_destroy()) destroying export ffff91a881c7a000/lustre-MDT0000-lwp-MDT0000 for lustre-MDT0000-lwp-MDT0000 00010000:01000000:1.0:1783441562.955217:0:12812:0:(obd_class.h:671:obd_cleanup_client_import()) lustre-MDT0000-lwp-MDT0000: client import never connected 00000100:00080000:1.0:1783441562.955227:0:12812:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:1.0:1783441562.955231:0:12812:0:(client.c:3112:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0000: committing for last_committed 0 gen 5 00000100:00100000:1.0:1783441562.955240:0:12812:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:1.0:1783441562.955268:0:59:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff91a881c7f000 for lustre-MDT0000-lwp-MDT0000 00000020:00000080:1.0:1783441562.955431:0:12812:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1783441562.955453:0:12812:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-lwp-MDT0000 (uuid lustre-MDT0000-lwp-MDT0000_UUID) 00000020:00000080:1.0:1783441562.955458:0:12812:0:(genops.c:906:class_export_put()) final put ffff91a881c7e000/lustre-MDT0000-lwp-MDT0000_UUID 00000020:00000080:1.0:1783441562.955462:0:12812:0:(genops.c:865:class_export_destroy()) destroying export ffff91a881c7e000/lustre-MDT0000-lwp-MDT0000_UUID for lustre-MDT0000-lwp-MDT0000 00000020:01000000:1.0:1783441562.955467:0:12812:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-lwp-MDT0000 (lustre-MDT0000-lwp-MDT0000_UUID) 00000020:01000004:1.0:1783441562.955526:0:12812:0:(obd_mount.c:710:lustre_put_lsi()) put ffff91a84869e800 1 00000020:00000080:1.0:1783441562.955531:0:12812:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xa2426164df2c743a 00000020:00000080:1.0:1783441562.955537:0:12812:0:(genops.c:906:class_export_put()) final put ffff91a84869a800/lustre-MDT0000-osd_UUID 00000020:01000000:1.0:1783441562.955544:0:12812:0:(obd_config.c:2475:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-osd (flags='') 00000020:00000080:1.0:1783441562.955551:0:59:0:(genops.c:865:class_export_destroy()) destroying export ffff91a84869a800/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00000080:1.0:1783441562.955560:0:12812:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1783441562.955564:0:12812:0:(obd_config.c:955:class_cleanup()) lustre-MDT0000-osd: forcing exports to disconnect: 0/1 00000020:00080000:1.0:1783441562.955568:0:12812:0:(genops.c:1579:class_disconnect_exports()) OBD device 0 (ffff91a8515719c0) has no exports 00000020:00000080:1.0:1783441563.013687:0:12812:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1783441563.013703:0:12812:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-osd (uuid lustre-MDT0000-osd_UUID) 00000020:00000080:1.0:1783441563.013709:0:12812:0:(genops.c:906:class_export_put()) final put ffff91a844b0a000/lustre-MDT0000-osd_UUID 00000020:00000080:1.0:1783441563.013713:0:12812:0:(genops.c:865:class_export_destroy()) destroying export ffff91a844b0a000/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:01000000:1.0:1783441563.013721:0:12812:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-osd (lustre-MDT0000-osd_UUID) 00000020:01000004:1.0:1783441563.013886:0:12812:0:(obd_mount.c:668:lustre_free_lsi()) Freeing lsi ffff91a848699000 00000020:01000000:1.0:1783441563.013908:0:12812:0:(obd_config.c:2475:class_manual_cleanup()) Manual cleanup of MDS (flags='F') 00000020:00000080:1.0:1783441563.013913:0:12812:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1783441563.013917:0:12812:0:(obd_config.c:955:class_cleanup()) MDS: forcing exports to disconnect: 0/1 00000020:00080000:1.0:1783441563.013921:0:12812:0:(genops.c:1579:class_disconnect_exports()) OBD device 3 (ffff91a8476799c0) has no exports 00000100:00100000:1.0:1783441563.013994:0:6605:0:(service.c:3183:ptlrpc_main()) mdt00_003: service thread [ffff91a744913600:6605] 3 exiting: rc = 0 00000100:00100000:1.0:1783441563.014237:0:5785:0:(service.c:3183:ptlrpc_main()) mdt00_000: service thread [ffff91a8484ecc00:5785] 0 exiting: rc = 1 00000100:00100000:1.0:1783441563.014300:0:5786:0:(service.c:3183:ptlrpc_main()) mdt00_001: service thread [ffff91a8655d2800:5786] 1 exiting: rc = 0 00000100:00100000:0.0:1783441563.019202:0:5787:0:(service.c:3183:ptlrpc_main()) mdt00_002: service thread [ffff91a8484d1200:5787] 2 exiting: rc = 0 00000100:00100000:1.0:1783441563.019414:0:12812:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783441563.019422:0:12812:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783441563.019429:0:12812:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783441563.019434:0:12812:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783441563.019439:0:12812:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783441563.019444:0:12812:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783441563.019517:0:12812:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783441563.019535:0:12812:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783441563.019541:0:12812:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783441563.019548:0:12812:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783441563.019554:0:12812:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783441563.019559:0:12812:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783441563.019565:0:12812:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783441563.019571:0:12812:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783441563.019577:0:12812:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783441563.019583:0:12812:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783441563.019588:0:12812:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783441563.019593:0:12812:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783441563.019599:0:12812:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783441563.019605:0:12812:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783441563.019611:0:12812:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783441563.019761:0:12812:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783441563.019767:0:12812:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783441563.019772:0:12812:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783441563.019777:0:12812:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783441563.019786:0:12812:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783441563.019793:0:12812:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783441563.019798:0:12812:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783441563.019804:0:12812:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783441563.019808:0:12812:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783441563.019932:0:12812:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783441563.019939:0:12812:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783441563.019944:0:12812:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783441563.019949:0:12812:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783441563.019955:0:12812:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783441563.019960:0:12812:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783441563.019966:0:12812:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783441563.019974:0:12812:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783441563.019982:0:12812:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783441563.019988:0:12812:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783441563.020013:0:12812:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783441563.020023:0:12812:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783441563.020038:0:12812:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783441563.020046:0:12812:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783441563.020053:0:12812:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783441563.020060:0:12812:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783441563.020066:0:12812:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783441563.020072:0:12812:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783441563.020081:0:12812:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783441563.020088:0:12812:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783441563.020177:0:12812:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783441563.020189:0:12812:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783441563.020200:0:12812:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783441563.020209:0:12812:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783441563.020214:0:12812:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783441563.020224:0:12812:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783441563.020231:0:12812:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783441563.020236:0:12812:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783441563.020243:0:12812:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783441563.020249:0:12812:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783441563.020254:0:12812:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783441563.020260:0:12812:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783441563.020266:0:12812:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783441563.020280:0:12812:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783441563.032997:0:5789:0:(service.c:3183:ptlrpc_main()) mdt_rdpg00_001: service thread [ffff91a8484d0200:5789] 1 exiting: rc = 0 00000100:00100000:1.0:1783441563.032997:0:5788:0:(service.c:3183:ptlrpc_main()) mdt_rdpg00_000: service thread [ffff91a8484d1e00:5788] 0 exiting: rc = 1 00000100:00100000:1.0:1783441563.035552:0:12812:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783441563.035563:0:12812:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783441563.035573:0:12812:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783441563.035581:0:12812:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783441563.035589:0:12812:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783441563.035598:0:12812:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783441563.035607:0:12812:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783441563.035615:0:12812:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783441563.035623:0:12812:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783441563.035631:0:12812:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783441563.035638:0:12812:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783441563.035646:0:12812:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783441563.035669:0:12812:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783441563.035676:0:12812:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783441563.035684:0:12812:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783441563.035691:0:12812:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783441563.035699:0:12812:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783441563.035706:0:12812:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783441563.035713:0:12812:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783441563.035721:0:12812:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783441563.035725:0:12812:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783441563.035730:0:12812:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783441563.035737:0:12812:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783441563.035753:0:12812:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783441563.035760:0:12812:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783441563.035767:0:12812:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783441563.035772:0:12812:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783441563.035778:0:12812:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783441563.035782:0:12812:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783441563.035787:0:12812:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783441563.035793:0:12812:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783441563.035799:0:12812:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783441563.035806:0:12812:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783441563.036695:0:12812:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783441563.036708:0:12812:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783441563.036715:0:12812:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783441563.036722:0:12812:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783441563.036727:0:12812:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783441563.036734:0:12812:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783441563.036756:0:12812:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783441563.036764:0:12812:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783441563.036770:0:12812:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783441563.036775:0:12812:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783441563.036780:0:12812:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783441563.036785:0:12812:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783441563.036790:0:12812:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783441563.036794:0:12812:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783441563.036807:0:12812:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783441563.037412:0:12812:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783441563.037422:0:12812:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783441563.037429:0:12812:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783441563.037436:0:12812:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783441563.037443:0:12812:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783441563.037450:0:12812:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783441563.037456:0:12812:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783441563.037463:0:12812:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783441563.037469:0:12812:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783441563.037475:0:12812:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783441563.037482:0:12812:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783441563.037489:0:12812:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783441563.037496:0:12812:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783441563.037501:0:12812:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783441563.037505:0:12812:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783441563.037511:0:12812:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783441563.041130:0:5790:0:(service.c:3183:ptlrpc_main()) mdt_out00_000: service thread [ffff91a8515f4400:5790] 0 exiting: rc = 1 00000100:00100000:3.0:1783441563.041299:0:5791:0:(service.c:3183:ptlrpc_main()) mdt_out00_001: service thread [ffff91a8515f5000:5791] 1 exiting: rc = 0 00000100:00100000:1.0:1783441563.041573:0:12812:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783441563.041589:0:12812:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783441563.041595:0:12812:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783441563.041614:0:12812:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783441563.041627:0:12812:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783441563.041642:0:12812:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783441563.041667:0:12812:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783441563.041679:0:12812:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783441563.041685:0:12812:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783441563.041716:0:12812:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783441563.041724:0:12812:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783441563.041733:0:12812:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783441563.041762:0:12812:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783441563.041770:0:12812:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783441563.041778:0:12812:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783441563.041785:0:12812:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783441563.041791:0:12812:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783441563.041798:0:12812:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783441563.042592:0:12812:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783441563.042599:0:12812:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783441563.042605:0:12812:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783441563.042635:0:12812:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783441563.042642:0:12812:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783441563.042649:0:12812:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783441563.042654:0:12812:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783441563.042659:0:12812:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783441563.042665:0:12812:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783441563.042671:0:12812:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783441563.042678:0:12812:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783441563.042684:0:12812:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783441563.042689:0:12812:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783441563.042696:0:12812:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783441563.042702:0:12812:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783441563.042730:0:12812:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783441563.042736:0:12812:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783441563.043592:0:12812:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783441563.043602:0:12812:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783441563.043610:0:12812:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783441563.043616:0:12812:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783441563.043623:0:12812:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783441563.043631:0:12812:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783441563.043637:0:12812:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783441563.043644:0:12812:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783441563.043652:0:12812:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783441563.043661:0:12812:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783441563.043694:0:12812:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783441563.043705:0:12812:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783441563.043716:0:12812:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783441563.043724:0:12812:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783441563.043731:0:12812:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783441563.043806:0:12812:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783441563.045011:0:12812:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783441563.045022:0:12812:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783441563.045045:0:12812:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783441563.045055:0:12812:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783441563.045065:0:12812:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783441563.045077:0:12812:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783441563.045736:0:12812:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783441563.045779:0:12812:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783441563.045787:0:12812:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783441563.045794:0:12812:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783441563.045803:0:12812:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783441563.046422:0:12812:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783441563.046447:0:12812:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783441563.064025:0:5793:0:(service.c:3183:ptlrpc_main()) mdt_seqs_0001: service thread [ffff91a846f9b800:5793] 1 exiting: rc = 0 00000100:00100000:2.0:1783441563.064186:0:5792:0:(service.c:3183:ptlrpc_main()) mdt_seqs_0000: service thread [ffff91a848f1aa00:5792] 0 exiting: rc = 1 00000100:00100000:0.0:1783441563.064398:0:12812:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783441563.064406:0:12812:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783441563.064411:0:12812:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783441563.064416:0:12812:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783441563.064421:0:12812:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783441563.064426:0:12812:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783441563.064431:0:12812:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783441563.064437:0:12812:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783441563.064441:0:12812:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783441563.064446:0:12812:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783441563.064451:0:12812:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783441563.064456:0:12812:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783441563.064460:0:12812:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783441563.064479:0:12812:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783441563.064484:0:12812:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783441563.064489:0:12812:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783441563.064494:0:12812:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783441563.064513:0:12812:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783441563.064519:0:12812:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783441563.064523:0:12812:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783441563.064528:0:12812:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783441563.064533:0:12812:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783441563.064537:0:12812:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783441563.064542:0:12812:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783441563.064547:0:12812:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783441563.064552:0:12812:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783441563.064556:0:12812:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783441563.064561:0:12812:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783441563.064569:0:12812:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783441563.064574:0:12812:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783441563.064579:0:12812:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783441563.064584:0:12812:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783441563.064589:0:12812:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783441563.064593:0:12812:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783441563.064598:0:12812:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783441563.064602:0:12812:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783441563.064607:0:12812:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783441563.064611:0:12812:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783441563.064616:0:12812:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783441563.064621:0:12812:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783441563.064626:0:12812:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783441563.064703:0:12812:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783441563.064711:0:12812:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783441563.064829:0:12812:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783441563.064837:0:12812:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783441563.064843:0:12812:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783441563.064849:0:12812:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783441563.064854:0:12812:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783441563.064868:0:12812:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783441563.064873:0:12812:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783441563.064878:0:12812:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783441563.064883:0:12812:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783441563.064888:0:12812:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783441563.064893:0:12812:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783441563.064899:0:12812:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783441563.064906:0:12812:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783441563.064911:0:12812:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783441563.064917:0:12812:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783441563.064928:0:12812:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783441563.064933:0:12812:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783441563.064938:0:12812:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783441563.064944:0:12812:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783441563.064949:0:12812:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783441563.064954:0:12812:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783441563.065901:0:5795:0:(service.c:3183:ptlrpc_main()) mdt_seqm_0001: service thread [ffff91a848542400:5795] 1 exiting: rc = 0 00000100:00100000:0.0:1783441563.066112:0:5794:0:(service.c:3183:ptlrpc_main()) mdt_seqm_0000: service thread [ffff91a848f1ac00:5794] 0 exiting: rc = 1 00000100:00100000:0.0:1783441563.066180:0:12812:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783441563.066187:0:12812:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783441563.066192:0:12812:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783441563.066197:0:12812:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783441563.066202:0:12812:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783441563.066208:0:12812:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783441563.066213:0:12812:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783441563.066217:0:12812:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783441563.066222:0:12812:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783441563.066227:0:12812:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783441563.066232:0:12812:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783441563.066237:0:12812:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783441563.066242:0:12812:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783441563.066247:0:12812:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783441563.066252:0:12812:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783441563.066256:0:12812:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783441563.066261:0:12812:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783441563.066266:0:12812:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783441563.066283:0:12812:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783441563.066287:0:12812:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783441563.066292:0:12812:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783441563.066297:0:12812:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783441563.066302:0:12812:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783441563.066307:0:12812:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783441563.066311:0:12812:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783441563.066389:0:12812:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783441563.066397:0:12812:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783441563.066402:0:12812:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783441563.066407:0:12812:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783441563.066412:0:12812:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783441563.066417:0:12812:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783441563.066423:0:12812:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783441563.066428:0:12812:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783441563.066433:0:12812:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783441563.066437:0:12812:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783441563.066442:0:12812:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783441563.066447:0:12812:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783441563.066452:0:12812:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783441563.066457:0:12812:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783441563.066463:0:12812:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783441563.066468:0:12812:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783441563.066473:0:12812:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783441563.066479:0:12812:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783441563.066484:0:12812:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783441563.066490:0:12812:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783441563.066563:0:12812:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783441563.066571:0:12812:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783441563.066577:0:12812:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783441563.066582:0:12812:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783441563.066588:0:12812:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783441563.066593:0:12812:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783441563.066598:0:12812:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783441563.066603:0:12812:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783441563.066617:0:12812:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783441563.066623:0:12812:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783441563.066628:0:12812:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783441563.066710:0:12812:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783441563.066715:0:12812:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783441563.066816:0:12812:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783441563.066823:0:12812:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783441563.066829:0:12812:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783441563.066834:0:12812:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783441563.066840:0:12812:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783441563.066845:0:12812:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783441563.067234:0:5797:0:(service.c:3183:ptlrpc_main()) mdt_fld_0001: service thread [ffff91a848542c00:5797] 1 exiting: rc = 0 00000100:00100000:2.0:1783441563.067438:0:5796:0:(service.c:3183:ptlrpc_main()) mdt_fld_0000: service thread [ffff91a848543800:5796] 0 exiting: rc = 1 00000100:00100000:0.0:1783441563.067595:0:12812:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783441563.067602:0:12812:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783441563.067607:0:12812:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783441563.067613:0:12812:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783441563.067619:0:12812:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783441563.067624:0:12812:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783441563.067630:0:12812:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783441563.067712:0:12812:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783441563.067718:0:12812:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783441563.067844:0:12812:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783441563.067849:0:12812:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783441563.067854:0:12812:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783441563.067859:0:12812:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783441563.067864:0:12812:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783441563.067869:0:12812:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783441563.067874:0:12812:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783441563.067879:0:12812:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783441563.067884:0:12812:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783441563.067889:0:12812:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783441563.067894:0:12812:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783441563.067899:0:12812:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783441563.067904:0:12812:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783441563.067909:0:12812:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783441563.067927:0:12812:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783441563.067933:0:12812:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783441563.067938:0:12812:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783441563.067944:0:12812:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783441563.067948:0:12812:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783441563.067953:0:12812:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783441563.067959:0:12812:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783441563.067965:0:12812:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783441563.067970:0:12812:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783441563.067975:0:12812:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783441563.067981:0:12812:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783441563.067986:0:12812:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783441563.067992:0:12812:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783441563.067997:0:12812:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783441563.068002:0:12812:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783441563.068007:0:12812:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783441563.068012:0:12812:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783441563.068017:0:12812:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783441563.068022:0:12812:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783441563.068027:0:12812:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783441563.068032:0:12812:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783441563.068037:0:12812:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783441563.068042:0:12812:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783441563.068047:0:12812:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783441563.068052:0:12812:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783441563.068057:0:12812:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783441563.068062:0:12812:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783441563.068067:0:12812:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783441563.068072:0:12812:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783441563.068076:0:12812:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783441563.068081:0:12812:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783441563.068086:0:12812:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783441563.068091:0:12812:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783441563.068096:0:12812:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783441563.068101:0:12812:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783441563.068114:0:12812:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783441563.068118:0:12812:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783441563.068122:0:12812:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783441563.068127:0:12812:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783441563.068131:0:12812:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783441563.068136:0:12812:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783441563.068885:0:5799:0:(service.c:3183:ptlrpc_main()) mdt_io00_001: service thread [ffff91a848543400:5799] 1 exiting: rc = 0 00000100:00100000:2.0:1783441563.069096:0:5798:0:(service.c:3183:ptlrpc_main()) mdt_io00_000: service thread [ffff91a8492d4c00:5798] 0 exiting: rc = 1 00000100:00100000:3.0:1783441563.071314:0:5800:0:(service.c:3183:ptlrpc_main()) mdt_io00_002: service thread [ffff91a848542e00:5800] 2 exiting: rc = 0 00000100:00100000:0.0:1783441563.072188:0:12812:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783441563.072202:0:12812:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783441563.072209:0:12812:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783441563.072214:0:12812:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783441563.072241:0:12812:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783441563.072248:0:12812:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783441563.072253:0:12812:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783441563.072259:0:12812:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783441563.072264:0:12812:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783441563.072270:0:12812:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783441563.072276:0:12812:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783441563.072283:0:12812:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783441563.072289:0:12812:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783441563.072294:0:12812:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783441563.072299:0:12812:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783441563.072305:0:12812:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783441563.072311:0:12812:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783441563.072389:0:12812:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783441563.072399:0:12812:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783441563.072406:0:12812:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783441563.072412:0:12812:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783441563.072418:0:12812:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783441563.072424:0:12812:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783441563.072430:0:12812:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783441563.072435:0:12812:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783441563.072441:0:12812:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783441563.072446:0:12812:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783441563.072452:0:12812:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783441563.072484:0:12812:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783441563.072490:0:12812:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783441563.072574:0:12812:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783441563.072581:0:12812:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783441563.072587:0:12812:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783441563.072593:0:12812:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783441563.072600:0:12812:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783441563.072605:0:12812:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783441563.072612:0:12812:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783441563.072620:0:12812:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783441563.072625:0:12812:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783441563.072695:0:12812:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783441563.072703:0:12812:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783441563.072711:0:12812:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783441563.072717:0:12812:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783441563.072733:0:12812:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783441563.072757:0:12812:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783441563.072764:0:12812:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783441563.072770:0:12812:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783441563.072775:0:12812:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783441563.072781:0:12812:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783441563.072786:0:12812:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783441563.072791:0:12812:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783441563.072796:0:12812:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783441563.072820:0:12812:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783441563.072827:0:12812:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783441563.072832:0:12812:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783441563.072838:0:12812:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783441563.072843:0:12812:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783441563.072848:0:12812:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783441563.072853:0:12812:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783441563.072858:0:12812:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783441563.072864:0:12812:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783441563.072868:0:12812:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783441563.072873:0:12812:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783441563.072885:0:12812:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000020:00000080:0.0:1783441563.077497:0:12812:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1783441563.077513:0:12812:0:(obd_config.c:883:class_detach()) detach on obd MDS (uuid MDS_uuid) 00000020:00000080:0.0:1783441563.077519:0:12812:0:(genops.c:906:class_export_put()) final put ffff91a8476ea800/MDS_uuid 00000020:00000080:0.0:1783441563.077524:0:12812:0:(genops.c:865:class_export_destroy()) destroying export ffff91a8476ea800/MDS_uuid for MDS 00000020:01000000:0.0:1783441563.077529:0:12812:0:(genops.c:441:class_free_dev()) finishing cleanup of obd MDS (MDS_uuid) 00000020:02000400:0.0:1783441563.077657:0:12812:0:(tgt_mount.c:2182:server_put_super()) server umount lustre-MDT0000 complete 00010000:00010000:2.0:1783441563.820947:0:5773:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1783441564.015238:0:3305:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff91a874dcf480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:6c1ddb50-5795-40c6-a2b6-8f58add9da62:3305:1870073693298176:0@lo:400:kworker.0 00000400:00000100:0.0:1783441564.015293:0:3305:0:(lib-move.c:4262:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 26 match 1870073693298176 offset 0 length 224: 4 00000100:00100000:0.0:1783441564.015775:0:3305:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1783441564.015783:0:3305:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff91a874dcd880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3305:1870073693298304:0@lo:400:kworker.0 00000400:00000100:0.0:1783441564.015809:0:3305:0:(lib-move.c:4262:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1870073693298304 offset 0 length 224: 4 00000100:00100000:0.0:1783441564.019182:0:3304:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1783441564.021220:0:3304:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff91a874dce680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3304:1870073693298432:0@lo:400:kworker.0 00000400:00000100:0.0:1783441564.023190:0:3304:0:(lib-move.c:4262:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1870073693298432 offset 0 length 224: 4 00010000:00010000:3.0:1783441564.848296:0:5772:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783441565.872266:0:5773:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:0.0:1783441566.185501:0:6613:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000020:00000080:0.0:1783441566.185512:0:6613:0:(genops.c:906:class_export_put()) final put ffff91a74422d000/lustre-MDT0000-mdtlov_UUID 00000020:00000080:0.0:1783441566.185538:0:365:0:(genops.c:865:class_export_destroy()) destroying export ffff91a74422d000/lustre-MDT0000-mdtlov_UUID for lustre-OST0000 00000020:00000080:0.0:1783441566.185577:0:365:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff91a74422e800 for lustre-OST0000 00000020:01000004:3.0:1783441566.369494:0:12962:0:(tgt_mount.c:2193:server_umount_begin()) umount -f 00000020:01000004:3.0:1783441566.388882:0:12962:0:(tgt_mount.c:2063:server_put_super()) server put_super lustre-OST0000 00010000:00010000:3.0:1783441566.388951:0:12962:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.113@tcp lock: ffff91a87da46c00/0xa2426164df2c777b lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xa2426164df2c7782 expref: -99 pid: 5783 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783441566.388967:0:12962:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.113@tcp lock: ffff91a87da46c00/0xa2426164df2c777b lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0xa2426164df2c7782 expref: -99 pid: 5783 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783441566.388976:0:12962:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.113@tcp lock: ffff91a87da46c00/0xa2426164df2c777b lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000400000000 nid: local remote: 0xa2426164df2c7782 expref: -99 pid: 5783 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783441566.388982:0:12962:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.201.113@tcp lock: ffff91a87da46c00/0xa2426164df2c777b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000400000000 nid: local remote: 0xa2426164df2c7782 expref: -99 pid: 5783 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783441566.389019:0:12962:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:3.0:1783441566.389025:0:12962:0:(mgc_request.c:547:config_log_end()) end config log lustre-client (0) 00000100:00080000:3.0:1783441566.389045:0:12962:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:3.0:1783441566.389055:0:12962:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff91a874dcd880 x1870073693298304/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1783441580 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1783441566.389071:0:12962:0:(client.c:3112:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0000: committing for last_committed 0 gen 3 00000100:00080000:3.0:1783441566.389077:0:12962:0:(pinger.c:399:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID 00000100:00080000:3.0:1783441566.389099:0:12962:0:(import.c:65:import_set_state_nolock()) ffff91a877f8a800 lustre-MDT0000_UUID: changing import state from FULL to CONNECTING 00010000:00010000:1.0:1783441566.389247:0:5772:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1783441566.389255:0:5772:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.113@tcp lock: ffff91a87da46c00/0xa2426164df2c777b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000400000000 nid: local remote: 0xa2426164df2c7782 expref: -99 pid: 5783 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783441566.389263:0:5772:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91a87da46c00 already unused, calling callback (ffffffffc1b78c20) 10000000:00010000:1.0:1783441566.389266:0:5772:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.113@tcp lock: ffff91a87da46c00/0xa2426164df2c777b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000400000000 nid: local remote: 0xa2426164df2c7782 expref: -99 pid: 5783 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783441566.389274:0:5772:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.113@tcp lock: ffff91a87da46c00/0xa2426164df2c777b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1008400000000 nid: local remote: 0xa2426164df2c7782 expref: -99 pid: 5783 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1783441566.389281:0:5772:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.113@tcp lock: ffff91a87da46c00/0xa2426164df2c777b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1009400000000 nid: local remote: 0xa2426164df2c7782 expref: -99 pid: 5783 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1783441566.389286:0:5772:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:1.0:1783441566.389288:0:5772:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-client: stopping, won't requeue 10000000:01000000:1.0:1783441566.389291:0:5772:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-client 00010000:00010000:1.0:1783441566.389316:0:5772:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.113@tcp lock: ffff91a87da46c00/0xa2426164df2c777b lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5809400000020 nid: local remote: 0xa2426164df2c7782 expref: -99 pid: 5783 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783441566.389323:0:5772:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1783441566.389353:0:5772:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.113@tcp lock: ffff91a87da46c00/0xa2426164df2c777b lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5809400000020 nid: local remote: 0xa2426164df2c7782 expref: -99 pid: 5783 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783441566.389367:0:5772:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.113@tcp lock: ffff91a87da46c00/0xa2426164df2c777b lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5809400000020 nid: local remote: 0xa2426164df2c7782 expref: -99 pid: 5783 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783441566.389380:0:5772:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783441566.389382:0:5772:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783441566.389383:0:5772:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1783441566.389391:0:3303:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1783441566.389406:0:3303:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff91a745550a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:6c1ddb50-5795-40c6-a2b6-8f58add9da62:3303:1870073693298688:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1783441566.389483:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783441566.389546:0:11015:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073693298688 00000100:00100000:1.0:1783441566.389553:0:11015:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073693298688 00000100:00100000:1.0:1783441566.389591:0:11015:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:1.0:1783441566.389599:0:11015:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a745553100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:0+-99:3303:x1870073693298688:12345-0@lo:103:ldlm_bl.0 00010000:00020000:1.0:1783441566.389605:0:11015:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) ldlm_cancel from 0@lo arrived at 1783441566 with bad export cookie 11692014668476085348 00000100:00100000:0.0:1783441566.391680:0:3305:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff91a874dcd880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3305:1870073693298304:0@lo:400:kworker.0 00000100:00100000:2.0:1783441566.391774:0:3302:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff91a874dcfb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3302:1870073693298560:0@lo:39:umount.0 00000400:00000100:2.0:1783441566.391822:0:3302:0:(lib-move.c:4262:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1870073693298560 offset 0 length 224: 4 00000100:00100000:2.0:1783441566.398296:0:11015:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a745553100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:0+-99:3303:x1870073693298688:12345-0@lo:103:ldlm_bl.0 Request processed in 8686us (8802us total) trans 0 rc -107/-107 00000100:00100000:2.0:1783441566.398313:0:11015:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00080000:1.0:1783441566.398392:0:3303:0:(recover.c:205:ptlrpc_request_handle_notconn()) import MGC192.168.201.113@tcp of MGS@0@lo abruptly disconnected: reconnecting 00000100:00080000:1.0:1783441566.398397:0:3303:0:(import.c:65:import_set_state_nolock()) ffff91a8476ec000 MGS: changing import state from FULL to DISCONN 00000100:02020000:1.0:1783441566.398401:0:3303:0:(import.c:186:ptlrpc_set_import_discon()) MGC192.168.201.113@tcp: Connection to MGS (at 0@lo) was lost; in progress operations using this service will fail 00000100:00080000:1.0:1783441566.404337:0:3303:0:(import.c:192:ptlrpc_set_import_discon()) import MGS@0@lo for MGC192.168.201.113@tcp not replayable, auto-deactivating 00000100:00080000:1.0:1783441566.404342:0:3303:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import MGS INVALID 00000100:00100000:1.0:1783441566.404352:0:3303:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff91a874dcf480 x1870073693298176/t0(0) o400->MGC192.168.201.113@tcp@0@lo:26/25 lens 224/224 e 0 to 0 dl 1783441580 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1783441566.404368:0:3303:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff91a745550a80 x1870073693298688/t0(0) o103->MGC192.168.201.113@tcp@0@lo:17/18 lens 328/224 e 0 to 0 dl 1783441582 ref 1 fl Rpc:RQU/200/0 rc 0/-107 job:'ldlm_bl.0' uid:0 gid:0 projid:4294967295 10000000:01000000:1.0:1783441566.404378:0:3303:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808001 00000100:00080000:1.0:1783441566.404380:0:3303:0:(pinger.c:193:ptlrpc_pinger_ir_down()) IR down 10000000:01000000:1.0:1783441566.404382:0:3303:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808002 00000100:00080000:1.0:1783441566.404386:0:3303:0:(import.c:65:import_set_state_nolock()) ffff91a8476ec000 MGS: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1783441566.404410:0:3303:0:(import.c:510:import_select_connection()) MGC192.168.201.113@tcp: connect to NID 0@lo last attempt 159 00000100:00080000:1.0:1783441566.404419:0:3303:0:(import.c:624:import_select_connection()) MGC192.168.201.113@tcp: import ffff91a8476ec000 using connection 192.168.201.113@tcp/0@lo 00000100:00100000:0.0:1783441566.404610:0:3305:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff91a874dcf480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:6c1ddb50-5795-40c6-a2b6-8f58add9da62:3305:1870073693298176:0@lo:400:kworker.0 00000100:00100000:0.0:1783441566.404665:0:3303:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff91a877face00 x1870073693298816/t0(0) o250->MGC192.168.201.113@tcp@0@lo:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1783441566.404727:0:3302:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff91a877face00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:6c1ddb50-5795-40c6-a2b6-8f58add9da62:3302:1870073693298816:0@lo:250:ptlrpcd_00_00.0 00000100:00100000:0.0:1783441566.404857:0:3303:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff91a745550a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:6c1ddb50-5795-40c6-a2b6-8f58add9da62:3303:1870073693298688:0@lo:103:ldlm_bl.0 00000400:00000100:1.0:1783441566.405330:0:3302:0:(lib-move.c:4262:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 26 match 1870073693298816 offset 0 length 520: 4 00010000:00010000:3.0:1783441566.896208:0:5773:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:0.0:1783441567.667411:0:7492:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000020:00000080:0.0:1783441567.667430:0:7492:0:(genops.c:906:class_export_put()) final put ffff91a8748ec800/lustre-MDT0000-mdtlov_UUID 00000020:00000080:0.0:1783441567.667465:0:365:0:(genops.c:865:class_export_destroy()) destroying export ffff91a8748ec800/lustre-MDT0000-mdtlov_UUID for lustre-OST0001 00000020:00000080:0.0:1783441567.667499:0:365:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff91a8748ed800 for lustre-OST0001 00010000:00010000:1.0:1783441567.917160:0:5772:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783441568.942764:0:5773:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:3.0:1783441569.132889:0:33:0:(pinger.c:229:ptlrpc_pinger_process_import()) 6c1ddb50-5795-40c6-a2b6-8f58add9da62->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1783441569.132900:0:33:0:(pinger.c:247:ptlrpc_pinger_process_import()) 6c1ddb50-5795-40c6-a2b6-8f58add9da62->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:3.0:1783441569.132972:0:3306:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1783441569.132994:0:3306:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff91a874dcd180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3306:1870073693298944:0@lo:400:kworker.0 00000400:00000100:3.0:1783441569.133615:0:3306:0:(lib-move.c:4262:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1870073693298944 offset 0 length 224: 4 00010000:00010000:1.0:1783441569.965923:0:5772:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783441570.989038:0:5773:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:3.0:1783441571.180887:0:33:0:(pinger.c:229:ptlrpc_pinger_process_import()) 6c1ddb50-5795-40c6-a2b6-8f58add9da62->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1783441571.180899:0:33:0:(pinger.c:247:ptlrpc_pinger_process_import()) 6c1ddb50-5795-40c6-a2b6-8f58add9da62->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:3.0:1783441571.180993:0:3306:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff91a874dced80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3306:1870073693299072:0@lo:400:kworker.0 00000400:00000100:3.0:1783441571.181066:0:3306:0:(lib-move.c:4262:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1870073693299072 offset 0 length 224: 4 00010000:00010000:1.0:1783441572.013697:0:5772:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783441573.037012:0:5773:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783441574.061018:0:5772:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783441575.085952:0:5773:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783441576.111292:0:5772:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:3.0:1783441576.301147:0:33:0:(pinger.c:229:ptlrpc_pinger_process_import()) 6c1ddb50-5795-40c6-a2b6-8f58add9da62->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1783441576.301158:0:33:0:(pinger.c:247:ptlrpc_pinger_process_import()) 6c1ddb50-5795-40c6-a2b6-8f58add9da62->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:1.0:1783441576.301291:0:3303:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff91a874dcca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3303:1870073693299200:0@lo:400:kworker.0 00000400:00000100:1.0:1783441576.301360:0:3303:0:(lib-move.c:4262:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1870073693299200 offset 0 length 224: 4 00000100:00100000:2.0:1783441576.815027:0:3302:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1783441566/real 1783441566] req@ffff91a877face00 x1870073693298816/t0(0) o250->MGC192.168.201.113@tcp@0@lo:26/25 lens 520/544 e 0 to 1 dl 1783441576 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'ptlrpcd_00_00.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1783441576.815062:0:3302:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff91a877face00 x1870073693298816/t0(0) o250->MGC192.168.201.113@tcp@0@lo:26/25 lens 520/544 e 0 to 1 dl 1783441576 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'ptlrpcd_00_00.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1783441576.815075:0:3302:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1783441566/real 1783441566] req@ffff91a874dcfb80 x1870073693298560/t0(0) o39->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 1 dl 1783441576 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'umount.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1783441576.815087:0:3302:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff91a874dcfb80 x1870073693298560/t0(0) o39->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 1 dl 1783441576 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'umount.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1783441576.815130:0:3302:0:(import.c:65:import_set_state_nolock()) ffff91a8476ec000 MGS: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1783441576.815148:0:3302:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of MGS on 0@lo failed (-110) 00000100:00100000:2.0:1783441576.815153:0:3302:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff91a877face00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:6c1ddb50-5795-40c6-a2b6-8f58add9da62:3302:1870073693298816:0@lo:250:ptlrpcd_00_00.0 00000100:00080000:2.0:1783441576.815158:0:3302:0:(import.c:65:import_set_state_nolock()) ffff91a877f8a800 lustre-MDT0000_UUID: changing import state from CONNECTING to CLOSED 00000100:00100000:2.0:1783441576.815178:0:3302:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff91a874dcfb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3302:1870073693298560:0@lo:39:umount.0 00000100:00080000:2.0:1783441576.815212:0:12113:0:(pinger.c:229:ptlrpc_pinger_process_import()) 6c1ddb50-5795-40c6-a2b6-8f58add9da62->MGS: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1783441576.815217:0:12113:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery 00000100:00080000:2.0:1783441576.815219:0:12113:0:(import.c:65:import_set_state_nolock()) ffff91a8476ec000 MGS: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1783441576.815224:0:12113:0:(import.c:510:import_select_connection()) MGC192.168.201.113@tcp: connect to NID 0@lo last attempt 404 00000100:00080000:2.0:1783441576.815229:0:12113:0:(import.c:589:import_select_connection()) MGC192.168.201.113@tcp: tried all connections, increasing latency to 5s 00000100:00080000:2.0:1783441576.815235:0:12113:0:(import.c:624:import_select_connection()) MGC192.168.201.113@tcp: import ffff91a8476ec000 using connection 192.168.201.113@tcp/0@lo 00000100:00100000:2.0:1783441576.815267:0:12113:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff91a859086300 x1870073693299328/t0(0) o250->MGC192.168.201.113@tcp@0@lo:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1783441576.815298:0:3302:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff91a859086300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:6c1ddb50-5795-40c6-a2b6-8f58add9da62:3302:1870073693299328:0@lo:250:kworker.0 00000100:00080000:3.0:1783441576.815423:0:12962:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:3.0:1783441576.815428:0:12962:0:(client.c:3112:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0000: committing for last_committed 0 gen 4 00000100:00100000:3.0:1783441576.815433:0:12962:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00010000:00010000:3.0:1783441576.816409:0:12962:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.113@tcp lock: ffff91a840031000/0xa2426164df2c7789 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xa2426164df2c7790 expref: -99 pid: 5783 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783441576.816423:0:12962:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.113@tcp lock: ffff91a840031000/0xa2426164df2c7789 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0xa2426164df2c7790 expref: -99 pid: 5783 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783441576.816429:0:12962:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.113@tcp lock: ffff91a840031000/0xa2426164df2c7789 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000400000000 nid: local remote: 0xa2426164df2c7790 expref: -99 pid: 5783 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783441576.816436:0:12962:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.201.113@tcp lock: ffff91a840031000/0xa2426164df2c7789 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000400000000 nid: local remote: 0xa2426164df2c7790 expref: -99 pid: 5783 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783441576.816454:0:12962:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1783441576.816460:0:12962:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.113@tcp lock: ffff91a841477800/0xa2426164df2c79b2 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xa2426164df2c79b9 expref: -99 pid: 5783 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783441576.816466:0:12962:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.113@tcp lock: ffff91a841477800/0xa2426164df2c79b2 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xa2426164df2c79b9 expref: -99 pid: 5783 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783441576.816472:0:12962:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.113@tcp lock: ffff91a841477800/0xa2426164df2c79b2 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0xa2426164df2c79b9 expref: -99 pid: 5783 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783441576.816478:0:12962:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.201.113@tcp lock: ffff91a841477800/0xa2426164df2c79b2 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0xa2426164df2c79b9 expref: -99 pid: 5783 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783441576.816499:0:12962:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 10000000:01000000:3.0:1783441576.816503:0:12962:0:(mgc_request.c:547:config_log_end()) end config log lustre-OST0000 (0) 00000020:01000004:3.0:1783441576.816527:0:12962:0:(tgt_mount.c:2113:server_put_super()) stopping lustre-OST0000 00000020:01000000:3.0:1783441576.816532:0:12962:0:(obd_config.c:2475:class_manual_cleanup()) Manual cleanup of lustre-OST0000 (flags='F') 00000020:00000080:3.0:1783441576.816537:0:12962:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:3.0:1783441576.816542:0:12962:0:(obd_config.c:955:class_cleanup()) lustre-OST0000: forcing exports to disconnect: 0/1 00000020:00080000:3.0:1783441576.816555:0:12962:0:(genops.c:1579:class_disconnect_exports()) OBD device 11 (ffff91a85021b380) has no exports 00000020:00080000:3.0:1783441576.816578:0:12962:0:(genops.c:1579:class_disconnect_exports()) OBD device 11 (ffff91a85021b380) has no exports 00000020:01000000:3.0:1783441576.818466:0:12962:0:(lprocfs_status_server.c:306:lprocfs_free_client_stats()) stat ffff91a8748b2c00 - data ffff91a8627e0870/ffff91a87537f800 00010000:00010000:1.0:1783441576.818729:0:5772:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1783441576.818739:0:5772:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.113@tcp lock: ffff91a840031000/0xa2426164df2c7789 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000400000000 nid: local remote: 0xa2426164df2c7790 expref: -99 pid: 5783 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783441576.818786:0:5772:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91a840031000 already unused, calling callback (ffffffffc1b78c20) 10000000:00010000:1.0:1783441576.818791:0:5772:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.113@tcp lock: ffff91a840031000/0xa2426164df2c7789 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000400000000 nid: local remote: 0xa2426164df2c7790 expref: -99 pid: 5783 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783441576.818801:0:5772:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.113@tcp lock: ffff91a840031000/0xa2426164df2c7789 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1008400000000 nid: local remote: 0xa2426164df2c7790 expref: -99 pid: 5783 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1783441576.818809:0:5772:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.113@tcp lock: ffff91a840031000/0xa2426164df2c7789 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1009400000000 nid: local remote: 0xa2426164df2c7790 expref: -99 pid: 5783 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1783441576.818815:0:5772:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:1.0:1783441576.818818:0:5772:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-OST0000: stopping, won't requeue 10000000:01000000:1.0:1783441576.818821:0:5772:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-OST0000 00010000:00010000:1.0:1783441576.818855:0:5772:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff91a8476ec000 00010000:00010000:1.0:1783441576.818860:0:5772:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.113@tcp lock: ffff91a840031000/0xa2426164df2c7789 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5809400000000 nid: local remote: 0xa2426164df2c7790 expref: -99 pid: 5783 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783441576.818867:0:5772:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.113@tcp lock: ffff91a840031000/0xa2426164df2c7789 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5809400000000 nid: local remote: 0xa2426164df2c7790 expref: -99 pid: 5783 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783441576.818879:0:5772:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1783441576.818883:0:5772:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.113@tcp lock: ffff91a841477800/0xa2426164df2c79b2 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0xa2426164df2c79b9 expref: -99 pid: 5783 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783441576.818888:0:5772:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91a841477800 already unused, calling callback (ffffffffc1b78c20) 10000000:00010000:1.0:1783441576.818890:0:5772:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.113@tcp lock: ffff91a841477800/0xa2426164df2c79b2 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0xa2426164df2c79b9 expref: -99 pid: 5783 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783441576.818897:0:5772:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.113@tcp lock: ffff91a841477800/0xa2426164df2c79b2 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1008400000000 nid: local remote: 0xa2426164df2c79b9 expref: -99 pid: 5783 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1783441576.818903:0:5772:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.113@tcp lock: ffff91a841477800/0xa2426164df2c79b2 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1009400000000 nid: local remote: 0xa2426164df2c79b9 expref: -99 pid: 5783 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1783441576.818909:0:5772:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 10000000:01000000:1.0:1783441576.818911:0:5772:0:(mgc_request.c:944:mgc_blocking_ast()) log params: stopping, won't requeue 10000000:01000000:1.0:1783441576.818913:0:5772:0:(mgc_request.c:130:config_log_put()) dropping config log params 00010000:00010000:1.0:1783441576.818917:0:5772:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff91a8476ec000 00010000:00010000:1.0:1783441576.818920:0:5772:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.113@tcp lock: ffff91a841477800/0xa2426164df2c79b2 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000000 nid: local remote: 0xa2426164df2c79b9 expref: -99 pid: 5783 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783441576.818926:0:5772:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.113@tcp lock: ffff91a841477800/0xa2426164df2c79b2 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000000 nid: local remote: 0xa2426164df2c79b9 expref: -99 pid: 5783 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783441576.818956:0:5772:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783441576.818958:0:5772:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783441576.818960:0:5772:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000400:00000100:2.0:1783441576.819204:0:3302:0:(lib-move.c:4262:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 26 match 1870073693299328 offset 0 length 520: 4 00010000:00010000:0.0:1783441576.821671:0:5773:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000000:3.0:1783441576.829227:0:12962:0:(lprocfs_status_server.c:306:lprocfs_free_client_stats()) stat ffff91a845779780 - data ffff91a872f765e8/ffff91a876fe8c00 00100000:10000000:3.0:1783441576.848878:0:12962:0:(lfsck_layout.c:753:lfsck_rbtree_cleanup()) lustre-OST0000-osd: layout LFSCK fini OST-objects accessing bitmap 00000020:00000080:1.0:1783441576.884594:0:12962:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xa2426164df2c758a 00000020:00000080:1.0:1783441576.884605:0:12962:0:(genops.c:906:class_export_put()) final put ffff91a74494e000/lustre-OST0000-osd_UUID 00000020:00000080:1.0:1783441576.884622:0:59:0:(genops.c:865:class_export_destroy()) destroying export ffff91a74494e000/lustre-OST0000-osd_UUID for lustre-OST0000-osd 00000020:01000004:1.0:1783441576.884633:0:12962:0:(tgt_mount.c:187:server_put_mount()) put mount ffff91a867cf2000 from lustre-OST0000, refs=2 00000020:01000004:1.0:1783441576.884637:0:12962:0:(obd_mount.c:710:lustre_put_lsi()) put ffff91a867cf2000 2 00000020:01000004:1.0:1783441576.884639:0:12962:0:(tgt_mount.c:120:server_deregister_mount()) deregister mount ffff91a867cf2000 from lustre-OST0000 00000020:00000080:1.0:1783441576.884664:0:12962:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1783441576.884674:0:12962:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0000 (uuid lustre-OST0000_UUID) 00000020:00000080:1.0:1783441576.884678:0:12962:0:(genops.c:906:class_export_put()) final put ffff91a8495a4800/lustre-OST0000_UUID 00000020:00000080:1.0:1783441576.884680:0:12962:0:(genops.c:865:class_export_destroy()) destroying export ffff91a8495a4800/lustre-OST0000_UUID for lustre-OST0000 00000020:01000000:1.0:1783441576.884687:0:12962:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0000 (lustre-OST0000_UUID) 00000020:01000004:1.0:1783441576.884728:0:12962:0:(obd_mount.c:578:lustre_stop_mgc()) MGC still has 1 references. 00000020:01000000:1.0:1783441576.884733:0:12962:0:(obd_config.c:2475:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-lwp-OST0000 (flags='F') 00000020:00000080:1.0:1783441576.884737:0:12962:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1783441576.884778:0:12962:0:(obd_config.c:955:class_cleanup()) lustre-MDT0000-lwp-OST0000: forcing exports to disconnect: 1/3 00000020:00080000:1.0:1783441576.884788:0:12962:0:(genops.c:1840:print_export_data()) lustre-MDT0000-lwp-OST0000: ACTIVE ffff91a877f88800 lustre-MDT0000-lwp-OST0000 0@lo 3 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:1.0:1783441576.884794:0:12962:0:(genops.c:1574:class_disconnect_exports()) OBD device 12 (ffff91a877f799c0) has exports, disconnecting them 00000020:00080000:1.0:1783441576.884799:0:12962:0:(genops.c:1549:class_disconnect_export_list()) lustre-MDT0000-lwp-OST0000: disconnecting export at 0@lo (ffff91a877f88800), last request at 1783441339 00000020:00000080:1.0:1783441576.884804:0:12962:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xa2426164df2c75b4 00000020:00080000:1.0:1783441576.884812:0:12962:0:(genops.c:1554:class_disconnect_export_list()) disconnected export at 0@lo (ffff91a877f88800): rc 0 00000020:00000080:1.0:1783441576.884817:0:12962:0:(genops.c:906:class_export_put()) final put ffff91a877f88800/lustre-MDT0000-lwp-OST0000 00000020:00000080:1.0:1783441576.884836:0:59:0:(genops.c:865:class_export_destroy()) destroying export ffff91a877f88800/lustre-MDT0000-lwp-OST0000 for lustre-MDT0000-lwp-OST0000 00010000:01000000:0.0:1783441576.890569:0:12962:0:(obd_class.h:671:obd_cleanup_client_import()) lustre-MDT0000-lwp-OST0000: client import never connected 00000100:00080000:0.0:1783441576.890579:0:12962:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:0.0:1783441576.890584:0:12962:0:(client.c:3112:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0000: committing for last_committed 0 gen 5 00000100:00100000:0.0:1783441576.890591:0:12962:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:0.0:1783441576.890621:0:365:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff91a877f8a800 for lustre-MDT0000-lwp-OST0000 00000020:00000080:0.0:1783441576.890784:0:12962:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1783441576.890794:0:12962:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-lwp-OST0000 (uuid lustre-MDT0000-lwp-OST0000_UUID) 00000020:00000080:0.0:1783441576.890801:0:12962:0:(genops.c:906:class_export_put()) final put ffff91a865519000/lustre-MDT0000-lwp-OST0000_UUID 00000020:00000080:0.0:1783441576.890805:0:12962:0:(genops.c:865:class_export_destroy()) destroying export ffff91a865519000/lustre-MDT0000-lwp-OST0000_UUID for lustre-MDT0000-lwp-OST0000 00000020:01000000:0.0:1783441576.890817:0:12962:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-lwp-OST0000 (lustre-MDT0000-lwp-OST0000_UUID) 00000020:01000004:0.0:1783441576.890884:0:12962:0:(obd_mount.c:710:lustre_put_lsi()) put ffff91a867cf2000 1 00000020:00000080:0.0:1783441576.890890:0:12962:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xa2426164df2c7544 00000020:00000080:0.0:1783441576.890896:0:12962:0:(genops.c:906:class_export_put()) final put ffff91a867cf5800/lustre-OST0000-osd_UUID 00000020:01000000:0.0:1783441576.890903:0:12962:0:(obd_config.c:2475:class_manual_cleanup()) Manual cleanup of lustre-OST0000-osd (flags='') 00000020:00000080:0.0:1783441576.890911:0:365:0:(genops.c:865:class_export_destroy()) destroying export ffff91a867cf5800/lustre-OST0000-osd_UUID for lustre-OST0000-osd 00000020:00000080:0.0:1783441576.890920:0:12962:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1783441576.890925:0:12962:0:(obd_config.c:955:class_cleanup()) lustre-OST0000-osd: forcing exports to disconnect: 0/1 00000020:00080000:0.0:1783441576.890929:0:12962:0:(genops.c:1579:class_disconnect_exports()) OBD device 9 (ffff91a851570000) has no exports 00000020:00000080:2.0:1783441576.918265:0:12962:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1783441576.918281:0:12962:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0000-osd (uuid lustre-OST0000-osd_UUID) 00000020:00000080:2.0:1783441576.918288:0:12962:0:(genops.c:906:class_export_put()) final put ffff91a867cf1000/lustre-OST0000-osd_UUID 00000020:00000080:2.0:1783441576.918292:0:12962:0:(genops.c:865:class_export_destroy()) destroying export ffff91a867cf1000/lustre-OST0000-osd_UUID for lustre-OST0000-osd 00000020:01000000:2.0:1783441576.918305:0:12962:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0000-osd (lustre-OST0000-osd_UUID) 00000020:01000004:2.0:1783441576.918444:0:12962:0:(obd_mount.c:668:lustre_free_lsi()) Freeing lsi ffff91a867cf4800 00000020:02000400:2.0:1783441576.918489:0:12962:0:(tgt_mount.c:2182:server_put_super()) server umount lustre-OST0000 complete 00010000:00010000:1.0:1783441577.134598:0:5772:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783441578.158842:0:5773:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783441579.185154:0:5772:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783441580.212948:0:5773:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:1.0:1783441580.247295:0:13116:0:(tgt_mount.c:2193:server_umount_begin()) umount -f 00000020:01000004:1.0:1783441580.256963:0:13116:0:(tgt_mount.c:2063:server_put_super()) server put_super lustre-OST0001 00010000:00010000:1.0:1783441580.257046:0:13116:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.113@tcp lock: ffff91a85f83c200/0xa2426164df2c775f lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xa2426164df2c7766 expref: -99 pid: 5783 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783441580.257063:0:13116:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.113@tcp lock: ffff91a85f83c200/0xa2426164df2c775f lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0xa2426164df2c7766 expref: -99 pid: 5783 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783441580.257071:0:13116:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.113@tcp lock: ffff91a85f83c200/0xa2426164df2c775f lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000400000000 nid: local remote: 0xa2426164df2c7766 expref: -99 pid: 5783 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783441580.257078:0:13116:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.201.113@tcp lock: ffff91a85f83c200/0xa2426164df2c775f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000400000000 nid: local remote: 0xa2426164df2c7766 expref: -99 pid: 5783 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783441580.257098:0:13116:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:1.0:1783441580.257104:0:13116:0:(mgc_request.c:547:config_log_end()) end config log lustre-client (0) 00010000:00010000:2.0:1783441580.257123:0:5772:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00000100:00080000:1.0:1783441580.257136:0:13116:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:1.0:1783441580.257153:0:13116:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff91a874dce680 x1870073693298432/t0(0) o400->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1783441580 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00010000:00010000:2.0:1783441580.257161:0:5772:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.113@tcp lock: ffff91a85f83c200/0xa2426164df2c775f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000400000000 nid: local remote: 0xa2426164df2c7766 expref: -99 pid: 5783 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783441580.257169:0:5772:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91a85f83c200 already unused, calling callback (ffffffffc1b78c20) 10000000:00010000:2.0:1783441580.257174:0:5772:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.113@tcp lock: ffff91a85f83c200/0xa2426164df2c775f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000400000000 nid: local remote: 0xa2426164df2c7766 expref: -99 pid: 5783 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783441580.257174:0:13116:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff91a874dcd180 x1870073693298944/t0(0) o400->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1783441585 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00010000:00010000:2.0:1783441580.257185:0:5772:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.113@tcp lock: ffff91a85f83c200/0xa2426164df2c775f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1008400000000 nid: local remote: 0xa2426164df2c7766 expref: -99 pid: 5783 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1783441580.257193:0:5772:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.113@tcp lock: ffff91a85f83c200/0xa2426164df2c775f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1009400000000 nid: local remote: 0xa2426164df2c7766 expref: -99 pid: 5783 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1783441580.257203:0:5772:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:2.0:1783441580.257206:0:5772:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-client: stopping, won't requeue 10000000:01000000:2.0:1783441580.257209:0:5772:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-client 00010000:00010000:2.0:1783441580.257226:0:5772:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff91a8476ec000 00010000:00010000:2.0:1783441580.257230:0:5772:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.113@tcp lock: ffff91a85f83c200/0xa2426164df2c775f lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000000 nid: local remote: 0xa2426164df2c7766 expref: -99 pid: 5783 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783441580.257237:0:5772:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.113@tcp lock: ffff91a85f83c200/0xa2426164df2c775f lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000000 nid: local remote: 0xa2426164df2c7766 expref: -99 pid: 5783 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783441580.257248:0:5772:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783441580.257250:0:5772:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783441580.257252:0:5772:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1783441580.257320:0:3304:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff91a874dce680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3304:1870073693298432:0@lo:400:kworker.0 00000100:00100000:1.0:1783441580.257346:0:13116:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff91a874dced80 x1870073693299072/t0(0) o400->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1783441587 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1783441580.257529:0:13116:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff91a874dcca80 x1870073693299200/t0(0) o400->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1783441592 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1783441580.257552:0:13116:0:(client.c:3112:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0001: committing for last_committed 0 gen 3 00000100:00080000:1.0:1783441580.257559:0:13116:0:(pinger.c:399:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID 00000100:00100000:2.0:1783441580.257602:0:3303:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff91a874dcca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3303:1870073693299200:0@lo:400:kworker.0 00000100:00080000:1.0:1783441580.257963:0:13116:0:(import.c:65:import_set_state_nolock()) ffff91a745262800 lustre-MDT0000_UUID: changing import state from FULL to CONNECTING 00000100:00100000:2.0:1783441580.258041:0:3302:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff91a745553800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3302:1870073693299456:0@lo:39:umount.0 00000400:00000100:2.0:1783441580.258106:0:3302:0:(lib-move.c:4262:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1870073693299456 offset 0 length 224: 4 00000100:00100000:3.0:1783441580.258356:0:3306:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff91a874dced80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3306:1870073693299072:0@lo:400:kworker.0 00000100:00100000:3.0:1783441580.258366:0:3306:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff91a874dcd180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3306:1870073693298944:0@lo:400:kworker.0 00010000:00010000:2.0:1783441581.232610:0:5773:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:2.0:1783441581.934807:0:12113:0:(pinger.c:229:ptlrpc_pinger_process_import()) 6c1ddb50-5795-40c6-a2b6-8f58add9da62->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1783441581.934822:0:12113:0:(pinger.c:247:ptlrpc_pinger_process_import()) 6c1ddb50-5795-40c6-a2b6-8f58add9da62->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00010000:00010000:2.0:1783441582.256923:0:5772:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783441583.277881:0:5773:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783441584.302450:0:5772:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783441585.325249:0:5773:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783441586.355168:0:5772:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:2.0:1783441587.052991:0:12113:0:(pinger.c:229:ptlrpc_pinger_process_import()) 6c1ddb50-5795-40c6-a2b6-8f58add9da62->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1783441587.053009:0:12113:0:(pinger.c:247:ptlrpc_pinger_process_import()) 6c1ddb50-5795-40c6-a2b6-8f58add9da62->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00010000:00010000:2.0:1783441587.375018:0:5773:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783441588.396980:0:5772:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783441589.421212:0:5773:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783441590.445025:0:5772:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1783441590.509025:0:3302:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1783441580/real 1783441580] req@ffff91a745553800 x1870073693299456/t0(0) o39->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 1 dl 1783441590 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'umount.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1783441590.512765:0:3302:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff91a745553800 x1870073693299456/t0(0) o39->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 1 dl 1783441590 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'umount.0' uid:0 gid:0 projid:4294967295 00000100:00080000:1.0:1783441590.512798:0:3302:0:(import.c:65:import_set_state_nolock()) ffff91a745262800 lustre-MDT0000_UUID: changing import state from CONNECTING to CLOSED 00000100:00100000:1.0:1783441590.512824:0:3302:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff91a745553800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3302:1870073693299456:0@lo:39:umount.0 00000100:00080000:2.0:1783441590.512985:0:13116:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:2.0:1783441590.512990:0:13116:0:(client.c:3112:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0001: committing for last_committed 0 gen 4 00000100:00100000:2.0:1783441590.512994:0:13116:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00010000:00010000:2.0:1783441590.514004:0:13116:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.113@tcp lock: ffff91a840030800/0xa2426164df2c776d lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xa2426164df2c7774 expref: -99 pid: 5783 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783441590.514019:0:13116:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.113@tcp lock: ffff91a840030800/0xa2426164df2c776d lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xa2426164df2c7774 expref: -99 pid: 5783 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783441590.514027:0:13116:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.113@tcp lock: ffff91a840030800/0xa2426164df2c776d lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0xa2426164df2c7774 expref: -99 pid: 5783 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783441590.514035:0:13116:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.201.113@tcp lock: ffff91a840030800/0xa2426164df2c776d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0xa2426164df2c7774 expref: -99 pid: 5783 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783441590.514050:0:13116:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1783441590.514089:0:13116:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.113@tcp lock: ffff91a85f83d200/0xa2426164df2c79a4 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xa2426164df2c79ab expref: -99 pid: 5783 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783441590.514097:0:13116:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.113@tcp lock: ffff91a85f83d200/0xa2426164df2c79a4 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xa2426164df2c79ab expref: -99 pid: 5783 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783441590.514103:0:13116:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.113@tcp lock: ffff91a85f83d200/0xa2426164df2c79a4 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0xa2426164df2c79ab expref: -99 pid: 5783 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783441590.514109:0:13116:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.201.113@tcp lock: ffff91a85f83d200/0xa2426164df2c79a4 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0xa2426164df2c79ab expref: -99 pid: 5783 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783441590.514134:0:13116:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 10000000:01000000:2.0:1783441590.514138:0:13116:0:(mgc_request.c:547:config_log_end()) end config log lustre-OST0001 (0) 00000020:01000004:2.0:1783441590.514161:0:13116:0:(tgt_mount.c:2113:server_put_super()) stopping lustre-OST0001 00000020:01000000:2.0:1783441590.514165:0:13116:0:(obd_config.c:2475:class_manual_cleanup()) Manual cleanup of lustre-OST0001 (flags='F') 00000020:00000080:2.0:1783441590.514170:0:13116:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1783441590.514175:0:13116:0:(obd_config.c:955:class_cleanup()) lustre-OST0001: forcing exports to disconnect: 0/1 00000020:00080000:2.0:1783441590.514179:0:13116:0:(genops.c:1579:class_disconnect_exports()) OBD device 15 (ffff91a877f7b380) has no exports 00000020:00080000:2.0:1783441590.514202:0:13116:0:(genops.c:1579:class_disconnect_exports()) OBD device 15 (ffff91a877f7b380) has no exports 00000020:01000000:2.0:1783441590.516123:0:13116:0:(lprocfs_status_server.c:306:lprocfs_free_client_stats()) stat ffff91a8748b20c0 - data ffff91a7447c1288/ffff91a87537cc00 00000020:01000000:2.0:1783441590.516321:0:13116:0:(lprocfs_status_server.c:306:lprocfs_free_client_stats()) stat ffff91a8748b2b40 - data ffff91a862753870/ffff91a87d4f8c00 00010000:00010000:0.0:1783441590.517530:0:5773:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1783441590.517543:0:5773:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.113@tcp lock: ffff91a840030800/0xa2426164df2c776d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0xa2426164df2c7774 expref: -99 pid: 5783 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783441590.517555:0:5773:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91a840030800 already unused, calling callback (ffffffffc1b78c20) 10000000:00010000:0.0:1783441590.517559:0:5773:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.113@tcp lock: ffff91a840030800/0xa2426164df2c776d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0xa2426164df2c7774 expref: -99 pid: 5783 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783441590.517588:0:5773:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.113@tcp lock: ffff91a840030800/0xa2426164df2c776d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1008400000000 nid: local remote: 0xa2426164df2c7774 expref: -99 pid: 5783 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1783441590.517596:0:5773:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.113@tcp lock: ffff91a840030800/0xa2426164df2c776d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1009400000000 nid: local remote: 0xa2426164df2c7774 expref: -99 pid: 5783 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1783441590.517603:0:5773:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:0.0:1783441590.517606:0:5773:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-OST0001: stopping, won't requeue 10000000:01000000:0.0:1783441590.517609:0:5773:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-OST0001 00010000:00010000:0.0:1783441590.517624:0:5773:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff91a8476ec000 00010000:00010000:0.0:1783441590.517628:0:5773:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.113@tcp lock: ffff91a840030800/0xa2426164df2c776d lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000000 nid: local remote: 0xa2426164df2c7774 expref: -99 pid: 5783 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783441590.517635:0:5773:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.113@tcp lock: ffff91a840030800/0xa2426164df2c776d lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000000 nid: local remote: 0xa2426164df2c7774 expref: -99 pid: 5783 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783441590.517661:0:5773:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1783441590.517665:0:5773:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.113@tcp lock: ffff91a85f83d200/0xa2426164df2c79a4 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0xa2426164df2c79ab expref: -99 pid: 5783 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783441590.517671:0:5773:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91a85f83d200 already unused, calling callback (ffffffffc1b78c20) 10000000:00010000:0.0:1783441590.517674:0:5773:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.113@tcp lock: ffff91a85f83d200/0xa2426164df2c79a4 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0xa2426164df2c79ab expref: -99 pid: 5783 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783441590.517681:0:5773:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.113@tcp lock: ffff91a85f83d200/0xa2426164df2c79a4 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1008400000000 nid: local remote: 0xa2426164df2c79ab expref: -99 pid: 5783 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1783441590.517688:0:5773:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.113@tcp lock: ffff91a85f83d200/0xa2426164df2c79a4 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1009400000000 nid: local remote: 0xa2426164df2c79ab expref: -99 pid: 5783 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1783441590.517701:0:5773:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 10000000:01000000:0.0:1783441590.517704:0:5773:0:(mgc_request.c:944:mgc_blocking_ast()) log params: stopping, won't requeue 10000000:01000000:0.0:1783441590.517715:0:5773:0:(mgc_request.c:130:config_log_put()) dropping config log params 00010000:00010000:0.0:1783441590.517721:0:5773:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff91a8476ec000 00010000:00010000:0.0:1783441590.517723:0:5773:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.113@tcp lock: ffff91a85f83d200/0xa2426164df2c79a4 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000000 nid: local remote: 0xa2426164df2c79ab expref: -99 pid: 5783 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783441590.517730:0:5773:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.113@tcp lock: ffff91a85f83d200/0xa2426164df2c79a4 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000000 nid: local remote: 0xa2426164df2c79ab expref: -99 pid: 5783 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783441590.517777:0:5773:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783441590.517779:0:5773:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783441590.517781:0:5773:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783441590.519053:0:5772:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00100000:10000000:2.0:1783441590.531438:0:13116:0:(lfsck_layout.c:753:lfsck_rbtree_cleanup()) lustre-OST0001-osd: layout LFSCK fini OST-objects accessing bitmap 00000020:00000080:0.0:1783441590.592087:0:13116:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xa2426164df2c7663 00000020:00000080:0.0:1783441590.592098:0:13116:0:(genops.c:906:class_export_put()) final put ffff91a7466c2000/lustre-OST0001-osd_UUID 00000020:00000080:0.0:1783441590.592112:0:365:0:(genops.c:865:class_export_destroy()) destroying export ffff91a7466c2000/lustre-OST0001-osd_UUID for lustre-OST0001-osd 00000020:01000004:0.0:1783441590.592122:0:13116:0:(tgt_mount.c:187:server_put_mount()) put mount ffff91a875566000 from lustre-OST0001, refs=2 00000020:01000004:0.0:1783441590.592125:0:13116:0:(obd_mount.c:710:lustre_put_lsi()) put ffff91a875566000 2 00000020:01000004:0.0:1783441590.592128:0:13116:0:(tgt_mount.c:120:server_deregister_mount()) deregister mount ffff91a875566000 from lustre-OST0001 00000020:00000080:0.0:1783441590.592154:0:13116:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1783441590.592164:0:13116:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0001 (uuid lustre-OST0001_UUID) 00000020:00000080:0.0:1783441590.592167:0:13116:0:(genops.c:906:class_export_put()) final put ffff91a877f89000/lustre-OST0001_UUID 00000020:00000080:0.0:1783441590.592169:0:13116:0:(genops.c:865:class_export_destroy()) destroying export ffff91a877f89000/lustre-OST0001_UUID for lustre-OST0001 00000020:01000000:0.0:1783441590.592176:0:13116:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0001 (lustre-OST0001_UUID) 00000100:00080000:0.0:1783441590.592284:0:13116:0:(pinger.c:399:ptlrpc_pinger_del_import()) removing pingable import 6c1ddb50-5795-40c6-a2b6-8f58add9da62->MGS 00010000:00010000:0.0:1783441590.592300:0:13116:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.113@tcp lock: ffff91a85f83de00/0xa2426164df2c7567 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x1008400000000 nid: local remote: 0xa2426164df2c756e expref: -99 pid: 6577 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1783441590.592311:0:13116:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.113@tcp lock: ffff91a85f83de00/0xa2426164df2c7567 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x1009400000000 nid: local remote: 0xa2426164df2c756e expref: -99 pid: 6577 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1783441590.592327:0:13116:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x70616d65646f6e:0x4:0x0].0x0 (nodemap) 10000000:01000000:0.0:1783441590.592330:0:13116:0:(mgc_request.c:954:mgc_blocking_ast()) log nodemap: disconnecting, won't requeue 10000000:01000000:0.0:1783441590.592333:0:13116:0:(mgc_request.c:130:config_log_put()) dropping config log nodemap 00010000:00010000:0.0:1783441590.592347:0:13116:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff91a8476ec000 00010000:00010000:0.0:1783441590.592350:0:13116:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.113@tcp lock: ffff91a85f83de00/0xa2426164df2c7567 lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000000 nid: local remote: 0xa2426164df2c756e expref: -99 pid: 6577 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783441590.592364:0:13116:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.113@tcp lock: ffff91a85f83ce00/0xa2426164df2c77b3 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1008400000000 nid: local remote: 0xa2426164df2c77ba expref: -99 pid: 5783 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1783441590.592371:0:13116:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.113@tcp lock: ffff91a85f83ce00/0xa2426164df2c77b3 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1009400000000 nid: local remote: 0xa2426164df2c77ba expref: -99 pid: 5783 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1783441590.592376:0:13116:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:0.0:1783441590.592378:0:13116:0:(mgc_request.c:954:mgc_blocking_ast()) log lustre-s: disconnecting, won't requeue 10000000:01000000:0.0:1783441590.592379:0:13116:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-sptlrpc 00010000:00010000:0.0:1783441590.592387:0:13116:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff91a8476ec000 00010000:00010000:0.0:1783441590.592390:0:13116:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.113@tcp lock: ffff91a85f83ce00/0xa2426164df2c77b3 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000000 nid: local remote: 0xa2426164df2c77ba expref: -99 pid: 5783 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00080000:0.0:1783441590.592405:0:13116:0:(import.c:65:import_set_state_nolock()) ffff91a8476ec000 MGS: changing import state from CONNECTING to CLOSED 10000000:01000000:0.0:1783441590.592408:0:13116:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808001 00000100:00080000:0.0:1783441590.592411:0:13116:0:(pinger.c:193:ptlrpc_pinger_ir_down()) IR down 10000000:01000000:0.0:1783441590.592412:0:13116:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808002 00000100:00080000:0.0:1783441590.592416:0:13116:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import MGS INVALID 00000100:00100000:0.0:1783441590.592426:0:13116:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff91a859086300 x1870073693299328/t0(0) o250->MGC192.168.201.113@tcp@0@lo:26/25 lens 520/544 e 0 to 0 dl 1783441591 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 10000000:01000000:0.0:1783441590.592548:0:13116:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808002 00000100:00100000:0.0:1783441590.592552:0:13116:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 1s for inflight to error out 00000100:00100000:1.0:1783441590.592899:0:3302:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff91a859086300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:6c1ddb50-5795-40c6-a2b6-8f58add9da62:3302:1870073693299328:0@lo:250:kworker.0 10000000:01000000:0.0:1783441590.592954:0:13116:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808003 00000020:00000080:0.0:1783441590.592967:0:13116:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xa2426164df2c7456 00000020:00000080:0.0:1783441590.592972:0:13116:0:(genops.c:906:class_export_put()) final put ffff91a8476ed800/6c1ddb50-5795-40c6-a2b6-8f58add9da62 00000020:01000000:0.0:1783441590.592981:0:13116:0:(obd_config.c:2475:class_manual_cleanup()) Manual cleanup of MGC192.168.201.113@tcp (flags='') 00000020:00000080:0.0:1783441590.592988:0:365:0:(genops.c:865:class_export_destroy()) destroying export ffff91a8476ed800/6c1ddb50-5795-40c6-a2b6-8f58add9da62 for MGC192.168.201.113@tcp 00000020:00000080:0.0:1783441590.592997:0:13116:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1783441590.593003:0:13116:0:(obd_config.c:955:class_cleanup()) MGC192.168.201.113@tcp: forcing exports to disconnect: 0/2 00000020:00080000:0.0:1783441590.593007:0:13116:0:(genops.c:1579:class_disconnect_exports()) OBD device 2 (ffff91a84767cd40) has no exports 10000000:01000000:3.0:1783441590.593211:0:5783:0:(mgc_request.c:708:mgc_requeue_thread()) Ending requeue thread 10000000:01000000:0.0:1783441590.593357:0:13116:0:(obd_class.h:671:obd_cleanup_client_import()) MGC192.168.201.113@tcp: client import never connected 00000100:00080000:0.0:1783441590.593360:0:13116:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import MGS INVALID 10000000:01000000:0.0:1783441590.593362:0:13116:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808002 00000100:00100000:0.0:1783441590.593365:0:13116:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 10000000:01000000:0.0:1783441590.593366:0:13116:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808003 00000020:00000080:0.0:1783441590.593388:0:365:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff91a8476ec000 for MGC192.168.201.113@tcp 00000020:00000080:0.0:1783441590.593418:0:13116:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1783441590.593421:0:13116:0:(obd_config.c:883:class_detach()) detach on obd MGC192.168.201.113@tcp (uuid 6c1ddb50-5795-40c6-a2b6-8f58add9da62) 00000020:00000080:0.0:1783441590.593424:0:13116:0:(genops.c:906:class_export_put()) final put ffff91a8476e9000/6c1ddb50-5795-40c6-a2b6-8f58add9da62 00000020:00000080:0.0:1783441590.593427:0:13116:0:(genops.c:865:class_export_destroy()) destroying export ffff91a8476e9000/6c1ddb50-5795-40c6-a2b6-8f58add9da62 for MGC192.168.201.113@tcp 00000020:01000000:0.0:1783441590.593431:0:13116:0:(genops.c:441:class_free_dev()) finishing cleanup of obd MGC192.168.201.113@tcp (6c1ddb50-5795-40c6-a2b6-8f58add9da62) 00000020:01000000:0.0:1783441590.593851:0:13116:0:(obd_config.c:2475:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-lwp-OST0001 (flags='F') 00000020:00000080:0.0:1783441590.593855:0:13116:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1783441590.593860:0:13116:0:(obd_config.c:955:class_cleanup()) lustre-MDT0000-lwp-OST0001: forcing exports to disconnect: 1/3 00000020:00080000:0.0:1783441590.593865:0:13116:0:(genops.c:1840:print_export_data()) lustre-MDT0000-lwp-OST0001: ACTIVE ffff91a84869b800 lustre-MDT0000-lwp-OST0001 0@lo 3 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:0.0:1783441590.593871:0:13116:0:(genops.c:1574:class_disconnect_exports()) OBD device 16 (ffff91a85021cd40) has exports, disconnecting them 00000020:00080000:0.0:1783441590.593876:0:13116:0:(genops.c:1549:class_disconnect_export_list()) lustre-MDT0000-lwp-OST0001: disconnecting export at 0@lo (ffff91a84869b800), last request at 1783441357 00000020:00000080:0.0:1783441590.593879:0:13116:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xa2426164df2c768d 00000020:00080000:0.0:1783441590.593888:0:13116:0:(genops.c:1554:class_disconnect_export_list()) disconnected export at 0@lo (ffff91a84869b800): rc 0 00000020:00000080:0.0:1783441590.593892:0:13116:0:(genops.c:906:class_export_put()) final put ffff91a84869b800/lustre-MDT0000-lwp-OST0001 00000020:00000080:0.0:1783441590.593912:0:365:0:(genops.c:865:class_export_destroy()) destroying export ffff91a84869b800/lustre-MDT0000-lwp-OST0001 for lustre-MDT0000-lwp-OST0001 00010000:01000000:1.0:1783441590.610943:0:13116:0:(obd_class.h:671:obd_cleanup_client_import()) lustre-MDT0000-lwp-OST0001: client import never connected 00000100:00080000:1.0:1783441590.610952:0:13116:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:1.0:1783441590.610956:0:13116:0:(client.c:3112:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0001: committing for last_committed 0 gen 5 00000100:00100000:1.0:1783441590.610963:0:13116:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:1.0:1783441590.610992:0:59:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff91a745262800 for lustre-MDT0000-lwp-OST0001 00010000:00010000:1.0:1783441590.612826:0:5773:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 0 locks of 0 total in blp. (-1 blwis in pool) 00010000:00010000:1.0:1783441590.613001:0:5772:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 0 locks of 0 total in blp. (-2 blwis in pool) 00000100:00100000:3.0:1783441590.613137:0:5767:0:(service.c:3183:ptlrpc_main()) ldlm_cb00_000: service thread [ffff91a844b04000:5767] 0 exiting: rc = 1 00000100:00100000:1.0:1783441590.613384:0:5768:0:(service.c:3183:ptlrpc_main()) ldlm_cb00_001: service thread [ffff91a8590d4c00:5768] 1 exiting: rc = 0 00000100:00100000:3.0:1783441590.613469:0:13116:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783441590.613876:0:5769:0:(service.c:3183:ptlrpc_main()) ldlm_cn00_000: service thread [ffff91a85013d400:5769] 0 exiting: rc = 1 00000100:00100000:1.0:1783441590.613928:0:11514:0:(service.c:3183:ptlrpc_main()) ldlm_cn00_004: service thread [ffff91a7448c2e00:11514] 4 exiting: rc = 0 00000100:00100000:0.0:1783441590.614211:0:5770:0:(service.c:3183:ptlrpc_main()) ldlm_cn00_001: service thread [ffff91a85013c200:5770] 1 exiting: rc = 0 00000100:00100000:1.0:1783441590.620721:0:5771:0:(service.c:3183:ptlrpc_main()) ldlm_cn00_002: service thread [ffff91a846f65a00:5771] 2 exiting: rc = 0 00000100:00100000:3.0:1783441590.622831:0:11015:0:(service.c:3183:ptlrpc_main()) ldlm_cn00_003: service thread [ffff91a8755b3200:11015] 3 exiting: rc = 0 00000100:00100000:1.0:1783441590.623204:0:13116:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783441590.623212:0:13116:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783441590.623219:0:13116:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783441590.623224:0:13116:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783441590.623231:0:13116:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783441590.623236:0:13116:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783441590.623243:0:13116:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783441590.623250:0:13116:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783441590.623255:0:13116:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783441590.623260:0:13116:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783441590.623278:0:13116:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783441590.623285:0:13116:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783441590.623292:0:13116:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783441590.623298:0:13116:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783441590.623304:0:13116:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783441590.623310:0:13116:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783441590.623318:0:13116:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783441590.623323:0:13116:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783441590.623328:0:13116:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783441590.623335:0:13116:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783441590.623339:0:13116:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783441590.623344:0:13116:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783441590.623351:0:13116:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783441590.623356:0:13116:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783441590.623362:0:13116:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783441590.623367:0:13116:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783441590.623372:0:13116:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783441590.623377:0:13116:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783441590.623382:0:13116:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783441590.623387:0:13116:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783441590.623392:0:13116:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783441590.623397:0:13116:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783441590.623402:0:13116:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783441590.623406:0:13116:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783441590.623411:0:13116:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783441590.623417:0:13116:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783441590.623421:0:13116:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783441590.623427:0:13116:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783441590.623432:0:13116:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783441590.623437:0:13116:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783441590.623443:0:13116:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783441590.623448:0:13116:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783441590.623453:0:13116:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783441590.623459:0:13116:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783441590.623465:0:13116:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783441590.623475:0:13116:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783441590.623480:0:13116:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783441590.623486:0:13116:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783441590.623490:0:13116:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783441590.623494:0:13116:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783441590.623500:0:13116:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783441590.623505:0:13116:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783441590.623509:0:13116:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783441590.623514:0:13116:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783441590.623519:0:13116:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783441590.623525:0:13116:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783441590.623530:0:13116:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783441590.623535:0:13116:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783441590.623539:0:13116:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783441590.623545:0:13116:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783441590.623550:0:13116:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783441590.623555:0:13116:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783441590.623561:0:13116:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783441590.623566:0:13116:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000020:00000080:1.0:1783441590.624986:0:13116:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1783441590.624996:0:13116:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-lwp-OST0001 (uuid lustre-MDT0000-lwp-OST0001_UUID) 00000020:00000080:1.0:1783441590.625001:0:13116:0:(genops.c:906:class_export_put()) final put ffff91a8748ea800/lustre-MDT0000-lwp-OST0001_UUID 00000020:00000080:1.0:1783441590.625006:0:13116:0:(genops.c:865:class_export_destroy()) destroying export ffff91a8748ea800/lustre-MDT0000-lwp-OST0001_UUID for lustre-MDT0000-lwp-OST0001 00000020:01000000:1.0:1783441590.625011:0:13116:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-lwp-OST0001 (lustre-MDT0000-lwp-OST0001_UUID) 00000020:01000004:1.0:1783441590.625053:0:13116:0:(obd_mount.c:710:lustre_put_lsi()) put ffff91a875566000 1 00000020:00000080:1.0:1783441590.625058:0:13116:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xa2426164df2c7632 00000020:00000080:1.0:1783441590.625064:0:13116:0:(genops.c:906:class_export_put()) final put ffff91a877f89800/lustre-OST0001-osd_UUID 00000020:01000000:1.0:1783441590.625075:0:13116:0:(obd_config.c:2475:class_manual_cleanup()) Manual cleanup of lustre-OST0001-osd (flags='') 00000020:00000080:1.0:1783441590.625087:0:59:0:(genops.c:865:class_export_destroy()) destroying export ffff91a877f89800/lustre-OST0001-osd_UUID for lustre-OST0001-osd 00000020:00000080:1.0:1783441590.625108:0:13116:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1783441590.625113:0:13116:0:(obd_config.c:955:class_cleanup()) lustre-OST0001-osd: forcing exports to disconnect: 0/1 00000020:00080000:1.0:1783441590.625116:0:13116:0:(genops.c:1579:class_disconnect_exports()) OBD device 14 (ffff91a84767b380) has no exports 00000020:00000080:0.0:1783441590.659377:0:13116:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1783441590.659392:0:13116:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0001-osd (uuid lustre-OST0001-osd_UUID) 00000020:00000080:0.0:1783441590.659398:0:13116:0:(genops.c:906:class_export_put()) final put ffff91a875560000/lustre-OST0001-osd_UUID 00000020:00000080:0.0:1783441590.659403:0:13116:0:(genops.c:865:class_export_destroy()) destroying export ffff91a875560000/lustre-OST0001-osd_UUID for lustre-OST0001-osd 00000020:01000000:0.0:1783441590.659415:0:13116:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0001-osd (lustre-OST0001-osd_UUID) 00000020:01000004:0.0:1783441590.659639:0:13116:0:(obd_mount.c:668:lustre_free_lsi()) Freeing lsi ffff91a875566800 00000020:01000000:0.0:1783441590.659662:0:13116:0:(obd_config.c:2475:class_manual_cleanup()) Manual cleanup of OSS (flags='F') 00000020:00000080:0.0:1783441590.659666:0:13116:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1783441590.659670:0:13116:0:(obd_config.c:955:class_cleanup()) OSS: forcing exports to disconnect: 0/1 00000020:00080000:0.0:1783441590.659674:0:13116:0:(genops.c:1579:class_disconnect_exports()) OBD device 10 (ffff91a851574d40) has no exports 00000020:00000080:0.0:1783441590.659700:0:13116:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1783441590.659715:0:13116:0:(obd_config.c:883:class_detach()) detach on obd OSS (uuid OSS_uuid) 00000020:00000080:0.0:1783441590.659718:0:13116:0:(genops.c:906:class_export_put()) final put ffff91a867cf4000/OSS_uuid 00000020:00000080:0.0:1783441590.659721:0:13116:0:(genops.c:865:class_export_destroy()) destroying export ffff91a867cf4000/OSS_uuid for OSS 00000020:01000000:0.0:1783441590.659724:0:13116:0:(genops.c:441:class_free_dev()) finishing cleanup of obd OSS (OSS_uuid) 00000100:00100000:0.0:1783441590.659833:0:6581:0:(service.c:3183:ptlrpc_main()) ll_ost00_000: service thread [ffff91a8748f0e00:6581] 0 exiting: rc = 1 00000100:00100000:0.0:1783441590.659933:0:6583:0:(service.c:3183:ptlrpc_main()) ll_ost00_002: service thread [ffff91a845014e00:6583] 2 exiting: rc = 0 00000100:00080000:1.0:1783441590.660275:0:5781:0:(pinger.c:550:ping_evictor_main()) Exiting Ping Evictor 00000100:00100000:2.0:1783441590.665298:0:8557:0:(service.c:3183:ptlrpc_main()) ll_ost00_003: service thread [ffff91a842b31c00:8557] 3 exiting: rc = 0 00000100:00100000:2.0:1783441590.665392:0:12319:0:(service.c:3183:ptlrpc_main()) ll_ost00_004: service thread [ffff91a875597600:12319] 4 exiting: rc = 0 00000100:00100000:2.0:1783441590.665458:0:6582:0:(service.c:3183:ptlrpc_main()) ll_ost00_001: service thread [ffff91a845015400:6582] 1 exiting: rc = 0 00000100:00100000:0.0:1783441590.665761:0:13116:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783441590.665772:0:13116:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783441590.665779:0:13116:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783441590.665785:0:13116:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783441590.665792:0:13116:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783441590.665799:0:13116:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783441590.665805:0:13116:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783441590.665823:0:13116:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783441590.665828:0:13116:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783441590.665834:0:13116:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783441590.665839:0:13116:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783441590.665850:0:13116:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783441590.665857:0:13116:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783441590.665862:0:13116:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783441590.665867:0:13116:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783441590.665872:0:13116:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783441590.665876:0:13116:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783441590.665900:0:13116:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783441590.665905:0:13116:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783441590.665910:0:13116:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783441590.665915:0:13116:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783441590.665920:0:13116:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783441590.665925:0:13116:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783441590.665931:0:13116:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783441590.665937:0:13116:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783441590.665942:0:13116:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783441590.665953:0:13116:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783441590.665959:0:13116:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783441590.665964:0:13116:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783441590.665969:0:13116:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783441590.665973:0:13116:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783441590.665979:0:13116:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783441590.665984:0:13116:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783441590.665989:0:13116:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783441590.665996:0:13116:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783441590.666001:0:13116:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783441590.666007:0:13116:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783441590.666012:0:13116:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783441590.666017:0:13116:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783441590.666022:0:13116:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783441590.666027:0:13116:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783441590.666033:0:13116:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783441590.666038:0:13116:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783441590.666043:0:13116:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783441590.666048:0:13116:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783441590.666053:0:13116:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783441590.666058:0:13116:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783441590.666070:0:13116:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783441590.666076:0:13116:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783441590.666082:0:13116:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783441590.666087:0:13116:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783441590.666091:0:13116:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783441590.666102:0:13116:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783441590.666106:0:13116:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783441590.666118:0:13116:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783441590.666123:0:13116:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783441590.666128:0:13116:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783441590.666134:0:13116:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783441590.666139:0:13116:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783441590.666145:0:13116:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783441590.666149:0:13116:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783441590.666154:0:13116:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783441590.666159:0:13116:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783441590.666164:0:13116:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783441590.667141:0:6584:0:(service.c:3183:ptlrpc_main()) ll_ost_create00_000: service thread [ffff91a845014200:6584] 0 exiting: rc = 1 00000100:00100000:0.0:1783441590.667394:0:6585:0:(service.c:3183:ptlrpc_main()) ll_ost_create00_001: service thread [ffff91a8748f1200:6585] 1 exiting: rc = 0 00000100:00100000:1.0:1783441590.667490:0:13116:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783441590.667498:0:13116:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783441590.667503:0:13116:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783441590.667508:0:13116:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783441590.667512:0:13116:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783441590.667517:0:13116:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783441590.667522:0:13116:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783441590.667529:0:13116:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783441590.667534:0:13116:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783441590.667539:0:13116:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783441590.667545:0:13116:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783441590.667553:0:13116:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783441590.667558:0:13116:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783441590.667564:0:13116:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783441590.667569:0:13116:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783441590.667575:0:13116:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783441590.667581:0:13116:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783441590.667586:0:13116:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783441590.667592:0:13116:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783441590.667597:0:13116:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783441590.667602:0:13116:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783441590.667607:0:13116:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783441590.667612:0:13116:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783441590.667618:0:13116:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783441590.667797:0:13116:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783441590.667808:0:13116:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783441590.667814:0:13116:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783441590.667820:0:13116:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783441590.667825:0:13116:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783441590.667830:0:13116:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783441590.667836:0:13116:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783441590.667841:0:13116:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783441590.667846:0:13116:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783441590.667850:0:13116:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783441590.667869:0:13116:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783441590.667873:0:13116:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783441590.667878:0:13116:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783441590.667883:0:13116:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783441590.667888:0:13116:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783441590.667893:0:13116:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783441590.667898:0:13116:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783441590.667903:0:13116:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783441590.667908:0:13116:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783441590.667914:0:13116:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783441590.667920:0:13116:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783441590.667925:0:13116:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783441590.667950:0:13116:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783441590.667957:0:13116:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783441590.667962:0:13116:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783441590.667968:0:13116:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783441590.667976:0:13116:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783441590.667981:0:13116:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783441590.667986:0:13116:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783441590.667991:0:13116:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783441590.667995:0:13116:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783441590.668000:0:13116:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783441590.668005:0:13116:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783441590.668011:0:13116:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783441590.668016:0:13116:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783441590.668021:0:13116:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783441590.668027:0:13116:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783441590.668032:0:13116:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783441590.668036:0:13116:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783441590.668042:0:13116:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783441590.669374:0:6588:0:(service.c:3183:ptlrpc_main()) ll_ost_io00_002: service thread [ffff91a874b9e600:6588] 2 exiting: rc = 0 00000100:00100000:1.0:1783441590.669569:0:6587:0:(service.c:3183:ptlrpc_main()) ll_ost_io00_001: service thread [ffff91a8748f1600:6587] 1 exiting: rc = 0 00000100:00100000:0.0:1783441590.670606:0:6586:0:(service.c:3183:ptlrpc_main()) ll_ost_io00_000: service thread [ffff91a8748f1e00:6586] 0 exiting: rc = 1 00000100:00100000:1.0:1783441590.672395:0:13116:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783441590.672405:0:13116:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783441590.672412:0:13116:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783441590.672436:0:13116:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783441590.672443:0:13116:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783441590.672453:0:13116:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783441590.672465:0:13116:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783441590.672475:0:13116:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783441590.672500:0:13116:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783441590.672513:0:13116:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783441590.672525:0:13116:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783441590.672535:0:13116:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783441590.672542:0:13116:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783441590.672548:0:13116:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783441590.672554:0:13116:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783441590.672560:0:13116:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783441590.672567:0:13116:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783441590.672573:0:13116:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783441590.672581:0:13116:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783441590.672586:0:13116:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783441590.672593:0:13116:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783441590.672599:0:13116:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783441590.672605:0:13116:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783441590.672611:0:13116:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783441590.672618:0:13116:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783441590.673079:0:13116:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783441590.673405:0:13116:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783441590.673413:0:13116:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783441590.673419:0:13116:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783441590.673425:0:13116:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783441590.673432:0:13116:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783441590.673437:0:13116:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783441590.673464:0:13116:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783441590.673472:0:13116:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783441590.673477:0:13116:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783441590.673483:0:13116:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783441590.673490:0:13116:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783441590.673495:0:13116:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783441590.673509:0:13116:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783441590.673515:0:13116:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783441590.673521:0:13116:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783441590.673528:0:13116:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783441590.673534:0:13116:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783441590.673540:0:13116:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783441590.673546:0:13116:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783441590.673551:0:13116:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783441590.673557:0:13116:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783441590.673563:0:13116:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783441590.673569:0:13116:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783441590.673575:0:13116:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783441590.673580:0:13116:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783441590.673585:0:13116:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783441590.673590:0:13116:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783441590.673596:0:13116:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783441590.673601:0:13116:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783441590.673607:0:13116:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783441590.673625:0:13116:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783441590.674261:0:13116:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783441590.674272:0:13116:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783441590.674279:0:13116:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783441590.674285:0:13116:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783441590.674291:0:13116:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783441590.674297:0:13116:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783441590.674303:0:13116:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783441590.695344:0:6589:0:(service.c:3183:ptlrpc_main()) ll_ost_seq00_000: service thread [ffff91a874b9e200:6589] 0 exiting: rc = 1 00000100:00100000:0.0:1783441590.695464:0:6590:0:(service.c:3183:ptlrpc_main()) ll_ost_seq00_001: service thread [ffff91a874b9f600:6590] 1 exiting: rc = 0 00000100:00100000:1.0:1783441590.698952:0:13116:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783441590.698962:0:13116:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783441590.698967:0:13116:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783441590.698972:0:13116:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783441590.698977:0:13116:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783441590.698983:0:13116:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783441590.698988:0:13116:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783441590.698993:0:13116:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783441590.698999:0:13116:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783441590.699023:0:13116:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783441590.699031:0:13116:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783441590.699037:0:13116:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783441590.699042:0:13116:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783441590.699047:0:13116:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783441590.699053:0:13116:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783441590.699069:0:13116:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783441590.699076:0:13116:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783441590.699082:0:13116:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783441590.699095:0:13116:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783441590.699101:0:13116:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783441590.699107:0:13116:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783441590.699113:0:13116:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783441590.699119:0:13116:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783441590.699125:0:13116:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783441590.699131:0:13116:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783441590.699137:0:13116:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783441590.699142:0:13116:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783441590.699147:0:13116:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783441590.699153:0:13116:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783441590.699159:0:13116:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783441590.699164:0:13116:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783441590.699170:0:13116:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783441590.699175:0:13116:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783441590.699182:0:13116:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783441590.699187:0:13116:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783441590.699200:0:13116:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783441590.699206:0:13116:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783441590.699211:0:13116:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783441590.699217:0:13116:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783441590.699223:0:13116:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783441590.699228:0:13116:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783441590.699234:0:13116:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783441590.699240:0:13116:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783441590.699245:0:13116:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783441590.699256:0:13116:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783441590.699262:0:13116:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783441590.699267:0:13116:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783441590.699272:0:13116:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783441590.699278:0:13116:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783441590.699283:0:13116:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783441590.699288:0:13116:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783441590.699293:0:13116:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783441590.699298:0:13116:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783441590.699303:0:13116:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783441590.699309:0:13116:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783441590.699314:0:13116:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783441590.699319:0:13116:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783441590.699324:0:13116:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783441590.699330:0:13116:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783441590.699335:0:13116:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783441590.699339:0:13116:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783441590.699344:0:13116:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783441590.699349:0:13116:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783441590.699354:0:13116:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783441590.700099:0:6592:0:(service.c:3183:ptlrpc_main()) ll_ost_out00_001: service thread [ffff91a8590d2200:6592] 1 exiting: rc = 0 00000100:00100000:3.0:1783441590.700302:0:6591:0:(service.c:3183:ptlrpc_main()) ll_ost_out00_000: service thread [ffff91a8590d3200:6591] 0 exiting: rc = 1 00000100:00100000:1.0:1783441590.702729:0:13116:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783441590.702767:0:13116:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783441590.702774:0:13116:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783441590.702780:0:13116:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783441590.702786:0:13116:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783441590.702793:0:13116:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783441590.702800:0:13116:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783441590.702807:0:13116:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783441590.702814:0:13116:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783441590.702820:0:13116:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783441590.702826:0:13116:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783441590.702832:0:13116:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783441590.702838:0:13116:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783441590.702857:0:13116:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783441590.702865:0:13116:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783441590.702884:0:13116:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783441590.702889:0:13116:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783441590.702896:0:13116:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783441590.702902:0:13116:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783441590.702908:0:13116:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783441590.702915:0:13116:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783441590.702921:0:13116:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783441590.702927:0:13116:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783441590.702933:0:13116:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783441590.702940:0:13116:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783441590.702961:0:13116:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783441590.702969:0:13116:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783441590.702975:0:13116:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783441590.702981:0:13116:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783441590.702987:0:13116:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783441590.702995:0:13116:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783441590.703001:0:13116:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783441590.703008:0:13116:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783441590.703015:0:13116:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783441590.703021:0:13116:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783441590.703027:0:13116:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783441590.703033:0:13116:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783441590.703051:0:13116:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783441590.703068:0:13116:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783441590.703074:0:13116:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783441590.703080:0:13116:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783441590.703087:0:13116:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783441590.703093:0:13116:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783441590.703099:0:13116:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783441590.703105:0:13116:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783441590.703111:0:13116:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783441590.703118:0:13116:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783441590.703124:0:13116:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783441590.703131:0:13116:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783441590.703150:0:13116:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783441590.703162:0:13116:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783441590.703168:0:13116:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783441590.703175:0:13116:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783441590.703183:0:13116:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783441590.703197:0:13116:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783441590.703205:0:13116:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783441590.703212:0:13116:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783441590.703218:0:13116:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783441590.703224:0:13116:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783441590.703230:0:13116:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783441590.703237:0:13116:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783441590.703257:0:13116:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783441590.703264:0:13116:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783441590.703273:0:13116:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000020:02000400:0.0:1783441590.734797:0:13116:0:(tgt_mount.c:2182:server_put_super()) server umount lustre-OST0001 complete 00000001:02000400:0.0:1783441610.491420:0:13733:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg113-server.virtnet: executing load_modules_local 00000020:01000004:0.0:1783441618.711936:0:14145:0:(obd_mount.c:923:lmd_print()) mount data: 00000020:01000004:0.0:1783441618.711941:0:14145:0:(obd_mount.c:926:lmd_print()) device: lustre-mdt1/mdt1 00000080:01200004:0.0:1783441618.712052:0:14145:0:(super25.c:130:lustre_fill_super()) VFS Op: sb ffff91a844b0f000 00000020:01000004:0.0:1783441618.712068:0:14145:0:(tgt_mount.c:2501:osd_start()) Attempting to start lustre-MDT0000, type=osd-zfs, lsifl=200005, mountfl=0 00000020:01000004:0.0:1783441618.712077:0:14145:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-osd (typ=osd-zfs) 00000020:00000080:0.0:1783441618.712090:0:14145:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-osd (ffff91a8756bb380) 00000020:00000080:0.0:1783441618.712103:0:14145:0:(obd_config.c:720:class_attach_name()) OBD: dev 0 attached type osd-zfs with refcount 2 00100000:10000000:0.0:1783441618.727060:0:14145:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-MDT0000: registered index [0x200000001:0x3:0x0] (8/24) 00100000:10000000:0.0:1783441618.729521:0:14145:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-MDT0000: registered index [0x200000003:0x11:0x0] (8/32) 00100000:10000000:0.0:1783441618.730080:0:14145:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-MDT0000: registered index [0x200000003:0x3:0x0] (8/32) 00100000:10000000:0.0:1783441618.730152:0:14145:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled nodemap under 283: rc = 0 00100000:10000000:0.0:1783441618.730424:0:14145:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lustre-OST0001 under 283: rc = 0 00100000:10000000:0.0:1783441618.730526:0:14145:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lustre-MDT0000 under 283: rc = 0 00100000:10000000:0.0:1783441618.730624:0:14145:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lustre-client under 283: rc = 0 00100000:10000000:0.0:1783441618.730728:0:14145:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled params under 283: rc = 0 00100000:10000000:0.0:1783441618.730850:0:14145:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lustre-OST0000 under 283: rc = 0 00100000:10000000:0.0:1783441618.731113:0:14145:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lustre under 285: rc = 0 00100000:10000000:0.0:1783441618.732601:0:14145:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled dt-0x0 under 641: rc = 0 00100000:10000000:0.0:1783441618.732708:0:14145:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled md-0x0 under 641: rc = 0 00100000:10000000:0.0:1783441618.733403:0:14145:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x2020000-MDT0000 under 446: rc = 0 00100000:10000000:0.0:1783441618.733660:0:14145:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x1010000 under 446: rc = 0 00100000:10000000:0.0:1783441618.734078:0:14145:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x20000 under 446: rc = 0 00100000:10000000:0.0:1783441618.734506:0:14145:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x10000-MDT0000 under 446: rc = 0 00100000:10000000:0.0:1783441618.734779:0:14145:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x1010000-MDT0000 under 446: rc = 0 00100000:10000000:0.0:1783441618.735038:0:14145:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x2010000 under 446: rc = 0 00100000:10000000:0.0:1783441618.735467:0:14145:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x1020000-MDT0000 under 446: rc = 0 00100000:10000000:0.0:1783441618.735713:0:14145:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x2020000 under 446: rc = 0 00100000:10000000:0.0:1783441618.736078:0:14145:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x10000 under 446: rc = 0 00100000:10000000:0.0:1783441618.736490:0:14145:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x20000-MDT0000 under 446: rc = 0 00100000:10000000:0.0:1783441618.736797:0:14145:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x2010000-MDT0000 under 446: rc = 0 00100000:10000000:0.0:1783441618.737050:0:14145:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x1020000 under 446: rc = 0 00100000:10000000:0.0:1783441618.737635:0:14145:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_08 under 461: rc = 0 00100000:10000000:0.0:1783441618.737948:0:14145:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_02 under 461: rc = 0 00100000:10000000:0.0:1783441618.738419:0:14145:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_12 under 461: rc = 0 00100000:10000000:0.0:1783441618.738679:0:14145:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_11 under 461: rc = 0 00100000:10000000:0.0:1783441618.738954:0:14145:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_01 under 461: rc = 0 00100000:10000000:0.0:1783441618.739378:0:14145:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_06 under 461: rc = 0 00100000:10000000:0.0:1783441618.739635:0:14145:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_15 under 461: rc = 0 00100000:10000000:2.0:1783441618.740156:0:14145:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_05 under 461: rc = 0 00100000:10000000:2.0:1783441618.740574:0:14145:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_01 under 461: rc = 0 00100000:10000000:2.0:1783441618.740857:0:14145:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_11 under 461: rc = 0 00100000:10000000:2.0:1783441618.741108:0:14145:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_12 under 461: rc = 0 00100000:10000000:2.0:1783441618.741493:0:14145:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_08 under 461: rc = 0 00100000:10000000:2.0:1783441618.741731:0:14145:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_02 under 461: rc = 0 00100000:10000000:2.0:1783441618.742092:0:14145:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_05 under 461: rc = 0 00100000:10000000:2.0:1783441618.742504:0:14145:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_15 under 461: rc = 0 00100000:10000000:2.0:1783441618.742787:0:14145:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_06 under 461: rc = 0 00100000:10000000:2.0:1783441618.743042:0:14145:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_14 under 461: rc = 0 00100000:10000000:2.0:1783441618.743443:0:14145:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_04 under 461: rc = 0 00100000:10000000:2.0:1783441618.743723:0:14145:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_07 under 461: rc = 0 00100000:10000000:2.0:1783441618.744093:0:14145:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_10 under 461: rc = 0 00100000:10000000:2.0:1783441618.744501:0:14145:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_00 under 461: rc = 0 00100000:10000000:2.0:1783441618.744877:0:14145:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_03 under 461: rc = 0 00100000:10000000:2.0:1783441618.745133:0:14145:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_09 under 461: rc = 0 00100000:10000000:2.0:1783441618.745423:0:14145:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_13 under 461: rc = 0 00100000:10000000:2.0:1783441618.745663:0:14145:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_07 under 461: rc = 0 00100000:10000000:2.0:1783441618.745957:0:14145:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_04 under 461: rc = 0 00100000:10000000:2.0:1783441618.746218:0:14145:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_14 under 461: rc = 0 00100000:10000000:2.0:1783441618.746488:0:14145:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_13 under 461: rc = 0 00100000:10000000:2.0:1783441618.746735:0:14145:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_03 under 461: rc = 0 00100000:10000000:2.0:1783441618.747019:0:14145:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_09 under 461: rc = 0 00100000:10000000:2.0:1783441618.747512:0:14145:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_00 under 461: rc = 0 00100000:10000000:2.0:1783441618.747805:0:14145:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_10 under 461: rc = 0 00100000:10000000:2.0:1783441618.748455:0:14145:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled [0x200000400:0x1:0x0] under 450: rc = 0 00100000:10000000:2.0:1783441618.748993:0:14145:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-MDT0000: registered index [0x200000006:0x1020000:0x0] (8/32) 00100000:10000000:2.0:1783441618.749150:0:14145:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x1020000 under 646: rc = 0 00100000:10000000:2.0:1783441618.749503:0:14145:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-MDT0000: registered index [0x200000006:0x20000:0x0] (8/32) 00100000:10000000:2.0:1783441618.749571:0:14145:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x20000 under 646: rc = 0 00100000:10000000:2.0:1783441618.749799:0:14145:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-MDT0000: registered index [0x200000006:0x2020000:0x0] (8/32) 00100000:10000000:2.0:1783441618.749868:0:14145:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x2020000 under 646: rc = 0 00100000:10000000:2.0:1783441618.750359:0:14145:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-MDT0000: registered index [0x200000006:0x10000:0x0] (8/32) 00100000:10000000:2.0:1783441618.750430:0:14145:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x10000 under 642: rc = 0 00100000:10000000:2.0:1783441618.751071:0:14145:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-MDT0000: registered index [0x200000006:0x2010000:0x0] (8/32) 00100000:10000000:2.0:1783441618.751145:0:14145:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x2010000 under 642: rc = 0 00100000:10000000:2.0:1783441618.751492:0:14145:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-MDT0000: registered index [0x200000006:0x1010000:0x0] (8/32) 00100000:10000000:2.0:1783441618.751560:0:14145:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x1010000 under 642: rc = 0 00000020:00000080:2.0:1783441618.751912:0:14145:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-osd (uuid lustre-MDT0000-osd_UUID) 00080000:01000000:2.0:1783441618.751919:0:14145:0:(osd_handler.c:1569:osd_obd_connect()) connect #0 00000020:00000080:2.0:1783441618.751929:0:14145:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0xa2426164df2c8757 00000020:01000004:2.0:1783441618.751936:0:14145:0:(tgt_mount.c:2586:server_fill_super()) Found service lustre-MDT0000 on device lustre-mdt1/mdt1 00000020:01000000:2.0:1783441618.751941:0:14145:0:(tgt_mount.c:219:server_start_mgs()) Start MGS service MGS 00000020:01000004:2.0:1783441618.751945:0:14145:0:(tgt_mount.c:101:server_register_mount()) register mount ffff91a844b0f000 from MGS 00000020:01000004:2.0:1783441618.751949:0:14145:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD MGS (typ=mgs) 00000020:00000080:2.0:1783441618.751958:0:14145:0:(genops.c:413:class_newdev()) Allocate new device MGS (ffff91a84767b380) 00000020:00000080:2.0:1783441618.751969:0:14145:0:(obd_config.c:720:class_attach_name()) OBD: dev 1 attached type mgs with refcount 2 00000020:01000004:2.0:1783441618.752023:0:14145:0:(tgt_mount.c:153:server_get_mount()) get mount ffff91a844b0f000 from MGS, refs=2 00080000:01000000:2.0:1783441618.752027:0:14145:0:(osd_handler.c:1569:osd_obd_connect()) connect #1 00000020:00000080:2.0:1783441618.752032:0:14145:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0xa2426164df2c8765 00000100:00100000:2.0:1783441618.752121:0:14145:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/1 left), rc = 0 00000100:00100000:2.0:1783441618.752400:0:14145:0:(service.c:3462:ptlrpc_start_thread()) ldlm_cbd[0] started 0 min 2 max 56 00000100:00100000:2.0:1783441618.752406:0:14145:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cb00_000' 00000100:00100000:2.0:1783441618.753007:0:14145:0:(service.c:3462:ptlrpc_start_thread()) ldlm_cbd[0] started 1 min 2 max 56 00000100:00100000:2.0:1783441618.753014:0:14145:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cb00_001' 00000100:00100000:2.0:1783441618.753720:0:14145:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_canceld: allocate 64 new 8192-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1783441618.754038:0:14145:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 0 min 3 max 56 00000100:00100000:2.0:1783441618.754045:0:14145:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cn00_000' 00000100:00100000:2.0:1783441618.754732:0:14145:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 1 min 3 max 56 00000100:00100000:2.0:1783441618.754849:0:14145:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cn00_001' 00000100:00100000:2.0:1783441618.755383:0:14145:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 2 min 3 max 56 00000100:00100000:2.0:1783441618.755395:0:14145:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cn00_002' 00010000:00010000:0.0:1783441618.756119:0:14151:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783441618.756123:0:14151:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783441618.756126:0:14151:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783441618.756548:0:14152:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783441618.756551:0:14152:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783441618.756553:0:14152:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783441618.757160:0:14145:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-MGS-0 is initialized 00010000:00010000:0.0:1783441618.764427:0:14151:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:01000000:2.0:1783441618.766987:0:14145:0:(llog_obd.c:197:llog_setup()) obd MGS ctxt 0 is initialized 20000000:01000000:2.0:1783441618.767005:0:14145:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping . 20000000:01000000:2.0:1783441618.767007:0:14145:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping .. 10000000:01000000:2.0:1783441618.768967:0:14154:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x2 (params) 20000000:01000000:3.0:1783441618.769142:0:14145:0:(mgs_nids.c:666:mgs_nidtbl_init_fs()) IR: current version is 2 20000000:01000000:3.0:1783441618.769394:0:14145:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 20000000:01000000:3.0:1783441618.770124:0:14145:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 00000100:00100000:3.0:1783441618.770833:0:14145:0:(service.c:155:ptlrpc_grow_req_bufs()) mgs: allocate 64 new 8192-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1783441618.770982:0:14145:0:(service.c:3462:ptlrpc_start_thread()) mgs[-1] started 0 min 3 max 32 00000100:00100000:3.0:1783441618.770988:0:14145:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_mgs_0000' 00000100:00100000:0.0:1783441618.772995:0:14145:0:(service.c:3462:ptlrpc_start_thread()) mgs[-1] started 1 min 3 max 32 00000100:00100000:0.0:1783441618.773005:0:14145:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_mgs_0001' 00000100:00100000:0.0:1783441618.773542:0:14145:0:(service.c:3462:ptlrpc_start_thread()) mgs[-1] started 2 min 3 max 32 00000100:00100000:0.0:1783441618.773549:0:14145:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_mgs_0002' 00000020:00000080:1.0:1783441618.786648:0:14145:0:(obd_config.c:826:class_setup()) finished setup of obd MGS (uuid MGS) 00000020:01000004:1.0:1783441618.786674:0:14145:0:(obd_mount.c:411:lustre_start_mgc()) Start MGC 'MGC192.168.201.113@tcp' 00000020:01000004:1.0:1783441618.786676:0:14145:0:(obd_mount.c:420:lustre_start_mgc()) mgs NIDs (null). 00000020:01000004:1.0:1783441618.786707:0:14145:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD MGC192.168.201.113@tcp (typ=mgc) 00000020:00000080:1.0:1783441618.786721:0:14145:0:(genops.c:413:class_newdev()) Allocate new device MGC192.168.201.113@tcp (ffff91a744388000) 00000020:00000080:1.0:1783441618.786759:0:14145:0:(obd_config.c:720:class_attach_name()) OBD: dev 2 attached type mgc with refcount 2 00010000:00080000:1.0:1783441618.786839:0:14145:0:(ldlm_lib.c:102:import_set_conn()) imp ffff91a7457ef800@MGC192.168.201.113@tcp: add connection 192.168.201.113@tcp at head 00010000:00010000:1.0:1783441618.786989:0:14145:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-MGC192.168.201.113@tcp-0 is initialized 00000040:01000000:1.0:1783441618.786995:0:14145:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.201.113@tcp ctxt 1 is initialized 00000100:00080000:3.0:1783441618.788638:0:14159:0:(pinger.c:468:ping_evictor_main()) Starting Ping Evictor 10000000:01000000:2.0:1783441618.790576:0:14160:0:(mgc_request.c:631:mgc_requeue_thread()) Starting requeue thread 00000020:00000080:0.0:1783441618.791859:0:14145:0:(obd_config.c:826:class_setup()) finished setup of obd MGC192.168.201.113@tcp (uuid 94394728-4014-4ef0-b525-989290f008aa) 00000020:00000080:0.0:1783441618.791883:0:14145:0:(genops.c:1406:class_connect()) connect: client 94394728-4014-4ef0-b525-989290f008aa, cookie 0xa2426164df2c8773 00000100:00080000:0.0:1783441618.791895:0:14145:0:(import.c:510:import_select_connection()) MGC192.168.201.113@tcp: connect to NID 0@lo last attempt 0 00000100:00080000:0.0:1783441618.791902:0:14145:0:(import.c:624:import_select_connection()) MGC192.168.201.113@tcp: import ffff91a7457ef800 using connection 192.168.201.113@tcp/0@lo 00000100:00100000:0.0:1783441618.791934:0:14145:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff91a877fafb80 x1870073693299584/t0(0) o250->MGC192.168.201.113@tcp@0@lo:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1783441618.791966:0:14145:0:(pinger.c:374:ptlrpc_pinger_add_import()) adding pingable import 94394728-4014-4ef0-b525-989290f008aa->MGS 00000020:01000004:0.0:1783441618.791987:0:14145:0:(tgt_mount.c:1810:server_start_targets()) starting target lustre-MDT0000 00000020:01000004:0.0:1783441618.792010:0:14145:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD MDS (typ=mds) 00000020:00000080:0.0:1783441618.792023:0:14145:0:(genops.c:413:class_newdev()) Allocate new device MDS (ffff91a8756b99c0) 00000020:00000080:0.0:1783441618.792034:0:14145:0:(obd_config.c:720:class_attach_name()) OBD: dev 3 attached type mds with refcount 2 00000100:00100000:2.0:1783441618.792393:0:3302:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff91a877fafb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:94394728-4014-4ef0-b525-989290f008aa:3302:1870073693299584:0@lo:250:mount.lustre.0 00000100:00100000:2.0:1783441618.792545:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783441618.798544:0:14155:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073693299584 00000100:00100000:3.0:1783441618.798559:0:14155:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073693299584 00000100:00100000:3.0:1783441618.798718:0:14155:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1783441618.798728:0:14155:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a8492a2850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0+-99:3302:x1870073693299584:12345-0@lo:250:mount.lustre.0 00010000:00080000:3.0:1783441618.798770:0:14155:0:(ldlm_lib.c:1432:target_handle_connect()) MGS: connection from 94394728-4014-4ef0-b525-989290f008aa@0@lo t0 exp 0000000000000000 cur 456 last 0 00000020:00000080:3.0:1783441618.798799:0:14155:0:(genops.c:1406:class_connect()) connect: client 94394728-4014-4ef0-b525-989290f008aa, cookie 0xa2426164df2c8781 00000100:00080000:3.0:1783441618.798922:0:14155:0:(import.c:65:import_set_state_nolock()) ffff91a744380000 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1783441618.799010:0:14155:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a8492a2850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:94394728-4014-4ef0-b525-989290f008aa+5:3302:x1870073693299584:12345-0@lo:250:mount.lustre.0 Request processed in 282us (6466us total) trans 0 rc 0/0 00000100:00100000:3.0:1783441618.799025:0:14155:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1783441618.802397:0:3302:0:(client.c:3112:ptlrpc_free_committed()) MGC192.168.201.113@tcp: committing for last_committed 0 gen 1 00000100:00080000:3.0:1783441618.802412:0:3302:0:(import.c:1132:ptlrpc_connect_interpret()) MGC192.168.201.113@tcp: connect to target with instance 0 00000100:00080000:3.0:1783441618.802421:0:3302:0:(import.c:956:ptlrpc_connect_set_flags()) MGC192.168.201.113@tcp: Resetting ns_connect_flags to server flags: 0xa000011001002060 10000000:01000000:3.0:1783441618.802426:0:3302:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808005 00000100:00080000:3.0:1783441618.802431:0:3302:0:(import.c:65:import_set_state_nolock()) ffff91a7457ef800 MGS: changing import state from CONNECTING to FULL 10000000:01000000:3.0:1783441618.802434:0:3302:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808004 00000100:00080000:3.0:1783441618.802443:0:3302:0:(pinger.c:186:ptlrpc_pinger_ir_up()) IR up 00000100:00100000:3.0:1783441618.802451:0:3302:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff91a877fafb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:94394728-4014-4ef0-b525-989290f008aa:3302:1870073693299584:0@lo:250:mount.lustre.0 00000100:00100000:2.0:1783441618.808959:0:14145:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt: allocate 64 new 262144-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1783441618.809368:0:14145:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 0 min 3 max 116 00000100:00100000:2.0:1783441618.809376:0:14145:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt00_000' 00000100:00100000:1.0:1783441618.810413:0:14145:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 1 min 3 max 116 00000100:00100000:1.0:1783441618.810422:0:14145:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt00_001' 00000100:00100000:1.0:1783441618.811991:0:14145:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 2 min 3 max 116 00000100:00100000:1.0:1783441618.812000:0:14145:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt00_002' 00000100:00100000:1.0:1783441618.813088:0:14145:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_readpage: allocate 64 new 8192-byte reqbufs (0/64 left), rc = 0 00000100:00100000:1.0:1783441618.813453:0:14145:0:(service.c:3462:ptlrpc_start_thread()) mdt_readpage[0] started 0 min 2 max 80 00000100:00100000:1.0:1783441618.813531:0:14145:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_rdpg00_000' 00000100:00100000:1.0:1783441618.814231:0:14145:0:(service.c:3462:ptlrpc_start_thread()) mdt_readpage[0] started 1 min 2 max 80 00000100:00100000:1.0:1783441618.814371:0:14145:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_rdpg00_001' 00000100:00100000:3.0:1783441618.860924:0:14145:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_out: allocate 64 new 1048576-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1783441618.861150:0:14145:0:(service.c:3462:ptlrpc_start_thread()) mdt_out[0] started 0 min 2 max 116 00000100:00100000:3.0:1783441618.861157:0:14145:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_out00_000' 00000100:00100000:3.0:1783441618.867869:0:14145:0:(service.c:3462:ptlrpc_start_thread()) mdt_out[0] started 1 min 2 max 116 00000100:00100000:3.0:1783441618.867886:0:14145:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_out00_001' 00000100:00100000:3.0:1783441618.869396:0:14145:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_seqs: allocate 64 new 4096-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1783441618.869577:0:14145:0:(service.c:3462:ptlrpc_start_thread()) mdt_seqs[-1] started 0 min 2 max 256 00000100:00100000:3.0:1783441618.869583:0:14145:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_seqs_0000' 00000100:00100000:0.0:1783441618.877644:0:14145:0:(service.c:3462:ptlrpc_start_thread()) mdt_seqs[-1] started 1 min 2 max 256 00000100:00100000:0.0:1783441618.877657:0:14145:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_seqs_0001' 00000100:00100000:0.0:1783441618.881980:0:14145:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_seqm: allocate 64 new 4096-byte reqbufs (0/64 left), rc = 0 00000100:00100000:0.0:1783441618.882154:0:14145:0:(service.c:3462:ptlrpc_start_thread()) mdt_seqm[-1] started 0 min 2 max 256 00000100:00100000:0.0:1783441618.882173:0:14145:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_seqm_0000' 00000100:00100000:0.0:1783441618.883074:0:14145:0:(service.c:3462:ptlrpc_start_thread()) mdt_seqm[-1] started 1 min 2 max 256 00000100:00100000:0.0:1783441618.883082:0:14145:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_seqm_0001' 00000100:00100000:0.0:1783441618.884683:0:14145:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_fld: allocate 64 new 4096-byte reqbufs (0/64 left), rc = 0 00000100:00100000:0.0:1783441618.884888:0:14145:0:(service.c:3462:ptlrpc_start_thread()) mdt_fld[-1] started 0 min 2 max 256 00000100:00100000:0.0:1783441618.884894:0:14145:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_fld_0000' 00000100:00100000:0.0:1783441618.887106:0:14145:0:(service.c:3462:ptlrpc_start_thread()) mdt_fld[-1] started 1 min 2 max 256 00000100:00100000:0.0:1783441618.887121:0:14145:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_fld_0001' 00000100:00100000:2.0:1783441618.925086:0:14145:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_io: allocate 64 new 524288-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1783441618.926048:0:14145:0:(service.c:3462:ptlrpc_start_thread()) mdt_io[0] started 0 min 3 max 116 00000100:00100000:2.0:1783441618.926058:0:14145:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_io00_000' 00000100:00100000:2.0:1783441618.937413:0:14145:0:(service.c:3462:ptlrpc_start_thread()) mdt_io[0] started 1 min 3 max 116 00000100:00100000:2.0:1783441618.937435:0:14145:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_io00_001' 00000100:00100000:2.0:1783441618.938469:0:14145:0:(service.c:3462:ptlrpc_start_thread()) mdt_io[0] started 2 min 3 max 116 00000100:00100000:2.0:1783441618.938477:0:14145:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_io00_002' 00000020:00000080:2.0:1783441618.942936:0:14145:0:(obd_config.c:826:class_setup()) finished setup of obd MDS (uuid MDS_uuid) 00000020:01000004:3.0:1783441618.951929:0:14145:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for lustre-mdt1/mdt1 10000000:01000000:3.0:1783441618.951941:0:14145:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.201.113@tcp: cl_mgc_mutex lustre-MDT0000-osd for locked: rc = 0 00000040:01000000:3.0:1783441618.952091:0:14145:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.201.113@tcp ctxt 0 is initialized 00000020:01000004:3.0:1783441618.952131:0:14145:0:(tgt_mount.c:1418:server_register_target()) Registration lustre-MDT0000, fs=lustre, 192.168.201.113@tcp, index=0000, flags=0x20005 00000020:01000004:3.0:1783441618.952136:0:14145:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:3.0:1783441618.952138:0:14145:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:3.0:1783441618.952139:0:14145:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1783441618.952141:0:14145:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1783441618.952142:0:14145:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1783441618.952144:0:14145:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1783441618.952145:0:14145:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:3.0:1783441618.952146:0:14145:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:3.0:1783441618.952148:0:14145:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1783441618.952150:0:14145:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:3.0:1783441618.952152:0:14145:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-MDT0000 0x10020005 00000020:01000004:3.0:1783441618.952159:0:14145:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:3.0:1783441618.952160:0:14145:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:3.0:1783441618.952161:0:14145:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1783441618.952162:0:14145:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1783441618.952163:0:14145:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1783441618.952164:0:14145:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1783441618.952165:0:14145:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:3.0:1783441618.952166:0:14145:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:3.0:1783441618.952167:0:14145:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1783441618.952168:0:14145:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:3.0:1783441618.952208:0:14145:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-MDT0000 00000100:00100000:3.0:1783441618.952227:0:14145:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff91a874dcd180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:94394728-4014-4ef0-b525-989290f008aa:14145:1870073693299712:0@lo:253:mount.lustre.0 00000100:00100000:3.0:1783441618.952851:0:14145:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783441618.952955:0:14145:0:(client.c:2702:ptlrpc_set_wait()) set ffff91a848f256c0 going to sleep for 11 seconds 00000100:00100000:1.0:1783441618.954414:0:14157:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073693299712 00000100:00100000:1.0:1783441618.954427:0:14157:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073693299712 00000100:00100000:1.0:1783441618.954501:0:14157:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1783441618.954511:0:14157:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a8492a0c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:94394728-4014-4ef0-b525-989290f008aa+5:14145:x1870073693299712:12345-0@lo:253:mount.lustre.0 20000000:01000000:1.0:1783441618.954565:0:14157:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 20000000:01000000:1.0:1783441618.954568:0:14157:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 0 is registered to MGS. 20000000:01000000:1.0:1783441618.954571:0:14157:0:(mgs_handler.c:529:mgs_target_reg()) Server lustre-MDT0000 is running on 0@lo 10000000:01000000:1.0:1783441618.955472:0:14178:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 20000000:01000000:3.0:1783441618.955918:0:14157:0:(mgs_nids.c:666:mgs_nidtbl_init_fs()) IR: current version is 5 20000000:01000000:3.0:1783441618.958445:0:14179:0:(mgs_llog.c:340:mgs_fsdb_handler()) MDT index is 0 20000000:01000000:3.0:1783441618.958453:0:14179:0:(mgs_llog.c:324:mgs_fsdb_handler()) OST index for lustre-OST0000_UUID is 0 (0) 20000000:01000000:3.0:1783441618.958456:0:14179:0:(mgs_llog.c:324:mgs_fsdb_handler()) OST index for lustre-OST0001_UUID is 1 (1) 00000040:00080000:3.0:1783441618.958492:0:14179:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 42 count 42 20000000:01000000:1.0:1783441618.967162:0:14157:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 20000000:01000000:1.0:1783441618.967178:0:14157:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-MDT0000, index=0, rc=0 00000100:00100000:2.0:1783441618.991657:0:14157:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a8492a0c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:94394728-4014-4ef0-b525-989290f008aa+5:14145:x1870073693299712:12345-0@lo:253:mount.lustre.0 Request processed in 37137us (38796us total) trans 0 rc 0/0 00000100:00100000:2.0:1783441618.991678:0:14157:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1783441618.991945:0:14145:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff91a874dcd180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:94394728-4014-4ef0-b525-989290f008aa:14145:1870073693299712:0@lo:253:mount.lustre.0 10000000:01000000:3.0:1783441618.991962:0:14145:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-MDT0000 got index = 0 00000020:01000004:3.0:1783441618.991966:0:14145:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:3.0:1783441618.991967:0:14145:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:3.0:1783441618.991969:0:14145:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1783441618.991970:0:14145:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1783441618.991972:0:14145:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1783441618.991973:0:14145:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1783441618.991975:0:14145:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:3.0:1783441618.991976:0:14145:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:3.0:1783441618.991978:0:14145:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1783441618.991980:0:14145:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:3.0:1783441618.992002:0:14145:0:(tgt_mount.c:101:server_register_mount()) register mount ffff91a844b0f000 from lustre-MDT0000 10000000:01000000:3.0:1783441618.992030:0:14145:0:(mgc_request.c:1943:mgc_process_config()) parse_log lustre-MDT0000 from 0 10000000:01000000:3.0:1783441618.992033:0:14145:0:(mgc_request.c:329:config_log_add()) add config log lustre-MDT0000-0000000000000000 10000000:01000000:3.0:1783441618.992037:0:14145:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-sptlrpc-ffff91a744388000 10000000:01000000:3.0:1783441618.992042:0:14145:0:(mgc_request.c:68:mgc_name2resid()) log lustre-sptlrpc to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:3.0:1783441618.992065:0:14145:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-sptlrpc-ffff91a744388000 from 1 10000000:01000000:3.0:1783441618.992068:0:14145:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:3.0:1783441618.992111:0:14145:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.113@tcp lock: ffff91a841476400/0xa2426164df2c8788 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14145 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783441618.992122:0:14145:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.113@tcp lock: ffff91a841476400/0xa2426164df2c8788 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14145 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783441618.992133:0:14145:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.113@tcp lock: ffff91a841476400/0xa2426164df2c8788 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14145 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783441618.992156:0:14145:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff91a874dcd180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:94394728-4014-4ef0-b525-989290f008aa:14145:1870073693299840:0@lo:101:mount.lustre.0 00000100:00100000:3.0:1783441618.992204:0:14145:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783441618.992369:0:14145:0:(client.c:2702:ptlrpc_set_wait()) set ffff91a848f25d80 going to sleep for 11 seconds 00000100:00100000:0.0:1783441618.996684:0:14155:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073693299840 00000100:00100000:0.0:1783441618.996840:0:14155:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073693299840 00000100:00100000:0.0:1783441618.996949:0:14155:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1783441618.996959:0:14155:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a8492a0850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:94394728-4014-4ef0-b525-989290f008aa+5:14145:x1870073693299840:12345-0@lo:101:mount.lustre.0 00010000:00010000:0.0:1783441618.996977:0:14155:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1783441618.996998:0:14155:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff91a85fe58600/0xa2426164df2c878f lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xa2426164df2c8788 expref: -99 pid: 14155 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783441618.997027:0:14155:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff91a85fe58600/0xa2426164df2c878f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xa2426164df2c8788 expref: 6 pid: 14155 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783441618.997037:0:14155:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff91a85fe58600/0xa2426164df2c878f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xa2426164df2c8788 expref: 6 pid: 14155 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783441618.997046:0:14155:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91a85fe58600, rc 0) 00000100:00100000:0.0:1783441618.997125:0:14155:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a8492a0850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:94394728-4014-4ef0-b525-989290f008aa+6:14145:x1870073693299840:12345-0@lo:101:mount.lustre.0 Request processed in 167us (4920us total) trans 0 rc 0/0 00000100:00100000:0.0:1783441618.997132:0:14155:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1783441618.997220:0:14145:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff91a874dcd180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:94394728-4014-4ef0-b525-989290f008aa:14145:1870073693299840:0@lo:101:mount.lustre.0 00010000:00010000:3.0:1783441618.997258:0:14145:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.113@tcp lock: ffff91a841476400/0xa2426164df2c8788 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xa2426164df2c878f expref: -99 pid: 14145 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783441618.997269:0:14145:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.113@tcp lock: ffff91a841476400/0xa2426164df2c8788 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xa2426164df2c878f expref: -99 pid: 14145 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783441618.997338:0:14145:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff91a874dcd180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:94394728-4014-4ef0-b525-989290f008aa:14145:1870073693299968:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1783441618.997375:0:14145:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783441619.001137:0:14145:0:(client.c:2702:ptlrpc_set_wait()) set ffff91a848f25d80 going to sleep for 10 seconds 00000100:00100000:2.0:1783441619.001193:0:14156:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073693299968 00000100:00100000:2.0:1783441619.001203:0:14156:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073693299968 00000100:00100000:2.0:1783441619.001330:0:14156:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1783441619.001340:0:14156:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a8492a2450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:94394728-4014-4ef0-b525-989290f008aa+6:14145:x1870073693299968:12345-0@lo:501:mount.lustre.0 00000100:00100000:2.0:1783441619.001629:0:14156:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a8492a2450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:94394728-4014-4ef0-b525-989290f008aa+6:14145:x1870073693299968:12345-0@lo:501:mount.lustre.0 Request processed in 291us (4252us total) trans 0 rc -2/-2 00000100:00100000:2.0:1783441619.001637:0:14156:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1783441619.001863:0:14145:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff91a874dcd180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:94394728-4014-4ef0-b525-989290f008aa:14145:1870073693299968:0@lo:501:mount.lustre.0 10000000:01000000:3.0:1783441619.001907:0:14145:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.201.113@tcp: configuration from log 'lustre-sptlrpc' failed (-2). 00010000:00010000:3.0:1783441619.001928:0:14145:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.113@tcp lock: ffff91a841476400/0xa2426164df2c8788 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xa2426164df2c878f expref: -99 pid: 14145 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783441619.001952:0:14145:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.113@tcp lock: ffff91a841476400/0xa2426164df2c8788 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xa2426164df2c878f expref: -99 pid: 14145 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1783441619.001962:0:14145:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff91a844b0f000 10000000:01000000:3.0:1783441619.001967:0:14145:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:3.0:1783441619.001972:0:14145:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-barrier-ffff91a844b0f000 10000000:01000000:3.0:1783441619.001975:0:14145:0:(mgc_request.c:68:mgc_name2resid()) log lustre-barrier to resid 0x65727473756c/0x5 (lustre) 10000000:01000000:3.0:1783441619.001978:0:14145:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-barrier-ffff91a844b0f000 from 1 10000000:01000000:3.0:1783441619.001980:0:14145:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-barrier (res 0x65727473756c) 00010000:00010000:3.0:1783441619.002012:0:14145:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.113@tcp lock: ffff91a841477200/0xa2426164df2c8796 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14145 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783441619.002019:0:14145:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.113@tcp lock: ffff91a841477200/0xa2426164df2c8796 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14145 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783441619.002028:0:14145:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.113@tcp lock: ffff91a841477200/0xa2426164df2c8796 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14145 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783441619.002048:0:14145:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff91a874dcd180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:94394728-4014-4ef0-b525-989290f008aa:14145:1870073693300096:0@lo:101:mount.lustre.0 00000100:00100000:3.0:1783441619.002082:0:14145:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783441619.002104:0:14145:0:(client.c:2702:ptlrpc_set_wait()) set ffff91a848f25d80 going to sleep for 11 seconds 00000100:00100000:2.0:1783441619.002171:0:14156:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073693300096 00000100:00100000:2.0:1783441619.002181:0:14156:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073693300096 00000100:00100000:2.0:1783441619.002201:0:14156:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:2.0:1783441619.002207:0:14156:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a8492a3c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:94394728-4014-4ef0-b525-989290f008aa+6:14145:x1870073693300096:12345-0@lo:101:mount.lustre.0 00010000:00010000:2.0:1783441619.002216:0:14156:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1783441619.002323:0:14156:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff91a85eaa1800/0xa2426164df2c879d lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xa2426164df2c8796 expref: -99 pid: 14156 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783441619.002347:0:14156:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff91a85eaa1800/0xa2426164df2c879d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xa2426164df2c8796 expref: 7 pid: 14156 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783441619.002358:0:14156:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff91a85eaa1800/0xa2426164df2c879d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xa2426164df2c8796 expref: 7 pid: 14156 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783441619.002366:0:14156:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91a85eaa1800, rc 0) 00000100:00100000:2.0:1783441619.002449:0:14156:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a8492a3c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:94394728-4014-4ef0-b525-989290f008aa+7:14145:x1870073693300096:12345-0@lo:101:mount.lustre.0 Request processed in 241us (365us total) trans 0 rc 0/0 00000100:00100000:2.0:1783441619.002455:0:14156:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:3.0:1783441619.003101:0:14145:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff91a874dcd180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:94394728-4014-4ef0-b525-989290f008aa:14145:1870073693300096:0@lo:101:mount.lustre.0 00010000:00010000:3.0:1783441619.003117:0:14145:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.113@tcp lock: ffff91a841477200/0xa2426164df2c8796 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xa2426164df2c879d expref: -99 pid: 14145 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783441619.003127:0:14145:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.113@tcp lock: ffff91a841477200/0xa2426164df2c8796 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xa2426164df2c879d expref: -99 pid: 14145 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1783441619.003157:0:14145:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.201.113@tcp: configuration from log 'lustre-barrier' succeeded (0). 00010000:00010000:3.0:1783441619.003212:0:14145:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.113@tcp lock: ffff91a841477200/0xa2426164df2c8796 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xa2426164df2c879d expref: -99 pid: 14145 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783441619.003220:0:14145:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.113@tcp lock: ffff91a841477200/0xa2426164df2c8796 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xa2426164df2c879d expref: -99 pid: 14145 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1783441619.003227:0:14145:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-MDT0000-0000000000000000 10000000:01000000:3.0:1783441619.003241:0:14145:0:(mgc_request.c:68:mgc_name2resid()) log lustre-MDT0000 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:3.0:1783441619.003309:0:14145:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-mdtir-ffff91a844b0f000 10000000:01000000:3.0:1783441619.003314:0:14145:0:(mgc_request.c:68:mgc_name2resid()) log lustre-mdtir to resid 0x65727473756c/0x2 (lustre) 10000000:01000000:3.0:1783441619.003318:0:14145:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-MDT0000-0000000000000000 from 1 10000000:01000000:3.0:1783441619.003320:0:14145:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0000 (res 0x65727473756c) 00010000:00010000:3.0:1783441619.003341:0:14145:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.113@tcp lock: ffff91a841477c00/0xa2426164df2c87a4 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14145 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783441619.003349:0:14145:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.113@tcp lock: ffff91a841477c00/0xa2426164df2c87a4 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14145 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783441619.003358:0:14145:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.113@tcp lock: ffff91a841477c00/0xa2426164df2c87a4 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14145 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783441619.003374:0:14145:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff91a874dcd180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:94394728-4014-4ef0-b525-989290f008aa:14145:1870073693300224:0@lo:101:mount.lustre.0 00000100:00100000:3.0:1783441619.003409:0:14145:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783441619.003442:0:14145:0:(client.c:2702:ptlrpc_set_wait()) set ffff91a848f25d80 going to sleep for 11 seconds 00000100:00100000:0.0:1783441619.003508:0:14156:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073693300224 00000100:00100000:0.0:1783441619.003513:0:14156:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073693300224 00000100:00100000:0.0:1783441619.003554:0:14156:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:0.0:1783441619.003570:0:14156:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a8492a2c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:94394728-4014-4ef0-b525-989290f008aa+7:14145:x1870073693300224:12345-0@lo:101:mount.lustre.0 00010000:00010000:0.0:1783441619.003580:0:14156:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1783441619.003591:0:14156:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff91a85fe58200/0xa2426164df2c87ab lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xa2426164df2c87a4 expref: -99 pid: 14156 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783441619.003606:0:14156:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff91a85fe58200/0xa2426164df2c87ab lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xa2426164df2c87a4 expref: 8 pid: 14156 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783441619.003613:0:14156:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff91a85fe58200/0xa2426164df2c87ab lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xa2426164df2c87a4 expref: 8 pid: 14156 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783441619.003628:0:14156:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91a85fe58200, rc 0) 00000100:00100000:0.0:1783441619.003671:0:14156:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a8492a2c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:94394728-4014-4ef0-b525-989290f008aa+8:14145:x1870073693300224:12345-0@lo:101:mount.lustre.0 Request processed in 110us (261us total) trans 0 rc 0/0 00000100:00100000:0.0:1783441619.003678:0:14156:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:1.0:1783441619.004044:0:14145:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff91a874dcd180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:94394728-4014-4ef0-b525-989290f008aa:14145:1870073693300224:0@lo:101:mount.lustre.0 00010000:00010000:1.0:1783441619.004057:0:14145:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.113@tcp lock: ffff91a841477c00/0xa2426164df2c87a4 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xa2426164df2c87ab expref: -99 pid: 14145 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783441619.004064:0:14145:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.113@tcp lock: ffff91a841477c00/0xa2426164df2c87a4 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xa2426164df2c87ab expref: -99 pid: 14145 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783441619.004113:0:14145:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff91a745552680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:94394728-4014-4ef0-b525-989290f008aa:14145:1870073693300352:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1783441619.004141:0:14145:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783441619.004172:0:14145:0:(client.c:2702:ptlrpc_set_wait()) set ffff91a862ffacc0 going to sleep for 11 seconds 00000100:00100000:0.0:1783441619.004225:0:14157:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073693300352 00000100:00100000:0.0:1783441619.004229:0:14157:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073693300352 00000100:00100000:0.0:1783441619.004370:0:14157:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:0.0:1783441619.004378:0:14157:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a8492a1c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:94394728-4014-4ef0-b525-989290f008aa+8:14145:x1870073693300352:12345-0@lo:501:mount.lustre.0 00000100:00100000:0.0:1783441619.004903:0:14157:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a8492a1c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:94394728-4014-4ef0-b525-989290f008aa+9:14145:x1870073693300352:12345-0@lo:501:mount.lustre.0 Request processed in 526us (760us total) trans 0 rc 0/0 00000100:00100000:0.0:1783441619.004911:0:14157:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:1.0:1783441619.004978:0:14145:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff91a745552680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:94394728-4014-4ef0-b525-989290f008aa:14145:1870073693300352:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1783441619.005011:0:14145:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff91a745552680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:94394728-4014-4ef0-b525-989290f008aa:14145:1870073693300480:0@lo:503:mount.lustre.0 00000100:00100000:1.0:1783441619.005049:0:14145:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783441619.005404:0:14145:0:(client.c:2702:ptlrpc_set_wait()) set ffff91a862ffacc0 going to sleep for 11 seconds 00000100:00100000:3.0:1783441619.005455:0:14155:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073693300480 00000100:00100000:3.0:1783441619.005460:0:14155:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073693300480 00000100:00100000:3.0:1783441619.005489:0:14155:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:3.0:1783441619.005504:0:14155:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a8492a3050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:94394728-4014-4ef0-b525-989290f008aa+9:14145:x1870073693300480:12345-0@lo:503:mount.lustre.0 00000100:00100000:3.0:1783441619.006006:0:14155:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a8492a3050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:94394728-4014-4ef0-b525-989290f008aa+9:14145:x1870073693300480:12345-0@lo:503:mount.lustre.0 Request processed in 501us (955us total) trans 0 rc 0/0 00000100:00100000:3.0:1783441619.006014:0:14155:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:1.0:1783441619.006114:0:14145:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff91a745552680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:94394728-4014-4ef0-b525-989290f008aa:14145:1870073693300480:0@lo:503:mount.lustre.0 00000100:00100000:1.0:1783441619.006548:0:14180:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff91a745552680 pname:cluuid:pid:xid:nid:opc:job llog_process_th:94394728-4014-4ef0-b525-989290f008aa:14180:1870073693300608:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1783441619.006602:0:14180:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783441619.006632:0:14180:0:(client.c:2702:ptlrpc_set_wait()) set ffff91a862ffa480 going to sleep for 11 seconds 00000100:00100000:3.0:1783441619.007007:0:14155:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073693300608 00000100:00100000:3.0:1783441619.007013:0:14155:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073693300608 00000100:00100000:3.0:1783441619.007042:0:14155:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:3.0:1783441619.007050:0:14155:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a8492a0050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:94394728-4014-4ef0-b525-989290f008aa+9:14180:x1870073693300608:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1783441619.007404:0:14155:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a8492a0050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:94394728-4014-4ef0-b525-989290f008aa+9:14180:x1870073693300608:12345-0@lo:502:llog_process_th.0 Request processed in 353us (800us total) trans 0 rc 0/0 00000100:00100000:3.0:1783441619.007411:0:14155:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:1.0:1783441619.007510:0:14180:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff91a745552680 pname:cluuid:pid:xid:nid:opc:job llog_process_th:94394728-4014-4ef0-b525-989290f008aa:14180:1870073693300608:0@lo:502:llog_process_th.0 00000020:01000000:1.0:1783441619.007540:0:14180:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1783441619.007551:0:14180:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1783441619.007554:0:14180:0:(obd_config.c:1561:class_process_config()) marker 2 (0x1) lustre-MDT0000-m lov setup 00000020:01000000:1.0:1783441619.007559:0:14180:0:(obd_config.c:1967:class_config_llog_handler()) For 2.x interoperability, rename obd type from lov to lod (lustre-MDT0000) 00000020:00000080:1.0:1783441619.007562:0:14180:0:(obd_config.c:1470:class_process_config()) processing cmd: cf001 00000020:00000080:1.0:1783441619.007589:0:14180:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-mdtlov (ffff91a74438cd40) 00000020:00000080:1.0:1783441619.007606:0:14180:0:(obd_config.c:720:class_attach_name()) OBD: dev 4 attached type lod with refcount 2 00000020:00000080:1.0:1783441619.007612:0:14180:0:(obd_config.c:1470:class_process_config()) processing cmd: cf003 00080000:01000000:1.0:1783441619.007883:0:14180:0:(osd_handler.c:1569:osd_obd_connect()) connect #2 00000020:00000080:1.0:1783441619.007891:0:14180:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0xa2426164df2c87b9 00000020:00000080:1.0:1783441619.008099:0:14180:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-mdtlov (uuid lustre-MDT0000-mdtlov_UUID) 00000020:01000000:1.0:1783441619.008104:0:14180:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1783441619.008108:0:14180:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1783441619.008109:0:14180:0:(obd_config.c:1561:class_process_config()) marker 2 (0x2) lustre-MDT0000-m lov setup 00000020:01000000:1.0:1783441619.008112:0:14180:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1783441619.008115:0:14180:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1783441619.008116:0:14180:0:(obd_config.c:1561:class_process_config()) marker 3 (0x1) lustre-MDT0000 add mdt 00000020:00000080:1.0:1783441619.008119:0:14180:0:(obd_config.c:1470:class_process_config()) processing cmd: cf001 00000020:00000080:1.0:1783441619.008128:0:14180:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000 (ffff91a7443899c0) 00000020:00000080:1.0:1783441619.008136:0:14180:0:(obd_config.c:720:class_attach_name()) OBD: dev 5 attached type mdt with refcount 2 00000020:00000080:1.0:1783441619.008140:0:14180:0:(obd_config.c:1470:class_process_config()) processing cmd: cf007 00000020:00000080:1.0:1783441619.008141:0:14180:0:(obd_config.c:1514:class_process_config()) mountopt: profile lustre-MDT0000 osc lustre-MDT0000-mdtlov mdc (null) 00000020:01000000:1.0:1783441619.008144:0:14180:0:(obd_config.c:1148:class_add_profile()) Add profile lustre-MDT0000 00000020:00000080:1.0:1783441619.008149:0:14180:0:(obd_config.c:1470:class_process_config()) processing cmd: cf003 00000020:01000004:1.0:1783441619.008187:0:14180:0:(tgt_mount.c:153:server_get_mount()) get mount ffff91a844b0f000 from lustre-MDT0000, refs=3 00000020:00000080:1.0:1783441619.008199:0:14180:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDD0000 (ffff91a74438b380) 00000020:00000080:1.0:1783441619.008207:0:14180:0:(obd_config.c:720:class_attach_name()) OBD: dev 6 attached type mdd with refcount 2 00000004:01000000:1.0:1783441619.008349:0:14180:0:(lod_dev.c:2291:lod_obd_connect()) connect #0 00000020:00000080:1.0:1783441619.008355:0:14180:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0xa2426164df2c87ce 00000020:00000080:1.0:1783441619.008438:0:14180:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDD0000 (uuid lustre-MDD0000_UUID) 00000004:01000000:1.0:1783441619.008444:0:14180:0:(mdd_device.c:1596:mdd_obd_connect()) connect #0 00000020:00000080:1.0:1783441619.008455:0:14180:0:(genops.c:1406:class_connect()) connect: client lustre-MDD0000_UUID, cookie 0xa2426164df2c87d5 00080000:01000000:1.0:1783441619.008460:0:14180:0:(osd_handler.c:1569:osd_obd_connect()) connect #3 00000020:00000080:1.0:1783441619.008463:0:14180:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0xa2426164df2c87dc 00010000:00010000:2.0:1783441619.089526:0:14180:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-mdt-lustre-MDT0000_UUID-1 is initialized 00000001:00000004:2.0:1783441619.090632:0:14180:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 2, last_transno is 4294967528 00000001:00080000:2.0:1783441619.091030:0:14180:0:(tgt_lastrcvd.c:222:tgt_reply_header_read()) lustre-MDT0000: read reply_data header. magic=0xbdabda01 header_size=32 reply_size=32 00000020:00000080:2.0:1783441619.092787:0:14180:0:(genops.c:413:class_newdev()) Allocate new device lustre-QMT0000 (ffff91a84767cd40) 00000020:00000080:2.0:1783441619.092810:0:14180:0:(obd_config.c:720:class_attach_name()) OBD: dev 7 attached type qmt with refcount 2 00080000:01000000:2.0:1783441619.094066:0:14180:0:(osd_handler.c:1569:osd_obd_connect()) connect #4 00000020:00000080:2.0:1783441619.094079:0:14180:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0xa2426164df2c87ea 00000020:00000080:2.0:1783441619.098127:0:14180:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-QMT0000 (uuid lustre-QMT0000_UUID) 00000020:00000080:2.0:1783441619.109352:0:14180:0:(genops.c:1406:class_connect()) connect: client lustre-QMT0000_UUID, cookie 0xa2426164df2c87f1 00000020:00000080:3.0:1783441619.115493:0:14180:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000 (uuid lustre-MDT0000_UUID) 00000020:01000000:3.0:1783441619.115507:0:14180:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1783441619.117544:0:14180:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1783441619.117551:0:14180:0:(obd_config.c:1561:class_process_config()) marker 3 (0x2) lustre-MDT0000 add mdt 00000020:01000000:2.0:1783441619.117562:0:14180:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1783441619.117571:0:14180:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1783441619.117586:0:14180:0:(obd_config.c:1561:class_process_config()) marker 8 (0x1) lustre-MDT0000 mdt.identity_upcall 00000020:00000080:2.0:1783441619.117591:0:14180:0:(obd_config.c:1470:class_process_config()) processing cmd: cf00f 00000004:01000000:2.0:1783441619.117656:0:14180:0:(mdt_lproc.c:316:identity_upcall_store()) lustre-MDT0000: identity upcall set to /home/green/git/lustre-release/lustre/utils/l_getidentity 00000020:01000000:2.0:1783441619.117946:0:14180:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1783441619.117952:0:14180:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1783441619.117953:0:14180:0:(obd_config.c:1561:class_process_config()) marker 8 (0x2) lustre-MDT0000 mdt.identity_upcall 00000020:01000000:2.0:1783441619.117956:0:14180:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:2.0:1783441619.117958:0:14180:0:(obd_config.c:1899:class_config_llog_handler()) SKIP #10 00000020:01000000:2.0:1783441619.117960:0:14180:0:(obd_config.c:1925:class_config_llog_handler()) skipping 0x6 00000020:01000000:2.0:1783441619.117962:0:14180:0:(obd_config.c:1925:class_config_llog_handler()) skipping 0x6 00000020:01000000:2.0:1783441619.117964:0:14180:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:2.0:1783441619.117966:0:14180:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1783441619.117967:0:14180:0:(obd_config.c:1561:class_process_config()) marker 10 (0x6) lustre sys.timeout 00000020:01000000:2.0:1783441619.117969:0:14180:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:2.0:1783441619.117973:0:14180:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0000 (0) in 0 of lustre-mdt1/mdt1 00000020:00000080:2.0:1783441619.117976:0:14180:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1783441619.117977:0:14180:0:(obd_config.c:1561:class_process_config()) marker 12 (0x1) lustre-OST0000 add osc 00000020:00000080:2.0:1783441619.117980:0:14180:0:(obd_config.c:1470:class_process_config()) processing cmd: cf005 00000020:00000080:2.0:1783441619.117985:0:14180:0:(obd_config.c:1485:class_process_config()) adding mapping from uuid 192.168.201.113@tcp to nid 0x20000c0a8c971 (192.168.201.113@tcp) 00000020:01000000:2.0:1783441619.118014:0:14180:0:(obd_config.c:1975:class_config_llog_handler()) For 2.x interoperability, rename obd type from osc to osp (lustre-MDT0000) 00000020:00000080:2.0:1783441619.118017:0:14180:0:(obd_config.c:1470:class_process_config()) processing cmd: cf001 00000020:00000080:2.0:1783441619.118035:0:14180:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000-osc-MDT0000 (ffff91a8476799c0) 00000020:00000080:2.0:1783441619.118052:0:14180:0:(obd_config.c:720:class_attach_name()) OBD: dev 8 attached type osp with refcount 2 00000020:00000080:2.0:1783441619.118057:0:14180:0:(obd_config.c:1470:class_process_config()) processing cmd: cf003 00000004:00080000:2.0:1783441619.118124:0:14180:0:(osp_dev.c:1203:osp_init0()) lustre-OST0000-osc-MDT0000: connect to lustre-MDT0000-osd (lustre-OST0000-osc-MDT0000) 00080000:01000000:2.0:1783441619.118130:0:14180:0:(osd_handler.c:1569:osd_obd_connect()) connect #5 00000020:00000080:2.0:1783441619.118138:0:14180:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0xa2426164df2c87ff 00010000:00080000:2.0:1783441619.118168:0:14180:0:(ldlm_lib.c:102:import_set_conn()) imp ffff91a84869f800@lustre-OST0000-osc-MDT0000: add connection 192.168.201.113@tcp at head 00010000:00010000:2.0:1783441619.118475:0:14180:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-lustre-OST0000-osc-MDT0000-1 is initialized 00000040:01000000:2.0:1783441619.119227:0:14180:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000040:01000000:2.0:1783441619.126393:0:14180:0:(llog_obd.c:197:llog_setup()) obd lustre-OST0000-osc-MDT0000 ctxt 2 is initialized 00000040:00080000:2.0:1783441619.129034:0:14180:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1783441619.129112:0:14180:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x2:0x0].2, 64 off8320 00000040:00080000:2.0:1783441619.129813:0:14180:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xa:0x0].1, 64 off8256 00000040:00080000:2.0:1783441619.131715:0:14184:0:(llog.c:805:llog_process_thread()) index: 2, lh_last_idx: 2 synced_idx: 2 lgh_last_idx: 2 00000040:00080000:2.0:1783441619.131723:0:14184:0:(llog_cat.c:841:llog_cat_process_common()) processing log [0x1:0xa:0x0] at index 2 of catalog [0x1:0x2:0x0] 00000020:00000080:0.0:1783441619.132806:0:14180:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:0.0:1783441619.132822:0:14180:0:(obd_config.c:1470:class_process_config()) processing cmd: cf00d 00000004:01000000:0.0:1783441619.132859:0:14180:0:(lod_lov.c:128:lod_add_device()) osp:lustre-OST0000_UUID idx:0 gen:1 00000020:00000080:0.0:1783441619.132879:0:14180:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0xa2426164df2c8806 00000100:00080000:0.0:1783441619.132888:0:14180:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:0.0:1783441619.132894:0:14180:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-MDT0000: import ffff91a84869f800 using connection 192.168.201.113@tcp/0@lo 00000100:00100000:0.0:1783441619.132930:0:14180:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff91a877fae300 x1870073693300736/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1783441619.132960:0:14180:0:(pinger.c:374:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID 00000100:00100000:2.0:1783441619.133057:0:3303:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1783441619.133072:0:3303:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff91a877faf800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:94394728-4014-4ef0-b525-989290f008aa:3303:1870073693300864:0@lo:400:kworker.0 00000020:01000000:0.0:1783441619.133099:0:14180:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1783441619.133106:0:14180:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1783441619.133108:0:14180:0:(obd_config.c:1561:class_process_config()) marker 12 (0x2) lustre-OST0000 add osc 00000020:01000000:0.0:1783441619.133112:0:14180:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:0.0:1783441619.133115:0:14180:0:(obd_config.c:1899:class_config_llog_handler()) SKIP #16 00000020:01000000:0.0:1783441619.133117:0:14180:0:(obd_config.c:1925:class_config_llog_handler()) skipping 0x6 00000020:01000000:0.0:1783441619.133119:0:14180:0:(obd_config.c:1925:class_config_llog_handler()) skipping 0x6 00000020:01000000:0.0:1783441619.133132:0:14180:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:0.0:1783441619.133135:0:14180:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1783441619.133138:0:14180:0:(obd_config.c:1561:class_process_config()) marker 16 (0x6) lustre sys.timeout 00000100:00100000:2.0:1783441619.133142:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000020:01000000:0.0:1783441619.133145:0:14180:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:0.0:1783441619.133151:0:14180:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0001 (1) in 0 of lustre-mdt1/mdt1 00000020:00000080:0.0:1783441619.133154:0:14180:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1783441619.133155:0:14180:0:(obd_config.c:1561:class_process_config()) marker 18 (0x1) lustre-OST0001 add osc 00000020:00000080:0.0:1783441619.133158:0:14180:0:(obd_config.c:1470:class_process_config()) processing cmd: cf005 00000020:00000080:0.0:1783441619.133162:0:14180:0:(obd_config.c:1485:class_process_config()) adding mapping from uuid 192.168.201.113@tcp to nid 0x20000c0a8c971 (192.168.201.113@tcp) 00000020:01000000:0.0:1783441619.133183:0:14180:0:(obd_config.c:1975:class_config_llog_handler()) For 2.x interoperability, rename obd type from osc to osp (lustre-MDT0000) 00000020:00000080:0.0:1783441619.133186:0:14180:0:(obd_config.c:1470:class_process_config()) processing cmd: cf001 00000020:00000080:0.0:1783441619.133197:0:14180:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001-osc-MDT0000 (ffff91a8756b8000) 00000020:00000080:0.0:1783441619.133209:0:14180:0:(obd_config.c:720:class_attach_name()) OBD: dev 9 attached type osp with refcount 2 00000020:00000080:0.0:1783441619.133213:0:14180:0:(obd_config.c:1470:class_process_config()) processing cmd: cf003 00000004:00080000:0.0:1783441619.133291:0:14180:0:(osp_dev.c:1203:osp_init0()) lustre-OST0001-osc-MDT0000: connect to lustre-MDT0000-osd (lustre-OST0001-osc-MDT0000) 00080000:01000000:0.0:1783441619.133297:0:14180:0:(osd_handler.c:1569:osd_obd_connect()) connect #6 00000020:00000080:0.0:1783441619.133430:0:14180:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0xa2426164df2c8814 00010000:00080000:0.0:1783441619.133468:0:14180:0:(ldlm_lib.c:102:import_set_conn()) imp ffff91a848696000@lustre-OST0001-osc-MDT0000: add connection 192.168.201.113@tcp at head 00010000:00010000:0.0:1783441619.133671:0:14180:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-lustre-OST0001-osc-MDT0000-2 is initialized 00000040:01000000:0.0:1783441619.133884:0:14180:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000100:00100000:3.0:1783441619.133892:0:3302:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff91a877fae300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3302:1870073693300736:0@lo:8:llog_process_th.0 00000040:01000000:0.0:1783441619.133905:0:14180:0:(llog_obd.c:197:llog_setup()) obd lustre-OST0001-osc-MDT0000 ctxt 2 is initialized 00000400:00000100:3.0:1783441619.133923:0:3302:0:(lib-move.c:4262:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1870073693300736 offset 0 length 520: 4 00000100:00100000:3.0:1783441619.133961:0:14155:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073693300864 00000100:00100000:3.0:1783441619.133967:0:14155:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073693300864 00000100:00100000:3.0:1783441619.134005:0:14155:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:3.0:1783441619.134013:0:14155:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a8492a0450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:94394728-4014-4ef0-b525-989290f008aa+9:3303:x1870073693300864:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1783441619.134074:0:14155:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a8492a0450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:94394728-4014-4ef0-b525-989290f008aa+9:3303:x1870073693300864:12345-0@lo:400:kworker.0 Request processed in 61us (934us total) trans 0 rc 0/0 00000100:00100000:3.0:1783441619.134081:0:14155:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:2.0:1783441619.134170:0:3303:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff91a877faf800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:94394728-4014-4ef0-b525-989290f008aa:3303:1870073693300864:0@lo:400:kworker.0 00000040:00080000:0.0:1783441619.137867:0:14180:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1783441619.137962:0:14180:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x5:0x0].2, 64 off8320 00000040:00080000:0.0:1783441619.138051:0:14180:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xc:0x0].1, 64 off8256 00000040:00080000:2.0:1783441619.139820:0:14186:0:(llog.c:805:llog_process_thread()) index: 2, lh_last_idx: 2 synced_idx: 2 lgh_last_idx: 2 00000040:00080000:2.0:1783441619.139827:0:14186:0:(llog_cat.c:841:llog_cat_process_common()) processing log [0x1:0xc:0x0] at index 2 of catalog [0x1:0x5:0x0] 00000020:00000080:0.0:1783441619.147945:0:14180:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:0.0:1783441619.147961:0:14180:0:(obd_config.c:1470:class_process_config()) processing cmd: cf00d 00000004:01000000:0.0:1783441619.147999:0:14180:0:(lod_lov.c:128:lod_add_device()) osp:lustre-OST0001_UUID idx:1 gen:1 00000020:00000080:0.0:1783441619.148023:0:14180:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0xa2426164df2c881b 00000100:00080000:0.0:1783441619.148035:0:14180:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:0.0:1783441619.148041:0:14180:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff91a848696000 using connection 192.168.201.113@tcp/0@lo 00000100:00100000:0.0:1783441619.148088:0:14180:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff91a877faca80 x1870073693300992/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1783441619.148126:0:14180:0:(pinger.c:374:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID 00000020:01000000:0.0:1783441619.148192:0:14180:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1783441619.148196:0:14180:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1783441619.148198:0:14180:0:(obd_config.c:1561:class_process_config()) marker 18 (0x2) lustre-OST0001 add osc 00000020:01000000:0.0:1783441619.148202:0:14180:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1783441619.148206:0:14180:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1783441619.148207:0:14180:0:(obd_config.c:1561:class_process_config()) marker 22 (0x1) lustre sys.timeout 00000020:00000080:0.0:1783441619.148209:0:14180:0:(obd_config.c:1470:class_process_config()) processing cmd: cf009 00000020:00000080:0.0:1783441619.148211:0:14180:0:(obd_config.c:1535:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:0.0:1783441619.148213:0:14180:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1783441619.148215:0:14180:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1783441619.148216:0:14180:0:(obd_config.c:1561:class_process_config()) marker 22 (0x2) lustre sys.timeout 00000020:01000000:0.0:1783441619.148218:0:14180:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1783441619.148220:0:14180:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1783441619.148221:0:14180:0:(obd_config.c:1561:class_process_config()) marker 26 (0x1) lustre sys.jobid_var 00000020:00000080:0.0:1783441619.148224:0:14180:0:(obd_config.c:1470:class_process_config()) processing cmd: cf00f 00000100:00100000:0.0:1783441619.148266:0:14180:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff91a877fad500 pname:cluuid:pid:xid:nid:opc:job llog_process_th:94394728-4014-4ef0-b525-989290f008aa:14180:1870073693301120:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1783441619.148342:0:14180:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783441619.148385:0:14180:0:(client.c:2702:ptlrpc_set_wait()) set ffff91a84540b000 going to sleep for 11 seconds 00000100:00100000:2.0:1783441619.148430:0:14156:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073693301120 00000100:00100000:2.0:1783441619.148438:0:14156:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073693301120 00000100:00100000:2.0:1783441619.148486:0:14156:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:3.0:1783441619.148487:0:3302:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff91a877faca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3302:1870073693300992:0@lo:8:llog_process_th.0 00000100:00100000:2.0:1783441619.148495:0:14156:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a8492a1450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:94394728-4014-4ef0-b525-989290f008aa+9:14180:x1870073693301120:12345-0@lo:502:llog_process_th.0 00000400:00000100:3.0:1783441619.148514:0:3302:0:(lib-move.c:4262:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1870073693300992 offset 0 length 520: 4 00000100:00100000:2.0:1783441619.148771:0:14156:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a8492a1450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:94394728-4014-4ef0-b525-989290f008aa+9:14180:x1870073693301120:12345-0@lo:502:llog_process_th.0 Request processed in 276us (428us total) trans 0 rc 0/0 00000100:00100000:2.0:1783441619.148779:0:14156:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:0.0:1783441619.152394:0:14180:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff91a877fad500 pname:cluuid:pid:xid:nid:opc:job llog_process_th:94394728-4014-4ef0-b525-989290f008aa:14180:1870073693301120:0@lo:502:llog_process_th.0 00000020:01000000:0.0:1783441619.152445:0:14180:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1783441619.152456:0:14180:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1783441619.152458:0:14180:0:(obd_config.c:1561:class_process_config()) marker 26 (0x2) lustre sys.jobid_var 00000040:00080000:0.0:1783441619.152464:0:14180:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 37 count 37 00000020:01000000:3.0:1783441619.152703:0:14145:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0000 gen 1-36 (rc=0) 10000000:01000000:3.0:1783441619.152734:0:14145:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.201.113@tcp: configuration from log 'lustre-MDT0000' succeeded (0). 00010000:00010000:3.0:1783441619.152787:0:14145:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.113@tcp lock: ffff91a841477c00/0xa2426164df2c87a4 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xa2426164df2c87ab expref: -99 pid: 14145 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783441619.152800:0:14145:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.113@tcp lock: ffff91a841477c00/0xa2426164df2c87a4 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xa2426164df2c87ab expref: -99 pid: 14145 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1783441619.152808:0:14145:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-mdtir-ffff91a844b0f000 from 1 10000000:01000000:3.0:1783441619.152812:0:14145:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:3.0:1783441619.152851:0:14145:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.113@tcp lock: ffff91a841476000/0xa2426164df2c8822 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14145 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783441619.152859:0:14145:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.113@tcp lock: ffff91a841476000/0xa2426164df2c8822 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14145 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783441619.152867:0:14145:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.113@tcp lock: ffff91a841476000/0xa2426164df2c8822 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14145 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783441619.152888:0:14145:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff91a874dced80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:94394728-4014-4ef0-b525-989290f008aa:14145:1870073693301248:0@lo:101:mount.lustre.0 00000100:00100000:3.0:1783441619.152969:0:14145:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783441619.153008:0:14145:0:(client.c:2702:ptlrpc_set_wait()) set ffff91a848f25b40 going to sleep for 11 seconds 00000100:00100000:0.0:1783441619.155268:0:14157:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073693301248 00000100:00100000:0.0:1783441619.155283:0:14157:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073693301248 00000100:00100000:0.0:1783441619.155342:0:14157:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:0.0:1783441619.155352:0:14157:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a8492a1850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:94394728-4014-4ef0-b525-989290f008aa+9:14145:x1870073693301248:12345-0@lo:101:mount.lustre.0 00010000:00010000:0.0:1783441619.155368:0:14157:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1783441619.155401:0:14157:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff91a85fe58c00/0xa2426164df2c8829 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xa2426164df2c8822 expref: -99 pid: 14157 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783441619.155429:0:14157:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff91a85fe58c00/0xa2426164df2c8829 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xa2426164df2c8822 expref: 10 pid: 14157 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783441619.155439:0:14157:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff91a85fe58c00/0xa2426164df2c8829 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xa2426164df2c8822 expref: 10 pid: 14157 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783441619.155448:0:14157:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91a85fe58c00, rc 0) 00000100:00100000:0.0:1783441619.155529:0:14157:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a8492a1850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:94394728-4014-4ef0-b525-989290f008aa+10:14145:x1870073693301248:12345-0@lo:101:mount.lustre.0 Request processed in 177us (2558us total) trans 0 rc 0/0 00000100:00100000:0.0:1783441619.155536:0:14157:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:2.0:1783441619.155579:0:14145:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff91a874dced80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:94394728-4014-4ef0-b525-989290f008aa:14145:1870073693301248:0@lo:101:mount.lustre.0 00010000:00010000:2.0:1783441619.155599:0:14145:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.113@tcp lock: ffff91a841476000/0xa2426164df2c8822 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xa2426164df2c8829 expref: -99 pid: 14145 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783441619.155608:0:14145:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.113@tcp lock: ffff91a841476000/0xa2426164df2c8822 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xa2426164df2c8829 expref: -99 pid: 14145 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783441619.156214:0:14145:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff91a859087800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:94394728-4014-4ef0-b525-989290f008aa:14145:1870073693301376:0@lo:256:mount.lustre.0 00000100:00100000:2.0:1783441619.164256:0:14145:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783441619.164314:0:14145:0:(client.c:2702:ptlrpc_set_wait()) set ffff91a844b00cc0 going to sleep for 11 seconds 00000100:00100000:0.0:1783441619.165069:0:14156:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073693301376 00000100:00100000:0.0:1783441619.165095:0:14156:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073693301376 00000100:00100000:0.0:1783441619.165193:0:14156:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:0.0:1783441619.165203:0:14156:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a8492a3850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:94394728-4014-4ef0-b525-989290f008aa+10:14145:x1870073693301376:12345-0@lo:256:mount.lustre.0 20000000:01000000:0.0:1783441619.165237:0:14156:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 1048576. 20000000:01000000:0.0:1783441619.165246:0:14156:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 0, version 1 00000100:00100000:0.0:1783441619.165347:0:14156:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a8492a3850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:94394728-4014-4ef0-b525-989290f008aa+10:14145:x1870073693301376:12345-0@lo:256:mount.lustre.0 Request processed in 147us (1099us total) trans 0 rc 0/0 00000100:00100000:0.0:1783441619.165355:0:14156:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:2.0:1783441619.165441:0:14145:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff91a859087800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:94394728-4014-4ef0-b525-989290f008aa:14145:1870073693301376:0@lo:256:mount.lustre.0 10000000:01000000:2.0:1783441619.167361:0:14145:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.201.113@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:2.0:1783441619.167384:0:14145:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.113@tcp lock: ffff91a841476000/0xa2426164df2c8822 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xa2426164df2c8829 expref: -99 pid: 14145 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783441619.167396:0:14145:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.113@tcp lock: ffff91a841476000/0xa2426164df2c8822 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xa2426164df2c8829 expref: -99 pid: 14145 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1783441619.167404:0:14145:0:(mgc_request.c:1801:mgc_process_log()) Process log params-ffff91a844b0f000 from 1 10000000:01000000:2.0:1783441619.167407:0:14145:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:2.0:1783441619.167451:0:14145:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.113@tcp lock: ffff91a85eaa1a00/0xa2426164df2c8830 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14145 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783441619.167459:0:14145:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.113@tcp lock: ffff91a85eaa1a00/0xa2426164df2c8830 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14145 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783441619.167469:0:14145:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.113@tcp lock: ffff91a85eaa1a00/0xa2426164df2c8830 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14145 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783441619.167492:0:14145:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff91a859087800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:94394728-4014-4ef0-b525-989290f008aa:14145:1870073693301504:0@lo:101:mount.lustre.0 00000100:00100000:2.0:1783441619.167554:0:14145:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783441619.177507:0:14145:0:(client.c:2702:ptlrpc_set_wait()) set ffff91a844b00cc0 going to sleep for 11 seconds 00000100:00100000:1.0:1783441619.183430:0:14155:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073693301504 00000100:00100000:1.0:1783441619.183445:0:14155:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073693301504 00000100:00100000:1.0:1783441619.183515:0:14155:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:1.0:1783441619.183525:0:14155:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a8492a3450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:94394728-4014-4ef0-b525-989290f008aa+10:14145:x1870073693301504:12345-0@lo:101:mount.lustre.0 00010000:00010000:1.0:1783441619.183543:0:14155:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1783441619.183567:0:14155:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff91a87da47800/0xa2426164df2c8837 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xa2426164df2c8830 expref: -99 pid: 14155 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783441619.183836:0:14155:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff91a87da47800/0xa2426164df2c8837 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xa2426164df2c8830 expref: 11 pid: 14155 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783441619.183850:0:14155:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff91a87da47800/0xa2426164df2c8837 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xa2426164df2c8830 expref: 11 pid: 14155 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783441619.183860:0:14155:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91a87da47800, rc 0) 00000100:00100000:1.0:1783441619.183938:0:14155:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a8492a3450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:94394728-4014-4ef0-b525-989290f008aa+11:14145:x1870073693301504:12345-0@lo:101:mount.lustre.0 Request processed in 413us (16383us total) trans 0 rc 0/0 00000100:00100000:1.0:1783441619.183945:0:14155:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:2.0:1783441619.184071:0:14145:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff91a859087800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:94394728-4014-4ef0-b525-989290f008aa:14145:1870073693301504:0@lo:101:mount.lustre.0 00010000:00010000:2.0:1783441619.184089:0:14145:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.113@tcp lock: ffff91a85eaa1a00/0xa2426164df2c8830 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xa2426164df2c8837 expref: -99 pid: 14145 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783441619.184099:0:14145:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.113@tcp lock: ffff91a85eaa1a00/0xa2426164df2c8830 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xa2426164df2c8837 expref: -99 pid: 14145 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783441619.184182:0:14145:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff91a859087800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:94394728-4014-4ef0-b525-989290f008aa:14145:1870073693301632:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1783441619.184218:0:14145:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783441619.184268:0:14145:0:(client.c:2702:ptlrpc_set_wait()) set ffff91a844b00cc0 going to sleep for 11 seconds 00000100:00100000:1.0:1783441619.184440:0:14155:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073693301632 00000100:00100000:1.0:1783441619.184445:0:14155:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073693301632 00000100:00100000:1.0:1783441619.184465:0:14155:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:1.0:1783441619.184472:0:14155:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a85010bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:94394728-4014-4ef0-b525-989290f008aa+11:14145:x1870073693301632:12345-0@lo:501:mount.lustre.0 00000100:00100000:1.0:1783441619.187002:0:14155:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a85010bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:94394728-4014-4ef0-b525-989290f008aa+11:14145:x1870073693301632:12345-0@lo:501:mount.lustre.0 Request processed in 2521us (2775us total) trans 0 rc 0/0 00000100:00100000:1.0:1783441619.187015:0:14155:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:3.0:1783441619.187150:0:14145:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff91a859087800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:94394728-4014-4ef0-b525-989290f008aa:14145:1870073693301632:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1783441619.187206:0:14145:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff91a874dcea00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:94394728-4014-4ef0-b525-989290f008aa:14145:1870073693301760:0@lo:503:mount.lustre.0 00000100:00100000:3.0:1783441619.187269:0:14145:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783441619.187307:0:14145:0:(client.c:2702:ptlrpc_set_wait()) set ffff91a848f25180 going to sleep for 11 seconds 00000100:00100000:0.0:1783441619.187362:0:14156:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073693301760 00000100:00100000:0.0:1783441619.187369:0:14156:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073693301760 00000100:00100000:0.0:1783441619.187413:0:14156:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:0.0:1783441619.187422:0:14156:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a85010b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:94394728-4014-4ef0-b525-989290f008aa+11:14145:x1870073693301760:12345-0@lo:503:mount.lustre.0 00000100:00100000:0.0:1783441619.187612:0:14156:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a85010b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:94394728-4014-4ef0-b525-989290f008aa+11:14145:x1870073693301760:12345-0@lo:503:mount.lustre.0 Request processed in 190us (342us total) trans 0 rc 0/0 00000100:00100000:0.0:1783441619.187618:0:14156:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:2.0:1783441619.187716:0:14145:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff91a874dcea00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:94394728-4014-4ef0-b525-989290f008aa:14145:1870073693301760:0@lo:503:mount.lustre.0 00000100:00100000:0.0:1783441619.193370:0:14188:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff91a877fad500 pname:cluuid:pid:xid:nid:opc:job llog_process_th:94394728-4014-4ef0-b525-989290f008aa:14188:1870073693301888:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1783441619.193463:0:14188:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783441619.193512:0:14188:0:(client.c:2702:ptlrpc_set_wait()) set ffff91a8504a3e40 going to sleep for 11 seconds 00000100:00100000:2.0:1783441619.193537:0:14155:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073693301888 00000100:00100000:2.0:1783441619.193545:0:14155:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073693301888 00000100:00100000:2.0:1783441619.193597:0:14155:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:2.0:1783441619.193607:0:14155:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a844bde050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:94394728-4014-4ef0-b525-989290f008aa+11:14188:x1870073693301888:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1783441619.195989:0:14155:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a844bde050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:94394728-4014-4ef0-b525-989290f008aa+11:14188:x1870073693301888:12345-0@lo:502:llog_process_th.0 Request processed in 2374us (2517us total) trans 0 rc 0/0 00000100:00100000:2.0:1783441619.196003:0:14155:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:0.0:1783441619.196512:0:14188:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff91a877fad500 pname:cluuid:pid:xid:nid:opc:job llog_process_th:94394728-4014-4ef0-b525-989290f008aa:14188:1870073693301888:0@lo:502:llog_process_th.0 00000020:01000000:0.0:1783441619.196551:0:14188:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1783441619.196563:0:14188:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1783441619.196565:0:14188:0:(obd_config.c:1561:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:0.0:1783441619.196572:0:14188:0:(obd_config.c:2005:class_config_llog_handler()) cmd ce032, instance name: general-ffff91a844b0f000 00000020:00000080:0.0:1783441619.196574:0:14188:0:(obd_config.c:1470:class_process_config()) processing cmd: ce032 00000020:01000000:0.0:1783441619.196581:0:14188:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1783441619.196583:0:14188:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1783441619.196584:0:14188:0:(obd_config.c:1561:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000020:01000000:0.0:1783441619.196586:0:14188:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1783441619.196589:0:14188:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1783441619.196590:0:14188:0:(obd_config.c:1561:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:0.0:1783441619.196593:0:14188:0:(obd_config.c:2005:class_config_llog_handler()) cmd ce032, instance name: general-ffff91a844b0f000 00000020:00000080:0.0:1783441619.196594:0:14188:0:(obd_config.c:1470:class_process_config()) processing cmd: ce032 00000020:01000000:0.0:1783441619.196772:0:14188:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1783441619.196776:0:14188:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1783441619.196778:0:14188:0:(obd_config.c:1561:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000020:01000000:0.0:1783441619.196781:0:14188:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1783441619.196784:0:14188:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1783441619.196785:0:14188:0:(obd_config.c:1561:class_process_config()) marker 4 (0x1) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:0.0:1783441619.196789:0:14188:0:(obd_config.c:2005:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff91a844b0f000 00000020:00000080:0.0:1783441619.196791:0:14188:0:(obd_config.c:1470:class_process_config()) processing cmd: ce032 00000100:00100000:0.0:1783441619.196841:0:14188:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff91a877fad500 pname:cluuid:pid:xid:nid:opc:job llog_process_th:94394728-4014-4ef0-b525-989290f008aa:14188:1870073693302016:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1783441619.196898:0:14188:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783441619.196973:0:14188:0:(client.c:2702:ptlrpc_set_wait()) set ffff91a8504a3e40 going to sleep for 11 seconds 00000100:00100000:3.0:1783441619.203065:0:14157:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073693302016 00000100:00100000:3.0:1783441619.203080:0:14157:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073693302016 00000100:00100000:3.0:1783441619.203189:0:14157:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:3.0:1783441619.203200:0:14157:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a844bdfc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:94394728-4014-4ef0-b525-989290f008aa+11:14188:x1870073693302016:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1783441619.203477:0:14157:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a844bdfc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:94394728-4014-4ef0-b525-989290f008aa+11:14188:x1870073693302016:12345-0@lo:502:llog_process_th.0 Request processed in 278us (6577us total) trans 0 rc 0/0 00000100:00100000:3.0:1783441619.203487:0:14157:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:3.0:1783441619.206894:0:14188:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff91a877fad500 pname:cluuid:pid:xid:nid:opc:job llog_process_th:94394728-4014-4ef0-b525-989290f008aa:14188:1870073693302016:0@lo:502:llog_process_th.0 00000020:01000000:3.0:1783441619.206940:0:14188:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1783441619.206950:0:14188:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1783441619.206953:0:14188:0:(obd_config.c:1561:class_process_config()) marker 4 (0x2) lustre mdt.lustre-MDT0000.hsm_control 00000040:00080000:3.0:1783441619.206957:0:14188:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 10 count 10 00000020:01000000:2.0:1783441619.210054:0:14145:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-9 (rc=0) 10000000:01000000:2.0:1783441619.210088:0:14145:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.201.113@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:2.0:1783441619.210114:0:14145:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.113@tcp lock: ffff91a85eaa1a00/0xa2426164df2c8830 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xa2426164df2c8837 expref: -99 pid: 14145 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783441619.210127:0:14145:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.113@tcp lock: ffff91a85eaa1a00/0xa2426164df2c8830 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xa2426164df2c8837 expref: -99 pid: 14145 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1783441619.210175:0:14145:0:(mgc_request.c:1943:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:2.0:1783441619.210178:0:14145:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff91a844b0f000 10000000:01000000:2.0:1783441619.210181:0:14145:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff91a844b0f000 10000000:01000000:2.0:1783441619.210185:0:14145:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:2.0:1783441619.210191:0:14145:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-client-ffff91a844b0f000 from 1 10000000:01000000:2.0:1783441619.210194:0:14145:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:2.0:1783441619.210900:0:14145:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.113@tcp lock: ffff91a85eaa1200/0xa2426164df2c883e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14145 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783441619.210918:0:14145:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.113@tcp lock: ffff91a85eaa1200/0xa2426164df2c883e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14145 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783441619.210932:0:14145:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.113@tcp lock: ffff91a85eaa1200/0xa2426164df2c883e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14145 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783441619.210960:0:14145:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff91a859084380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:94394728-4014-4ef0-b525-989290f008aa:14145:1870073693302144:0@lo:101:mount.lustre.0 00000100:00100000:2.0:1783441619.211030:0:14145:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783441619.211077:0:14145:0:(client.c:2702:ptlrpc_set_wait()) set ffff91a844b00900 going to sleep for 11 seconds 00000100:00100000:1.0:1783441619.211130:0:14155:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073693302144 00000100:00100000:1.0:1783441619.211142:0:14155:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073693302144 00000100:00100000:1.0:1783441619.211194:0:14155:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:1.0:1783441619.211203:0:14155:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a844bdc850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:94394728-4014-4ef0-b525-989290f008aa+11:14145:x1870073693302144:12345-0@lo:101:mount.lustre.0 00010000:00010000:1.0:1783441619.211217:0:14155:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1783441619.211244:0:14155:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff91a87da46000/0xa2426164df2c8845 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0xa2426164df2c883e expref: -99 pid: 14155 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783441619.211269:0:14155:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff91a87da46000/0xa2426164df2c8845 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xa2426164df2c883e expref: 12 pid: 14155 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783441619.211280:0:14155:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff91a87da46000/0xa2426164df2c8845 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xa2426164df2c883e expref: 12 pid: 14155 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783441619.211288:0:14155:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91a87da46000, rc 0) 00000100:00100000:1.0:1783441619.211326:0:14155:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a844bdc850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:94394728-4014-4ef0-b525-989290f008aa+12:14145:x1870073693302144:12345-0@lo:101:mount.lustre.0 Request processed in 125us (297us total) trans 0 rc 0/0 00000100:00100000:1.0:1783441619.211333:0:14155:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:2.0:1783441619.211487:0:14145:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff91a859084380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:94394728-4014-4ef0-b525-989290f008aa:14145:1870073693302144:0@lo:101:mount.lustre.0 00010000:00010000:2.0:1783441619.211501:0:14145:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.113@tcp lock: ffff91a85eaa1200/0xa2426164df2c883e lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xa2426164df2c8845 expref: -99 pid: 14145 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783441619.211510:0:14145:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.113@tcp lock: ffff91a85eaa1200/0xa2426164df2c883e lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0xa2426164df2c8845 expref: -99 pid: 14145 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783441619.211562:0:14145:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff91a859084380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:94394728-4014-4ef0-b525-989290f008aa:14145:1870073693302272:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1783441619.211587:0:14145:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783441619.211610:0:14145:0:(client.c:2702:ptlrpc_set_wait()) set ffff91a844b00900 going to sleep for 11 seconds 00000100:00100000:1.0:1783441619.212786:0:14157:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073693302272 00000100:00100000:1.0:1783441619.212796:0:14157:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073693302272 00000100:00100000:1.0:1783441619.212841:0:14157:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:1.0:1783441619.212850:0:14157:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a875619c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:94394728-4014-4ef0-b525-989290f008aa+12:14145:x1870073693302272:12345-0@lo:501:mount.lustre.0 00000100:00100000:1.0:1783441619.213159:0:14157:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a875619c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:94394728-4014-4ef0-b525-989290f008aa+12:14145:x1870073693302272:12345-0@lo:501:mount.lustre.0 Request processed in 309us (1570us total) trans 0 rc 0/0 00000100:00100000:1.0:1783441619.213167:0:14157:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00100000:2.0:1783441619.213545:0:14145:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff91a859084380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:94394728-4014-4ef0-b525-989290f008aa:14145:1870073693302272:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1783441619.213594:0:14145:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff91a859084380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:94394728-4014-4ef0-b525-989290f008aa:14145:1870073693302400:0@lo:503:mount.lustre.0 00000100:00100000:2.0:1783441619.213657:0:14145:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783441619.213686:0:14145:0:(client.c:2702:ptlrpc_set_wait()) set ffff91a844b00900 going to sleep for 11 seconds 00000100:00100000:2.0:1783441619.213703:0:14156:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073693302400 00000100:00100000:2.0:1783441619.213707:0:14156:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073693302400 00000100:00100000:2.0:1783441619.213763:0:14156:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:2.0:1783441619.213779:0:14156:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a87561b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:94394728-4014-4ef0-b525-989290f008aa+12:14145:x1870073693302400:12345-0@lo:503:mount.lustre.0 00000100:00100000:2.0:1783441619.213944:0:14156:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a87561b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:94394728-4014-4ef0-b525-989290f008aa+12:14145:x1870073693302400:12345-0@lo:503:mount.lustre.0 Request processed in 167us (287us total) trans 0 rc 0/0 00000100:00100000:2.0:1783441619.213952:0:14156:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00100000:2.0:1783441619.213991:0:14145:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff91a859084380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:94394728-4014-4ef0-b525-989290f008aa:14145:1870073693302400:0@lo:503:mount.lustre.0 00000100:00100000:1.0:1783441619.215527:0:14192:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff91a745552680 pname:cluuid:pid:xid:nid:opc:job llog_process_th:94394728-4014-4ef0-b525-989290f008aa:14192:1870073693302528:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1783441619.215591:0:14192:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783441619.216285:0:14192:0:(client.c:2702:ptlrpc_set_wait()) set ffff91a862ffab40 going to sleep for 11 seconds 00000100:00100000:2.0:1783441619.218921:0:14155:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073693302528 00000100:00100000:2.0:1783441619.218936:0:14155:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073693302528 00000100:00100000:2.0:1783441619.218997:0:14155:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:2.0:1783441619.219009:0:14155:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a875619050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:94394728-4014-4ef0-b525-989290f008aa+12:14192:x1870073693302528:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1783441619.220556:0:14155:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a875619050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:94394728-4014-4ef0-b525-989290f008aa+12:14192:x1870073693302528:12345-0@lo:502:llog_process_th.0 Request processed in 1544us (4959us total) trans 0 rc 0/0 00000100:00100000:2.0:1783441619.220569:0:14155:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00100000:0.0:1783441619.222388:0:14192:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff91a745552680 pname:cluuid:pid:xid:nid:opc:job llog_process_th:94394728-4014-4ef0-b525-989290f008aa:14192:1870073693302528:0@lo:502:llog_process_th.0 00000020:01000004:0.0:1783441619.222487:0:14192:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-MDT0000 (typ=lwp) 00000020:00000080:0.0:1783441619.222512:0:14192:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-MDT0000 (ffff91a8756bcd40) 00000020:00000080:0.0:1783441619.222535:0:14192:0:(obd_config.c:720:class_attach_name()) OBD: dev 10 attached type lwp with refcount 2 00000020:01000004:0.0:1783441619.222738:0:14192:0:(tgt_mount.c:153:server_get_mount()) get mount ffff91a844b0f000 from lustre-MDT0000, refs=4 00000020:01000004:0.0:1783441619.222767:0:14192:0:(tgt_mount.c:187:server_put_mount()) put mount ffff91a844b0f000 from lustre-MDT0000, refs=4 00000020:01000004:0.0:1783441619.222771:0:14192:0:(obd_mount.c:710:lustre_put_lsi()) put ffff91a844b0f000 4 00010000:00080000:0.0:1783441619.222803:0:14192:0:(ldlm_lib.c:102:import_set_conn()) imp ffff91a85ff40000@lustre-MDT0000-lwp-MDT0000: add connection 192.168.201.113@tcp at head 00010000:00010000:0.0:1783441619.224434:0:14192:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-MDT0000-3 is initialized 00000020:00000080:0.0:1783441619.224550:0:14192:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-MDT0000 (uuid lustre-MDT0000-lwp-MDT0000_UUID) 00000010:01000000:0.0:1783441619.224587:0:14192:0:(lwp_dev.c:497:lwp_obd_connect()) connect #0 00000020:00000080:0.0:1783441619.224600:0:14192:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-lwp-MDT0000, cookie 0xa2426164df2c8853 00000100:00080000:0.0:1783441619.224611:0:14192:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:0.0:1783441619.224618:0:14192:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-MDT0000: import ffff91a85ff40000 using connection 192.168.201.113@tcp/0@lo 00000100:00100000:0.0:1783441619.224654:0:14192:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff91a877faf100 x1870073693302656/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1783441619.224693:0:14192:0:(pinger.c:374:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-MDT0000_UUID->lustre-MDT0000_UUID 00000100:00100000:2.0:1783441619.225053:0:3302:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff91a877faf100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3302:1870073693302656:0@lo:38:llog_process_th.0 00000100:00100000:2.0:1783441619.225136:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783441619.225200:0:14162:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073693302656 00000100:00100000:2.0:1783441619.225207:0:14162:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073693302656 00000100:00100000:2.0:1783441619.225261:0:14162:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1783441619.225268:0:14162:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a859084380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3302:x1870073693302656:12345-0@lo:38:llog_process_th.0 00000100:00100000:2.0:1783441619.225321:0:14162:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a859084380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3302:x1870073693302656:12345-0@lo:38:llog_process_th.0 Request processed in 51us (184us total) trans 0 rc -11/-11 00000100:00100000:2.0:1783441619.225328:0:14162:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1783441619.225371:0:3302:0:(client.c:3112:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:2.0:1783441619.225378:0:3302:0:(import.c:65:import_set_state_nolock()) ffff91a85ff40000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1783441619.225383:0:3302:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-11) 00000100:00100000:2.0:1783441619.225386:0:3302:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff91a877faf100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3302:1870073693302656:0@lo:38:llog_process_th.0 00000100:00100000:1.0:1783441619.228123:0:14192:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff91a745551f80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:94394728-4014-4ef0-b525-989290f008aa:14192:1870073693302784:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1783441619.228210:0:14192:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783441619.228259:0:14192:0:(client.c:2702:ptlrpc_set_wait()) set ffff91a87d8000c0 going to sleep for 11 seconds 00000100:00100000:1.0:1783441619.228281:0:14157:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073693302784 00000100:00100000:1.0:1783441619.228287:0:14157:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073693302784 00000100:00100000:1.0:1783441619.230199:0:14157:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:1.0:1783441619.230213:0:14157:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a875618c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:94394728-4014-4ef0-b525-989290f008aa+12:14192:x1870073693302784:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1783441619.233211:0:14157:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a875618c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:94394728-4014-4ef0-b525-989290f008aa+12:14192:x1870073693302784:12345-0@lo:502:llog_process_th.0 Request processed in 2093us (4092us total) trans 0 rc 0/0 00000100:00100000:1.0:1783441619.233226:0:14157:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:2.0:1783441619.234271:0:14192:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff91a745551f80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:94394728-4014-4ef0-b525-989290f008aa:14192:1870073693302784:0@lo:502:llog_process_th.0 00000040:00080000:2.0:1783441619.234317:0:14192:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 42 count 42 00000020:01000000:2.0:1783441619.234474:0:14145:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-41 (rc=0) 10000000:01000000:2.0:1783441619.234493:0:14145:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.201.113@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:2.0:1783441619.234508:0:14145:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.113@tcp lock: ffff91a85eaa1200/0xa2426164df2c883e lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xa2426164df2c8845 expref: -99 pid: 14145 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783441619.234519:0:14145:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.113@tcp lock: ffff91a85eaa1200/0xa2426164df2c883e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xa2426164df2c8845 expref: -99 pid: 14145 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:2.0:1783441619.234574:0:14145:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:2.0:1783441619.234577:0:14145:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:2.0:1783441619.234578:0:14145:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1783441619.234579:0:14145:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1783441619.234580:0:14145:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1783441619.234581:0:14145:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1783441619.234583:0:14145:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:2.0:1783441619.234585:0:14145:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:2.0:1783441619.234586:0:14145:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1783441619.234588:0:14145:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:2.0:1783441619.234592:0:14145:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-MDT0000 0x40020005 00000020:01000004:2.0:1783441619.234594:0:14145:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:2.0:1783441619.234595:0:14145:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:2.0:1783441619.234597:0:14145:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1783441619.234598:0:14145:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1783441619.234599:0:14145:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1783441619.234600:0:14145:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1783441619.234601:0:14145:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:2.0:1783441619.234601:0:14145:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:2.0:1783441619.234602:0:14145:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1783441619.234603:0:14145:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:2.0:1783441619.234904:0:14145:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-MDT0000 00000100:00100000:2.0:1783441619.234924:0:14145:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff91a859086d80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:94394728-4014-4ef0-b525-989290f008aa:14145:1870073693302912:0@lo:253:mount.lustre.0 00000100:00100000:2.0:1783441619.234983:0:14145:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783441619.235019:0:14145:0:(client.c:2702:ptlrpc_set_wait()) set ffff91a844b006c0 going to sleep for 11 seconds 00000100:00100000:2.0:1783441619.235039:0:14156:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073693302912 00000100:00100000:2.0:1783441619.235045:0:14156:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073693302912 00000100:00100000:2.0:1783441619.235144:0:14156:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:2.0:1783441619.235154:0:14156:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a875618850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:94394728-4014-4ef0-b525-989290f008aa+12:14145:x1870073693302912:12345-0@lo:253:mount.lustre.0 20000000:01000000:2.0:1783441619.235191:0:14156:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 0 is ready to reconnect. 20000000:01000000:2.0:1783441619.235204:0:14156:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 20000000:01000000:2.0:1783441619.364715:0:14156:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:2.0:1783441619.364735:0:14156:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-MDT0000, index=0, rc=0 20000000:01000000:1.0:1783441619.365479:0:14178:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:1.0:1783441619.365485:0:14178:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:1.0:1783441619.365508:0:14178:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff91a87da46600/0xa2426164df2c885a lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14178 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783441619.365527:0:14178:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff91a85fe58c00/0xa2426164df2c8829 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xa2426164df2c8822 expref: 12 pid: 14157 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783441619.365535:0:14178:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff91a87da46600/0xa2426164df2c885a lrc: 4/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 14178 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783441619.365576:0:14178:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff91a85fe58c00/0xa2426164df2c8829 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xa2426164df2c8822 expref: 12 pid: 14157 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783441619.365591:0:14178:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff91a85fe58c00/0xa2426164df2c8829 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xa2426164df2c8822 expref: 12 pid: 14157 timeout: 557 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783441619.365606:0:14178:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff91a745550e00 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:14178:1870073693303040:0@lo:104: 00000100:00100000:1.0:1783441619.365669:0:14178:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783441619.365738:0:14178:0:(client.c:2702:ptlrpc_set_wait()) set ffff91a846fb49c0 going to sleep for 11 seconds 00000100:00100000:3.0:1783441619.365871:0:14146:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073693303040 00000100:00100000:3.0:1783441619.365879:0:14146:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073693303040 00000100:00100000:3.0:1783441619.365919:0:14146:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1783441619.365929:0:14146:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a745552300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:94394728-4014-4ef0-b525-989290f008aa+3:14178:x1870073693303040:12345-0@lo:104: 00010000:00010000:3.0:1783441619.365943:0:14146:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.113@tcp lock: ffff91a841476000/0xa2426164df2c8822 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xa2426164df2c8829 expref: -99 pid: 14145 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783441619.365996:0:14146:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1783441619.366003:0:14146:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a745552300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:94394728-4014-4ef0-b525-989290f008aa+3:14178:x1870073693303040:12345-0@lo:104: Request processed in 75us (334us total) trans 0 rc 0/0 00000100:00100000:3.0:1783441619.366009:0:14146:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1783441619.366406:0:14178:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff91a745550e00 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:14178:1870073693303040:0@lo:104: 00010000:00010000:1.0:1783441619.366426:0:14178:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff91a87da46600/0xa2426164df2c885a lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14178 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783441619.368285:0:14152:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1783441619.368297:0:14152:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.113@tcp lock: ffff91a841476000/0xa2426164df2c8822 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xa2426164df2c8829 expref: -99 pid: 14145 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783441619.368308:0:14152:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91a841476000 already unused, calling callback (ffffffffc1b78c20) 10000000:00010000:0.0:1783441619.368313:0:14152:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.113@tcp lock: ffff91a841476000/0xa2426164df2c8822 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xa2426164df2c8829 expref: -99 pid: 14145 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783441619.368322:0:14152:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.113@tcp lock: ffff91a841476000/0xa2426164df2c8822 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xa2426164df2c8829 expref: -99 pid: 14145 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1783441619.368328:0:14152:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.113@tcp lock: ffff91a841476000/0xa2426164df2c8822 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xa2426164df2c8829 expref: -99 pid: 14145 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1783441619.368334:0:14152:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:0.0:1783441619.368445:0:14152:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.113@tcp lock: ffff91a841476000/0xa2426164df2c8822 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xa2426164df2c8829 expref: -99 pid: 14145 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783441619.368452:0:14152:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1783441619.368482:0:14152:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.113@tcp lock: ffff91a841476000/0xa2426164df2c8822 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xa2426164df2c8829 expref: -99 pid: 14145 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783441619.368488:0:14152:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.113@tcp lock: ffff91a841476000/0xa2426164df2c8822 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xa2426164df2c8829 expref: -99 pid: 14145 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783441619.368509:0:14152:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783441619.368511:0:14152:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783441619.368513:0:14152:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1783441619.368542:0:3306:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1783441619.368559:0:3306:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff91a877fadf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:94394728-4014-4ef0-b525-989290f008aa:3306:1870073693303168:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1783441619.368622:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783441619.368680:0:14148:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073693303168 00000100:00100000:0.0:1783441619.368687:0:14148:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073693303168 00010000:00010000:0.0:1783441619.368712:0:14148:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff91a85fe58c00/0xa2426164df2c8829 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xa2426164df2c8822 expref: 13 pid: 14157 timeout: 557 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783441619.368770:0:14148:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1783441619.368779:0:14148:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a877faf480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:94394728-4014-4ef0-b525-989290f008aa+13:3306:x1870073693303168:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1783441619.368792:0:14148:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1783441619.368798:0:14148:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff91a85fe58c00/0xa2426164df2c8829 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xa2426164df2c8822 expref: 13 pid: 14157 timeout: 557 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783441619.368809:0:14148:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff91a85fe58c00/0xa2426164df2c8829 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xa2426164df2c8822 expref: 13 pid: 14157 timeout: 557 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783441619.368823:0:14148:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff91a85fe58c00/0xa2426164df2c8829 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xa2426164df2c8822 expref: 13 pid: 14157 timeout: 557 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783441619.368846:0:14148:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff91a87da46600/0xa2426164df2c885a lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 14178 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783441619.368855:0:14148:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff91a87da46600/0xa2426164df2c885a lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 14178 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:0.0:1783441619.368871:0:14148:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.003386120s 00010000:00010000:0.0:1783441619.368876:0:14148:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff91a87da46600/0xa2426164df2c885a lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14178 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783441619.368883:0:14148:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff91a87da46600/0xa2426164df2c885a lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 14178 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783441619.368890:0:14148:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff91a87da46600/0xa2426164df2c885a lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 14178 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783441619.368897:0:14148:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff91a87da46600/0xa2426164df2c885a lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 14178 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783441619.368902:0:14148:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91a87da46600 already unused, calling callback (ffffffffc155ff90) 00010000:00010000:0.0:1783441619.368907:0:14148:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff91a87da46600/0xa2426164df2c885a lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 14178 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783441619.368914:0:14148:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff91a87da46600/0xa2426164df2c885a lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 14178 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783441619.368928:0:14148:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff91a87da46600/0xa2426164df2c885a lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14178 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783441619.368941:0:14148:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1783441619.368979:0:14148:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a877faf480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:94394728-4014-4ef0-b525-989290f008aa+12:3306:x1870073693303168:12345-0@lo:103:ldlm_bl.0 Request processed in 201us (357us total) trans 0 rc 0/0 00000100:00100000:0.0:1783441619.368988:0:14148:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1783441619.369028:0:3306:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff91a877fadf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:94394728-4014-4ef0-b525-989290f008aa:3306:1870073693303168:0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1783441619.369065:0:14178:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff91a87da46600/0xa2426164df2c885a lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14178 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783441619.369073:0:14178:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff91a87da46600/0xa2426164df2c885a lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14178 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783441619.369079:0:14178:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff91a87da46600/0xa2426164df2c885a lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14178 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783441619.375508:0:14156:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a875618850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:94394728-4014-4ef0-b525-989290f008aa+11:14145:x1870073693302912:12345-0@lo:253:mount.lustre.0 Request processed in 140346us (140515us total) trans 0 rc 0/0 00000100:00100000:2.0:1783441619.375524:0:14156:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00100000:0.0:1783441619.375617:0:14145:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff91a859086d80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:94394728-4014-4ef0-b525-989290f008aa:14145:1870073693302912:0@lo:253:mount.lustre.0 10000000:01000000:0.0:1783441619.375632:0:14145:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-MDT0000 got index = 0 00000020:01000004:0.0:1783441619.375635:0:14145:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:0.0:1783441619.375637:0:14145:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:0.0:1783441619.375638:0:14145:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1783441619.375639:0:14145:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1783441619.375640:0:14145:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1783441619.375641:0:14145:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1783441619.375642:0:14145:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:0.0:1783441619.375644:0:14145:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:0.0:1783441619.375646:0:14145:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1783441619.375648:0:14145:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:0.0:1783441619.375666:0:14145:0:(tgt_mount.c:2690:server_calc_timeout()) lustre-MDT0000: Imperative Recovery not enabled, recovery window 60-180 00080000:10000000:1.0:1783441619.380594:0:14145:0:(osd_index.c:2102:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xa:0x0] (8/8/4) registered 00080000:10000000:1.0:1783441619.380792:0:14145:0:(osd_index.c:2102:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x1:0x0] (8/8/1) registered 00080000:10000000:1.0:1783441619.381068:0:14145:0:(osd_index.c:2102:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xb:0x0] (8/8/4) registered 00080000:10000000:1.0:1783441619.381304:0:14145:0:(osd_index.c:2102:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x2:0x0] (8/8/1) registered 00080000:10000000:1.0:1783441619.381569:0:14145:0:(osd_index.c:2102:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xc:0x0] (8/8/4) registered 00080000:10000000:1.0:1783441619.381726:0:14145:0:(osd_index.c:2102:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x3:0x0] (8/8/1) registered 00080000:10000000:1.0:1783441619.382594:0:14145:0:(osd_index.c:2102:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xd:0x0] (8/8/4) registered 00080000:10000000:1.0:1783441619.382831:0:14145:0:(osd_index.c:2102:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x20001:0x0] (8/8/1) registered 00080000:10000000:1.0:1783441619.383118:0:14145:0:(osd_index.c:2102:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xe:0x0] (8/8/4) registered 00080000:10000000:1.0:1783441619.383497:0:14145:0:(osd_index.c:2102:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x20002:0x0] (8/8/1) registered 00080000:10000000:1.0:1783441619.383949:0:14145:0:(osd_index.c:2102:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xf:0x0] (8/8/4) registered 00080000:10000000:1.0:1783441619.384117:0:14145:0:(osd_index.c:2102:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x20003:0x0] (8/8/1) registered 00000020:00080000:2.0:1783441619.414850:0:14145:0:(update_trans.c:1487:distribute_txn_commit_batchid_init()) lustre-MDT0000: committed batchid 8 00000040:01000000:2.0:1783441619.416786:0:14145:0:(llog_obd.c:197:llog_setup()) obd lustre-MDT0000-osd ctxt 16 is initialized 00000020:00080000:1.0:1783441619.416886:0:14201:0:(update_trans.c:1530:distribute_txn_commit_thread()) lustre-MDT0000: start commit thread committed batchid 8 00000020:00080000:1.0:1783441619.416891:0:14201:0:(update_trans.c:1581:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 8 00000040:01000000:1.0:1783441619.419827:0:14202:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=32, read=32 00000040:00080000:1.0:1783441619.419931:0:14202:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1783441619.425009:0:14202:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x200000400:0x1:0x0] index 261376 count 1 00000004:00080000:1.0:1783441619.425086:0:14202:0:(lod_dev.c:521:lod_sub_recovery_thread()) lustre-MDT0000-osd retrieved update log, duration 0, retries 0 00000004:00080000:1.0:1783441619.425090:0:14202:0:(lod_dev.c:545:lod_sub_recovery_thread()) lustre-MDT0000 got update logs from all MDTs. 00000040:01000000:2.0:1783441619.431026:0:14145:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 12 is initialized 00000040:00080000:2.0:1783441619.431169:0:14145:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000004:00000080:2.0:1783441619.431968:0:14145:0:(mdd_device.c:553:mdd_changelog_llog_init()) changelog starting index=0 00000040:01000000:2.0:1783441619.431980:0:14145:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 14 is initialized 00000040:00080000:3.0:1783441619.432291:0:14145:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1783441619.433119:0:14145:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x5:0x0] index 64768 count 1 00000040:00080000:3.0:1783441619.433620:0:14145:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x6:0x0] index 64768 count 1 00000040:01000000:3.0:1783441619.433651:0:14145:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 15 is initialized 00080000:10000000:3.0:1783441619.435040:0:14145:0:(osd_index.c:2102:osd_index_try()) lustre-MDT0000: index object [0x200000003:0x36:0x0] (8/8/4) registered 00000001:00000004:3.0:1783441619.444246:0:14145:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 2, last_transno is 8589934592 00000001:00080000:2.0:1783441619.514193:0:14145:0:(tgt_lastrcvd.c:222:tgt_reply_header_read()) lustre-MDT0000: read reply_data header. magic=0xbdabda01 header_size=32 reply_size=32 00000004:00000080:2.0:1783441619.514256:0:14145:0:(mdd_device.c:2302:mdd_iocontrol()) lustre-MDD0000: cmd=c00866e6 len=0 karg=ffffaa8581cd7988 00100000:10000000:2.0:1783441619.514265:0:14145:0:(lfsck_lib.c:3085:lfsck_start()) lustre-MDT0000-osd: start master thread 00000020:01000004:2.0:1783441619.519046:0:14145:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:2.0:1783441619.519065:0:14145:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.201.113@tcp: cl_mgc_mutex unlock 00000020:01000004:2.0:1783441619.519080:0:14145:0:(tgt_mount.c:2459:server_fill_super_common()) Server sb, dev=46 00000080:00000004:2.0:1783441619.519104:0:14145:0:(super25.c:187:lustre_fill_super()) lustre-mdt1/mdt1: Mount complete 00010000:00010000:3.0:1783441619.820938:0:14151:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:0.0:1783441620.349193:0:14197:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 10000000:01000000:1.0:1783441620.717011:0:14160:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:1.0:1783441620.717019:0:14160:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-mdtir-ffff91a844b0f000 from 6 10000000:01000000:1.0:1783441620.717025:0:14160:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:1.0:1783441620.717085:0:14160:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.113@tcp lock: ffff91a87da46a00/0xa2426164df2c8861 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14160 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783441620.717097:0:14160:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.113@tcp lock: ffff91a87da46a00/0xa2426164df2c8861 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14160 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783441620.717117:0:14160:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.113@tcp lock: ffff91a87da46a00/0xa2426164df2c8861 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14160 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783441620.717142:0:14160:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff91a745550e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:94394728-4014-4ef0-b525-989290f008aa:14160:1870073693303296:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1783441620.717351:0:14160:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783441620.717406:0:14160:0:(client.c:2702:ptlrpc_set_wait()) set ffff91a8516d03c0 going to sleep for 11 seconds 00000100:00100000:2.0:1783441620.717508:0:14157:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073693303296 00000100:00100000:2.0:1783441620.717516:0:14157:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073693303296 00000100:00100000:2.0:1783441620.717576:0:14157:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:2.0:1783441620.717585:0:14157:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a87561a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:94394728-4014-4ef0-b525-989290f008aa+11:14160:x1870073693303296:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1783441620.717707:0:14157:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1783441620.717723:0:14157:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff91a85eaa0200/0xa2426164df2c8868 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xa2426164df2c8861 expref: -99 pid: 14157 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783441620.718139:0:14157:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff91a85eaa0200/0xa2426164df2c8868 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xa2426164df2c8861 expref: 12 pid: 14157 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783441620.718151:0:14157:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff91a85eaa0200/0xa2426164df2c8868 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xa2426164df2c8861 expref: 12 pid: 14157 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783441620.718160:0:14157:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91a85eaa0200, rc 0) 00000100:00100000:2.0:1783441620.718318:0:14157:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a87561a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:94394728-4014-4ef0-b525-989290f008aa+12:14160:x1870073693303296:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 733us (966us total) trans 0 rc 0/0 00000100:00100000:2.0:1783441620.718326:0:14157:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00100000:1.0:1783441620.723647:0:14160:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff91a745550e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:94394728-4014-4ef0-b525-989290f008aa:14160:1870073693303296:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1783441620.723678:0:14160:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.113@tcp lock: ffff91a87da46a00/0xa2426164df2c8861 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xa2426164df2c8868 expref: -99 pid: 14160 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783441620.723691:0:14160:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.113@tcp lock: ffff91a87da46a00/0xa2426164df2c8861 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xa2426164df2c8868 expref: -99 pid: 14160 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783441620.724055:0:14160:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff91a877fadf80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:94394728-4014-4ef0-b525-989290f008aa:14160:1870073693303424:0@lo:256:ll_cfg_requeue.0 00000100:00100000:0.0:1783441620.724124:0:14160:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783441620.724180:0:14160:0:(client.c:2702:ptlrpc_set_wait()) set ffff91a8504a3300 going to sleep for 11 seconds 00000100:00100000:1.0:1783441620.724608:0:14156:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073693303424 00000100:00100000:1.0:1783441620.724615:0:14156:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073693303424 00000100:00100000:1.0:1783441620.724714:0:14156:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:1.0:1783441620.724724:0:14156:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a87561ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:94394728-4014-4ef0-b525-989290f008aa+12:14160:x1870073693303424:12345-0@lo:256:ll_cfg_requeue.0 20000000:01000000:1.0:1783441620.724787:0:14156:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:1.0:1783441620.724806:0:14156:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:1.0:1783441620.724809:0:14156:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 6 00000100:00100000:1.0:1783441620.724909:0:14156:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a87561ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:94394728-4014-4ef0-b525-989290f008aa+12:14160:x1870073693303424:12345-0@lo:256:ll_cfg_requeue.0 Request processed in 187us (784us total) trans 0 rc 0/0 00000100:00100000:1.0:1783441620.724916:0:14156:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:0.0:1783441620.726934:0:14160:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff91a877fadf80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:94394728-4014-4ef0-b525-989290f008aa:14160:1870073693303424:0@lo:256:ll_cfg_requeue.0 10000000:01000000:0.0:1783441620.727005:0:14160:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.201.113@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:0.0:1783441620.727016:0:14160:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.113@tcp lock: ffff91a87da46a00/0xa2426164df2c8861 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xa2426164df2c8868 expref: -99 pid: 14160 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783441620.727028:0:14160:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.113@tcp lock: ffff91a87da46a00/0xa2426164df2c8861 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xa2426164df2c8868 expref: -99 pid: 14160 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783441620.846846:0:14152:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:3.0:1783441621.360688:0:14197:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:1.0:1783441621.871816:0:14151:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783441622.901220:0:14152:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783441623.916962:0:14151:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:0.0:1783441624.432408:0:365:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1783441624.432416:0:365:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:0.0:1783441624.432419:0:365:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1783441624.432422:0:365:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:0.0:1783441624.432425:0:365:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 0 00000100:00080000:0.0:1783441624.432428:0:365:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:0.0:1783441624.432431:0:365:0:(import.c:65:import_set_state_nolock()) ffff91a85ff40000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1783441624.432443:0:365:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-MDT0000: import ffff91a85ff40000 using connection 192.168.201.113@tcp/0@lo 00000100:00100000:0.0:1783441624.432464:0:365:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff91a877fac380 x1870073693303680/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1783441624.432727:0:3302:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff91a877fac380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3302:1870073693303680:0@lo:38:kworker.0 00000100:00100000:0.0:1783441624.432817:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783441624.432960:0:3306:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff91a877fadf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:94394728-4014-4ef0-b525-989290f008aa:3306:1870073693303552:0@lo:400:kworker.0 00000100:00100000:3.0:1783441624.432996:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783441624.433052:0:14164:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073693303680 00000100:00100000:3.0:1783441624.433059:0:14164:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073693303680 00000100:00100000:3.0:1783441624.433092:0:14164:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1783441624.433099:0:14164:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a877fac000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3302:x1870073693303680:12345-0@lo:38:kworker.0 00010000:00080000:3.0:1783441624.433125:0:14164:0:(ldlm_lib.c:1432:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-MDT0000_UUID@0@lo t0 exp 0000000000000000 cur 462 last 0 00000020:00000080:3.0:1783441624.433175:0:14164:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-lwp-MDT0000_UUID, cookie 0xa2426164df2c886f 00000004:00100000:3.0:1783441624.433188:0:14164:0:(mdt_handler.c:7286:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:3.0:1783441624.433312:0:14164:0:(import.c:65:import_set_state_nolock()) ffff91a7457e9000 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1783441624.433367:0:14164:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a877fac000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3302:x1870073693303680:12345-0@lo:38:kworker.0 Request processed in 265us (549us total) trans 0 rc 0/0 00000100:00100000:3.0:1783441624.433374:0:14164:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1783441624.433398:0:14157:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073693303552 00000100:00100000:3.0:1783441624.433402:0:14157:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073693303552 00000100:00100000:3.0:1783441624.433430:0:14157:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:3.0:1783441624.433436:0:14157:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a87561bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:94394728-4014-4ef0-b525-989290f008aa+12:3306:x1870073693303552:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1783441624.433469:0:14157:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a87561bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:94394728-4014-4ef0-b525-989290f008aa+12:3306:x1870073693303552:12345-0@lo:400:kworker.0 Request processed in 33us (472us total) trans 0 rc 0/0 00000100:00100000:3.0:1783441624.433475:0:14157:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00010000:00080000:3.0:1783441624.433525:0:3302:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@ffff91a877fac380 x1870073693303680/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/416 e 0 to 0 dl 1783441634 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:3.0:1783441624.433539:0:3302:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-MDT0000: connect to target with instance 2 00000100:00080000:3.0:1783441624.433546:0:3302:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-MDT0000: Resetting ns_connect_flags to server flags: 0x2041401047000020 00000100:00080000:3.0:1783441624.433551:0:3302:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:3.0:1783441624.433553:0:3302:0:(import.c:65:import_set_state_nolock()) ffff91a85ff40000 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:3.0:1783441624.433571:0:3302:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff91a877fac380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3302:1870073693303680:0@lo:38:kworker.0 00000100:00100000:3.0:1783441624.433604:0:3306:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff91a877fadf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:94394728-4014-4ef0-b525-989290f008aa:3306:1870073693303552:0@lo:400:kworker.0 00000001:02000400:3.0:1783441624.664355:0:14445:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg113-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00010000:00010000:0.0:1783441624.941879:0:14152:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783441625.965389:0:14151:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783441626.990342:0:14152:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783441628.017192:0:14151:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:3.0:1783441628.043164:0:14595:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007ffd37152900 20000000:00000080:3.0:1783441628.043183:0:14595:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff91a88169bc00 uarg=0000000000000000 20000000:01000000:3.0:1783441628.043221:0:14595:0:(mgs_llog.c:6188:mgs_set_param2()) set_param2 fs='' device='general' param='debug_raw_pointers=Y' 20000000:01000000:3.0:1783441628.043228:0:14595:0:(mgs_llog.c:4643:mgs_write_log_param2()) next param 'debug_raw_pointers=Y' 20000000:01000000:3.0:1783441628.043232:0:14595:0:(mgs_llog.c:1379:mgs_modify_param()) modify params/general/debug_raw_pointers=Y del=0 00000040:00080000:3.0:1783441628.048141:0:14596:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 2 count 10 20000000:00000400:1.0:1783441628.048512:0:14595:0:(mgs_llog.c:1450:mgs_modify_param()) MGS: modify general/debug_raw_pointers=Y (mode = 0) failed: rc = -17 10000000:01000000:1.0:1783441628.054894:0:14595:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 00010000:00010000:1.0:1783441628.054944:0:14595:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff91a87da46600/0xa2426164df2c8876 lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14595 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783441628.054964:0:14595:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff91a87da47800/0xa2426164df2c8837 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xa2426164df2c8830 expref: 11 pid: 14155 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783441628.054972:0:14595:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff91a87da46600/0xa2426164df2c8876 lrc: 4/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 14595 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783441628.055015:0:14595:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff91a87da47800/0xa2426164df2c8837 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xa2426164df2c8830 expref: 11 pid: 14155 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783441628.055030:0:14595:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff91a87da47800/0xa2426164df2c8837 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xa2426164df2c8830 expref: 11 pid: 14155 timeout: 565 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783441628.055045:0:14595:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff91a745550e00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:14595:1870073693303808:0@lo:104: 00000100:00100000:1.0:1783441628.063121:0:14595:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783441628.063198:0:14595:0:(client.c:2702:ptlrpc_set_wait()) set ffff91a842bd2b40 going to sleep for 11 seconds 00000100:00100000:0.0:1783441628.063249:0:14147:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073693303808 00000100:00100000:0.0:1783441628.063259:0:14147:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073693303808 00000100:00100000:0.0:1783441628.063347:0:14147:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1783441628.063356:0:14147:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a745553100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:94394728-4014-4ef0-b525-989290f008aa+3:14595:x1870073693303808:12345-0@lo:104: 00010000:00010000:0.0:1783441628.063374:0:14147:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.113@tcp lock: ffff91a85eaa1a00/0xa2426164df2c8830 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xa2426164df2c8837 expref: -99 pid: 14145 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783441628.063456:0:14147:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:0.0:1783441628.063462:0:14147:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a745553100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:94394728-4014-4ef0-b525-989290f008aa+3:14595:x1870073693303808:12345-0@lo:104: Request processed in 107us (906us total) trans 0 rc 0/0 00000100:00100000:0.0:1783441628.063469:0:14147:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00010000:0.0:1783441628.063490:0:14152:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1783441628.063496:0:14152:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.113@tcp lock: ffff91a85eaa1a00/0xa2426164df2c8830 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xa2426164df2c8837 expref: -99 pid: 14145 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783441628.063504:0:14152:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91a85eaa1a00 already unused, calling callback (ffffffffc1b78c20) 10000000:00010000:0.0:1783441628.063508:0:14152:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.113@tcp lock: ffff91a85eaa1a00/0xa2426164df2c8830 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xa2426164df2c8837 expref: -99 pid: 14145 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783441628.063517:0:14152:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.113@tcp lock: ffff91a85eaa1a00/0xa2426164df2c8830 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xa2426164df2c8837 expref: -99 pid: 14145 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1783441628.063524:0:14152:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.113@tcp lock: ffff91a85eaa1a00/0xa2426164df2c8830 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xa2426164df2c8837 expref: -99 pid: 14145 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1783441628.063530:0:14152:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:0.0:1783441628.063573:0:14152:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.113@tcp lock: ffff91a85eaa1a00/0xa2426164df2c8830 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xa2426164df2c8837 expref: -99 pid: 14145 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783441628.063579:0:14152:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1783441628.063600:0:14152:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.113@tcp lock: ffff91a85eaa1a00/0xa2426164df2c8830 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xa2426164df2c8837 expref: -99 pid: 14145 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783441628.063617:0:14152:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.113@tcp lock: ffff91a85eaa1a00/0xa2426164df2c8830 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xa2426164df2c8837 expref: -99 pid: 14145 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783441628.063638:0:14152:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783441628.063640:0:14152:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783441628.063641:0:14152:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1783441628.063669:0:3303:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff91a877fad880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:94394728-4014-4ef0-b525-989290f008aa:3303:1870073693303936:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1783441628.063705:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783441628.063768:0:14148:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073693303936 00000100:00100000:0.0:1783441628.063772:0:14148:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073693303936 00010000:00010000:0.0:1783441628.063790:0:14148:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff91a87da47800/0xa2426164df2c8837 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xa2426164df2c8830 expref: 12 pid: 14155 timeout: 565 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783441628.063811:0:14148:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1783441628.063817:0:14148:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a877fac700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:94394728-4014-4ef0-b525-989290f008aa+12:3303:x1870073693303936:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1783441628.063828:0:14148:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1783441628.063834:0:14148:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff91a87da47800/0xa2426164df2c8837 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xa2426164df2c8830 expref: 12 pid: 14155 timeout: 565 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783441628.063846:0:14148:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff91a87da47800/0xa2426164df2c8837 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xa2426164df2c8830 expref: 12 pid: 14155 timeout: 565 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783441628.063864:0:14148:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff91a87da46600/0xa2426164df2c8876 lrc: 3/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 14595 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783441628.063873:0:14148:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff91a87da46600/0xa2426164df2c8876 lrc: 4/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 14595 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783441628.063887:0:14148:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff91a87da46600/0xa2426164df2c8876 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14595 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783441628.063900:0:14148:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff91a87da46600/0xa2426164df2c8876 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 14595 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783441628.063907:0:14148:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff91a87da46600/0xa2426164df2c8876 lrc: 4/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 14595 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783441628.063913:0:14148:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff91a87da46600/0xa2426164df2c8876 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 14595 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783441628.063917:0:14148:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91a87da46600 already unused, calling callback (ffffffffc155ff90) 00010000:00010000:0.0:1783441628.063921:0:14148:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff91a87da46600/0xa2426164df2c8876 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 14595 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783441628.063928:0:14148:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff91a87da46600/0xa2426164df2c8876 lrc: 6/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 14595 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783441628.063938:0:14148:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff91a87da46600/0xa2426164df2c8876 lrc: 4/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14595 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783441628.063948:0:14148:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1783441628.063992:0:14148:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a877fac700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:94394728-4014-4ef0-b525-989290f008aa+12:3303:x1870073693303936:12345-0@lo:103:ldlm_bl.0 Request processed in 174us (286us total) trans 0 rc 0/0 00000100:00100000:0.0:1783441628.063998:0:14148:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1783441628.064146:0:3303:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff91a877fad880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:94394728-4014-4ef0-b525-989290f008aa:3303:1870073693303936:0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1783441628.064580:0:14595:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff91a87da47800/0xa2426164df2c8837 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xa2426164df2c8830 expref: 11 pid: 14155 timeout: 565 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783441628.064594:0:14595:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff91a745550e00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:14595:1870073693303808:0@lo:104: 00010000:00010000:2.0:1783441628.064610:0:14595:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff91a87da46600/0xa2426164df2c8876 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14595 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783441628.064619:0:14595:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff91a87da46600/0xa2426164df2c8876 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14595 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783441628.064625:0:14595:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff91a87da46600/0xa2426164df2c8876 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14595 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783441628.064631:0:14595:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff91a87da46600/0xa2426164df2c8876 lrc: 0/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14595 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783441629.042335:0:14151:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:0.0:1783441629.175492:0:14160:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:0.0:1783441629.175501:0:14160:0:(mgc_request.c:1801:mgc_process_log()) Process log params-ffff91a844b0f000 from 10 10000000:01000000:0.0:1783441629.175507:0:14160:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:0.0:1783441629.176328:0:14160:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.113@tcp lock: ffff91a85fe58a00/0xa2426164df2c887d lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14160 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783441629.176341:0:14160:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.113@tcp lock: ffff91a85fe58a00/0xa2426164df2c887d lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14160 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783441629.176360:0:14160:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.113@tcp lock: ffff91a85fe58a00/0xa2426164df2c887d lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14160 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783441629.176386:0:14160:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff91a877faea00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:94394728-4014-4ef0-b525-989290f008aa:14160:1870073693304064:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1783441629.176451:0:14160:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783441629.176554:0:14160:0:(client.c:2702:ptlrpc_set_wait()) set ffff91a8504a3c00 going to sleep for 11 seconds 00000100:00100000:2.0:1783441629.180967:0:14156:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073693304064 00000100:00100000:2.0:1783441629.180984:0:14156:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073693304064 00000100:00100000:2.0:1783441629.182633:0:14156:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:2.0:1783441629.182655:0:14156:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a87561a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:94394728-4014-4ef0-b525-989290f008aa+11:14160:x1870073693304064:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1783441629.182674:0:14156:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1783441629.182696:0:14156:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff91a85f83d600/0xa2426164df2c8884 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xa2426164df2c887d expref: -99 pid: 14156 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783441629.182725:0:14156:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff91a85f83d600/0xa2426164df2c8884 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xa2426164df2c887d expref: 12 pid: 14156 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783441629.182737:0:14156:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff91a85f83d600/0xa2426164df2c8884 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xa2426164df2c887d expref: 12 pid: 14156 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783441629.182770:0:14156:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91a85f83d600, rc 0) 00000100:00100000:2.0:1783441629.182855:0:14156:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a87561a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:94394728-4014-4ef0-b525-989290f008aa+12:14160:x1870073693304064:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 203us (6403us total) trans 0 rc 0/0 00000100:00100000:2.0:1783441629.182862:0:14156:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:1.0:1783441629.182962:0:14160:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff91a877faea00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:94394728-4014-4ef0-b525-989290f008aa:14160:1870073693304064:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1783441629.182983:0:14160:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.113@tcp lock: ffff91a85fe58a00/0xa2426164df2c887d lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xa2426164df2c8884 expref: -99 pid: 14160 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783441629.183002:0:14160:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.113@tcp lock: ffff91a85fe58a00/0xa2426164df2c887d lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xa2426164df2c8884 expref: -99 pid: 14160 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783441629.183093:0:14160:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff91a745553800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:94394728-4014-4ef0-b525-989290f008aa:14160:1870073693304192:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1783441629.183129:0:14160:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783441629.185634:0:14160:0:(client.c:2702:ptlrpc_set_wait()) set ffff91a8428ac900 going to sleep for 11 seconds 00000100:00100000:3.0:1783441629.185907:0:14157:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073693304192 00000100:00100000:3.0:1783441629.185916:0:14157:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073693304192 00000100:00100000:3.0:1783441629.185963:0:14157:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:3.0:1783441629.185972:0:14157:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a87561b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:94394728-4014-4ef0-b525-989290f008aa+12:14160:x1870073693304192:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1783441629.186495:0:14157:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a87561b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:94394728-4014-4ef0-b525-989290f008aa+12:14160:x1870073693304192:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 523us (3365us total) trans 0 rc 0/0 00000100:00100000:3.0:1783441629.186503:0:14157:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00100000:1.0:1783441629.187207:0:14160:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff91a745553800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:94394728-4014-4ef0-b525-989290f008aa:14160:1870073693304192:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1783441629.187337:0:14160:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff91a745553800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:94394728-4014-4ef0-b525-989290f008aa:14160:1870073693304320:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1783441629.187384:0:14160:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783441629.187420:0:14160:0:(client.c:2702:ptlrpc_set_wait()) set ffff91a8428ac900 going to sleep for 11 seconds 00000100:00100000:3.0:1783441629.187464:0:14157:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073693304320 00000100:00100000:3.0:1783441629.187469:0:14157:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073693304320 00000100:00100000:3.0:1783441629.187505:0:14157:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:3.0:1783441629.187511:0:14157:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a87561a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:94394728-4014-4ef0-b525-989290f008aa+12:14160:x1870073693304320:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1783441629.187802:0:14157:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a87561a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:94394728-4014-4ef0-b525-989290f008aa+12:14160:x1870073693304320:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 290us (416us total) trans 0 rc 0/0 00000100:00100000:3.0:1783441629.187819:0:14157:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00100000:1.0:1783441629.194730:0:14160:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff91a745553800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:94394728-4014-4ef0-b525-989290f008aa:14160:1870073693304320:0@lo:503:ll_cfg_requeue.0 00000040:00080000:2.0:1783441629.211070:0:14647:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 10 00000020:01000000:1.0:1783441629.211324:0:14160:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 10-9 (rc=0) 10000000:01000000:1.0:1783441629.211349:0:14160:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.201.113@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:1.0:1783441629.211361:0:14160:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.113@tcp lock: ffff91a85fe58a00/0xa2426164df2c887d lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xa2426164df2c8884 expref: -99 pid: 14160 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783441629.211372:0:14160:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.113@tcp lock: ffff91a85fe58a00/0xa2426164df2c887d lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xa2426164df2c8884 expref: -99 pid: 14160 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00080000:0.0:1783441629.549140:0:365:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1783441629.549149:0:365:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:0.0:1783441629.549152:0:365:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1783441629.549155:0:365:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:0.0:1783441629.549227:0:3304:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff91a877fadc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3304:1870073693304448:0@lo:400:kworker.0 00000100:00100000:0.0:1783441629.549296:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783441629.549571:0:14163:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073693304448 00000100:00100000:2.0:1783441629.549579:0:14163:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073693304448 00000100:00100000:2.0:1783441629.549623:0:14163:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1783441629.549631:0:14163:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a877faed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3304:x1870073693304448:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1783441629.549683:0:14163:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a877faed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3304:x1870073693304448:12345-0@lo:400:kworker.0 Request processed in 52us (386us total) trans 0 rc 0/0 00000100:00100000:2.0:1783441629.549689:0:14163:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1783441629.549772:0:3302:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1783441619/real 1783441619] req@ffff91a877faca80 x1870073693300992/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1783441629 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1783441629.549794:0:3302:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff91a877faca80 x1870073693300992/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1783441629 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1783441629.549804:0:3302:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1783441619/real 1783441619] req@ffff91a877fae300 x1870073693300736/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1783441629 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1783441629.549814:0:3302:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff91a877fae300 x1870073693300736/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1783441629 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00080000:1.0:1783441629.549827:0:3302:0:(import.c:65:import_set_state_nolock()) ffff91a848696000 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1783441629.549838:0:3302:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-110) 00000100:00100000:1.0:1783441629.549841:0:3302:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff91a877faca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3302:1870073693300992:0@lo:8:llog_process_th.0 00000100:00080000:1.0:1783441629.549846:0:3302:0:(import.c:65:import_set_state_nolock()) ffff91a84869f800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1783441629.549865:0:3302:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 0@lo failed (-110) 00000100:00100000:1.0:1783441629.549868:0:3302:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff91a877fae300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3302:1870073693300736:0@lo:8:llog_process_th.0 00000100:00080000:1.0:1783441629.549896:0:59:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1783441629.549900:0:59:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery 00000100:00080000:1.0:1783441629.549902:0:59:0:(import.c:65:import_set_state_nolock()) ffff91a84869f800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1783441629.549906:0:59:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-MDT0000: connect to NID 0@lo last attempt 457 00000100:00080000:1.0:1783441629.549910:0:59:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-MDT0000: tried all connections, increasing latency to 5s 00000100:00080000:1.0:1783441629.549914:0:59:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-MDT0000: import ffff91a84869f800 using connection 192.168.201.113@tcp/0@lo 00000100:00100000:1.0:1783441629.549933:0:59:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff91a745553800 x1870073693304576/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1783441629.549945:0:59:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1783441629.549948:0:59:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:1.0:1783441629.549950:0:59:0:(import.c:65:import_set_state_nolock()) ffff91a848696000 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1783441629.549953:0:59:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-MDT0000: connect to NID 0@lo last attempt 457 00000100:00080000:1.0:1783441629.549955:0:59:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-MDT0000: tried all connections, increasing latency to 5s 00000100:00080000:1.0:1783441629.549959:0:59:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff91a848696000 using connection 192.168.201.113@tcp/0@lo 00000100:00100000:1.0:1783441629.549968:0:59:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff91a745551500 x1870073693304704/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1783441629.549997:0:3302:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff91a745553800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3302:1870073693304576:0@lo:8:kworker.0 00000400:00000100:1.0:1783441629.550023:0:3302:0:(lib-move.c:4262:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1870073693304576 offset 0 length 520: 4 00000100:00100000:1.0:1783441629.550043:0:3302:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff91a745551500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3302:1870073693304704:0@lo:8:kworker.0 00000400:00000100:1.0:1783441629.550073:0:3302:0:(lib-move.c:4262:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1870073693304704 offset 0 length 520: 4 00010000:00080000:0.0:1783441629.550214:0:3304:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@ffff91a877fadc00 x1870073693304448/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1783441645 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1783441629.550227:0:3304:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff91a877fadc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3304:1870073693304448:0@lo:400:kworker.0 00010000:00010000:0.0:1783441630.065242:0:14152:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783441631.091675:0:14151:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:0.0:1783441631.599686:0:14197:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:0.0:1783441632.109687:0:14152:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:3.0:1783441632.262696:0:14796:0:(obd_mount.c:923:lmd_print()) mount data: 00000020:01000004:3.0:1783441632.262700:0:14796:0:(obd_mount.c:926:lmd_print()) device: lustre-ost1/ost1 00000080:01200004:3.0:1783441632.262865:0:14796:0:(super25.c:130:lustre_fill_super()) VFS Op: sb ffff91a745264800 00000020:01000004:3.0:1783441632.262882:0:14796:0:(tgt_mount.c:2501:osd_start()) Attempting to start lustre-OST0000, type=osd-zfs, lsifl=200002, mountfl=0 00000020:01000004:3.0:1783441632.262894:0:14796:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-OST0000-osd (typ=osd-zfs) 00000020:00000080:3.0:1783441632.262908:0:14796:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000-osd (ffff91a877f78000) 00000020:00000080:3.0:1783441632.262937:0:14796:0:(obd_config.c:720:class_attach_name()) OBD: dev 11 attached type osd-zfs with refcount 2 00100000:10000000:3.0:1783441632.304597:0:14796:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0000: refresh OI map for scrub, op 1, force yes, [0x200000007:0x1:0x0] => 0 (ROOT): rc = 1 00100000:10000000:3.0:1783441632.304897:0:14796:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-OST0000: registered index [0x200000001:0x3:0x0] (8/24) 00100000:10000000:0.0:1783441632.311387:0:14796:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0000: refresh OI map for scrub, op 1, force yes, [0x200000009:0x0:0x0] => 0 (update_log): rc = 1 00100000:10000000:0.0:1783441632.311669:0:14796:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0000: refresh OI map for scrub, op 1, force yes, [0x20000000a:0x0:0x0] => 0 (update_log_dir): rc = 1 00100000:10000000:0.0:1783441632.312297:0:14796:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-OST0000: registered index [0x200000003:0x3:0x0] (8/32) 00100000:10000000:0.0:1783441632.312660:0:14796:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0000: initial OI scrub handled lustre-client under 225: rc = 0 00100000:10000000:0.0:1783441632.312820:0:14796:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0000: initial OI scrub handled params under 225: rc = 0 00100000:10000000:0.0:1783441632.312920:0:14796:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0000: initial OI scrub handled lustre-OST0000 under 225: rc = 0 00100000:10000000:0.0:1783441632.315902:0:14796:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0000: initial OI scrub handled 0x2020000-OST0000 under 769: rc = 0 00100000:10000000:0.0:1783441632.316677:0:14796:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0000: initial OI scrub handled 0x2020000 under 769: rc = 0 00100000:10000000:0.0:1783441632.317530:0:14796:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0000: initial OI scrub handled 0x1020000 under 769: rc = 0 00100000:10000000:0.0:1783441632.317841:0:14796:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0000: initial OI scrub handled 0x20000 under 769: rc = 0 00100000:10000000:0.0:1783441632.318244:0:14796:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0000: initial OI scrub handled 0x1020000-OST0000 under 769: rc = 0 00100000:10000000:0.0:1783441632.318651:0:14796:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0000: initial OI scrub handled 0x20000-OST0000 under 769: rc = 0 00000020:00000080:0.0:1783441632.319730:0:14796:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000-osd (uuid lustre-OST0000-osd_UUID) 00080000:01000000:0.0:1783441632.319778:0:14796:0:(osd_handler.c:1569:osd_obd_connect()) connect #0 00000020:00000080:0.0:1783441632.319791:0:14796:0:(genops.c:1406:class_connect()) connect: client lustre-OST0000-osd_UUID, cookie 0xa2426164df2c8892 00000020:01000004:0.0:1783441632.319800:0:14796:0:(tgt_mount.c:2586:server_fill_super()) Found service lustre-OST0000 on device lustre-ost1/ost1 00000020:01000004:0.0:1783441632.319822:0:14796:0:(obd_mount.c:403:lustre_start_mgc()) MGC192.168.201.113@tcp:Set MGC reconnect 1 10000000:01000000:0.0:1783441632.319826:0:14796:0:(mgc_request.c:1071:mgc_set_info_async()) InitRecov MGC192.168.201.113@tcp 1/d0:i0:r0:or0:FULL 00000020:01000004:0.0:1783441632.319833:0:14796:0:(tgt_mount.c:1810:server_start_targets()) starting target lustre-OST0000 00000020:01000004:0.0:1783441632.319837:0:14796:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD OSS (typ=ost) 00000020:00000080:0.0:1783441632.319859:0:14796:0:(genops.c:413:class_newdev()) Allocate new device OSS (ffff91a87cf8cd40) 00000020:00000080:0.0:1783441632.319872:0:14796:0:(obd_config.c:720:class_attach_name()) OBD: dev 12 attached type ost with refcount 2 00000100:00100000:0.0:1783441632.325657:0:14796:0:(service.c:155:ptlrpc_grow_req_bufs()) ost: allocate 64 new 32768-byte reqbufs (0/64 left), rc = 0 00000100:00100000:0.0:1783441632.325846:0:14796:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 0 min 3 max 116 00000100:00100000:0.0:1783441632.325853:0:14796:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost00_000' 00000100:00100000:1.0:1783441632.327423:0:14796:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 1 min 3 max 116 00000100:00100000:1.0:1783441632.327438:0:14796:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost00_001' 00000100:00100000:0.0:1783441632.328144:0:14796:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 2 min 3 max 116 00000100:00100000:0.0:1783441632.328152:0:14796:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost00_002' 00000100:00100000:1.0:1783441632.331892:0:14796:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_create: allocate 64 new 32768-byte reqbufs (0/64 left), rc = 0 00000100:00100000:1.0:1783441632.332120:0:14796:0:(service.c:3462:ptlrpc_start_thread()) ost_create[0] started 0 min 2 max 16 00000100:00100000:1.0:1783441632.332127:0:14796:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_create00_000' 00000100:00100000:1.0:1783441632.341501:0:14796:0:(service.c:3462:ptlrpc_start_thread()) ost_create[0] started 1 min 2 max 16 00000100:00100000:1.0:1783441632.341526:0:14796:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_create00_001' 00000100:00100000:2.0:1783441632.373756:0:14796:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_io: allocate 64 new 524288-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1783441632.374148:0:14796:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 0 min 3 max 116 00000100:00100000:2.0:1783441632.374155:0:14796:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_io00_000' 00000100:00100000:2.0:1783441632.378292:0:14796:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 1 min 3 max 116 00000100:00100000:2.0:1783441632.378308:0:14796:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_io00_001' 00000100:00100000:2.0:1783441632.379542:0:14796:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 2 min 3 max 116 00000100:00100000:2.0:1783441632.379558:0:14796:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_io00_002' 00000100:00100000:2.0:1783441632.383389:0:14796:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_seq: allocate 64 new 32768-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1783441632.383588:0:14796:0:(service.c:3462:ptlrpc_start_thread()) ost_seq[0] started 0 min 2 max 16 00000100:00100000:2.0:1783441632.383596:0:14796:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_seq00_000' 00000100:00100000:2.0:1783441632.385260:0:14796:0:(service.c:3462:ptlrpc_start_thread()) ost_seq[0] started 1 min 2 max 16 00000100:00100000:2.0:1783441632.385272:0:14796:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_seq00_001' 00000100:00100000:1.0:1783441632.461732:0:14796:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_out: allocate 64 new 1048576-byte reqbufs (0/64 left), rc = 0 00000100:00100000:1.0:1783441632.462717:0:14796:0:(service.c:3462:ptlrpc_start_thread()) ost_out[0] started 0 min 2 max 16 00000100:00100000:1.0:1783441632.462726:0:14796:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_out00_000' 00000100:00100000:1.0:1783441632.474048:0:14796:0:(service.c:3462:ptlrpc_start_thread()) ost_out[0] started 1 min 2 max 16 00000100:00100000:1.0:1783441632.474068:0:14796:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_out00_001' 00000020:00000080:1.0:1783441632.474552:0:14796:0:(obd_config.c:826:class_setup()) finished setup of obd OSS (uuid OSS_uuid) 00000020:01000004:1.0:1783441632.474576:0:14796:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for lustre-ost1/ost1 10000000:01000000:1.0:1783441632.474583:0:14796:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.201.113@tcp: cl_mgc_mutex lustre-OST0000-osd for locked: rc = 0 00000040:01000000:1.0:1783441632.483565:0:14796:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.201.113@tcp ctxt 0 is initialized 00000020:01000004:1.0:1783441632.483673:0:14796:0:(tgt_mount.c:1418:server_register_target()) Registration lustre-OST0000, fs=lustre, 192.168.201.113@tcp, index=0000, flags=0x20002 00000020:01000004:1.0:1783441632.483679:0:14796:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:1.0:1783441632.483680:0:14796:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:1.0:1783441632.483681:0:14796:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1783441632.483683:0:14796:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1783441632.483684:0:14796:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1783441632.483685:0:14796:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1783441632.483686:0:14796:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:1.0:1783441632.483688:0:14796:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1783441632.483689:0:14796:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:1.0:1783441632.483780:0:14796:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0000 0x10020002 00000020:01000004:1.0:1783441632.483784:0:14796:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:1.0:1783441632.483785:0:14796:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:1.0:1783441632.483787:0:14796:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1783441632.483788:0:14796:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1783441632.483793:0:14796:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1783441632.483794:0:14796:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1783441632.483795:0:14796:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:1.0:1783441632.483796:0:14796:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1783441632.483797:0:14796:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:1.0:1783441632.483834:0:14796:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0000 00000100:00100000:1.0:1783441632.483864:0:14796:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff91a745550000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:94394728-4014-4ef0-b525-989290f008aa:14796:1870073693304832:0@lo:253:mount.lustre.0 00000100:00100000:1.0:1783441632.484043:0:14796:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783441632.484549:0:14796:0:(client.c:2702:ptlrpc_set_wait()) set ffff91a8486306c0 going to sleep for 11 seconds 00000100:00100000:3.0:1783441632.484598:0:14157:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073693304832 00000100:00100000:3.0:1783441632.484607:0:14157:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073693304832 00000100:00100000:3.0:1783441632.484777:0:14157:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:3.0:1783441632.484788:0:14157:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a875619450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:94394728-4014-4ef0-b525-989290f008aa+12:14796:x1870073693304832:12345-0@lo:253:mount.lustre.0 20000000:01000000:3.0:1783441632.484838:0:14157:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 0 is registered to MGS. 20000000:01000000:3.0:1783441632.484842:0:14157:0:(mgs_handler.c:529:mgs_target_reg()) Server lustre-OST0000 is running on 0@lo 20000000:01000000:3.0:1783441632.484846:0:14157:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0000, index=0, rc=0 00000100:00100000:1.0:1783441632.490143:0:14157:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a875619450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:94394728-4014-4ef0-b525-989290f008aa+12:14796:x1870073693304832:12345-0@lo:253:mount.lustre.0 Request processed in 5345us (6088us total) trans 0 rc 0/0 00000100:00100000:1.0:1783441632.490159:0:14157:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00100000:2.0:1783441632.492857:0:14796:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff91a745550000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:94394728-4014-4ef0-b525-989290f008aa:14796:1870073693304832:0@lo:253:mount.lustre.0 10000000:01000000:2.0:1783441632.492880:0:14796:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0000 got index = 0 00000020:01000004:2.0:1783441632.492883:0:14796:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:2.0:1783441632.492885:0:14796:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:2.0:1783441632.492886:0:14796:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1783441632.492887:0:14796:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1783441632.492888:0:14796:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1783441632.492890:0:14796:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1783441632.492891:0:14796:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1783441632.492893:0:14796:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1783441632.492894:0:14796:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:2.0:1783441632.492920:0:14796:0:(tgt_mount.c:101:server_register_mount()) register mount ffff91a745264800 from lustre-OST0000 10000000:01000000:2.0:1783441632.493023:0:14796:0:(mgc_request.c:1943:mgc_process_config()) parse_log lustre-OST0000 from 0 10000000:01000000:2.0:1783441632.493026:0:14796:0:(mgc_request.c:329:config_log_add()) add config log lustre-OST0000-0000000000000000 10000000:01000000:2.0:1783441632.493034:0:14796:0:(mgc_request_server.c:874:mgc_get_local_copy()) Get log lustre-sptlrpc-ffff91a744388000 local copy 00010000:00010000:2.0:1783441632.493044:0:14796:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.113@tcp lock: ffff91a841476400/0xa2426164df2c8788 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xa2426164df2c878f expref: -99 pid: 14145 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783441632.493295:0:14796:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff91a859085c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:94394728-4014-4ef0-b525-989290f008aa:14796:1870073693304960:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1783441632.493357:0:14796:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783441632.493446:0:14796:0:(client.c:2702:ptlrpc_set_wait()) set ffff91a8485523c0 going to sleep for 11 seconds 00000100:00100000:0.0:1783441632.493499:0:14155:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073693304960 00000100:00100000:0.0:1783441632.493506:0:14155:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073693304960 00000100:00100000:0.0:1783441632.493601:0:14155:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:0.0:1783441632.493610:0:14155:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a875619850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:94394728-4014-4ef0-b525-989290f008aa+12:14796:x1870073693304960:12345-0@lo:501:mount.lustre.0 00000100:00100000:1.0:1783441632.494149:0:14155:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a875619850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:94394728-4014-4ef0-b525-989290f008aa+12:14796:x1870073693304960:12345-0@lo:501:mount.lustre.0 Request processed in 538us (790us total) trans 0 rc -2/-2 00000100:00100000:1.0:1783441632.494159:0:14155:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00100000:3.0:1783441632.494237:0:14796:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff91a859085c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:94394728-4014-4ef0-b525-989290f008aa:14796:1870073693304960:0@lo:501:mount.lustre.0 10000000:01000000:3.0:1783441632.494253:0:14796:0:(mgc_request_server.c:765:mgc_llog_local_copy()) MGC192.168.201.113@tcp: no remote llog for lustre-sptlrpc, check MGS config 10000000:01000000:3.0:1783441632.494421:0:14796:0:(mgc_request_server.c:897:mgc_get_local_copy()) MGC192.168.201.113@tcp: can't save local copy of 'lustre-sptlrpc': rc = -2. 00010000:00010000:3.0:1783441632.494428:0:14796:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.113@tcp lock: ffff91a841476400/0xa2426164df2c8788 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xa2426164df2c878f expref: -99 pid: 14145 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783441632.494437:0:14796:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.113@tcp lock: ffff91a841476400/0xa2426164df2c8788 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xa2426164df2c878f expref: -99 pid: 14145 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1783441632.494470:0:14796:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff91a745264800 10000000:01000000:3.0:1783441632.494475:0:14796:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:3.0:1783441632.494488:0:14796:0:(mgc_request.c:194:do_config_log_add()) do adding config log nodemap-ffff91a744388000 10000000:01000000:3.0:1783441632.494491:0:14796:0:(mgc_request.c:68:mgc_name2resid()) log nodemap to resid 0x70616d65646f6e/0x4 (nodemap) 10000000:01000000:3.0:1783441632.494494:0:14796:0:(mgc_request.c:1801:mgc_process_log()) Process log nodemap-ffff91a744388000 from 1 10000000:01000000:3.0:1783441632.494497:0:14796:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for nodemap (res 0x70616d65646f6e) 00010000:00010000:3.0:1783441632.494523:0:14796:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.113@tcp lock: ffff91a841476800/0xa2426164df2c88a0 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783441632.494532:0:14796:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.113@tcp lock: ffff91a841476800/0xa2426164df2c88a0 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783441632.494541:0:14796:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.113@tcp lock: ffff91a841476800/0xa2426164df2c88a0 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783441632.494556:0:14796:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff91a874dcea00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:94394728-4014-4ef0-b525-989290f008aa:14796:1870073693305088:0@lo:101:mount.lustre.0 00000100:00100000:3.0:1783441632.494598:0:14796:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783441632.494882:0:14796:0:(client.c:2702:ptlrpc_set_wait()) set ffff91a8504a30c0 going to sleep for 11 seconds 00000100:00100000:2.0:1783441632.495039:0:14156:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073693305088 00000100:00100000:2.0:1783441632.495045:0:14156:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073693305088 00000100:00100000:2.0:1783441632.495073:0:14156:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:2.0:1783441632.495080:0:14156:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a87561b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:94394728-4014-4ef0-b525-989290f008aa+12:14796:x1870073693305088:12345-0@lo:101:mount.lustre.0 00010000:00010000:2.0:1783441632.495089:0:14156:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1783441632.495108:0:14156:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff91a85f83d000/0xa2426164df2c88a7 lrc: 2/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xa2426164df2c88a0 expref: -99 pid: 14156 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783441632.495129:0:14156:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff91a85f83d000/0xa2426164df2c88a7 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xa2426164df2c88a0 expref: 13 pid: 14156 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783441632.495141:0:14156:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff91a85f83d000/0xa2426164df2c88a7 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xa2426164df2c88a0 expref: 13 pid: 14156 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783441632.495149:0:14156:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91a85f83d000, rc 0) 00000100:00100000:2.0:1783441632.495192:0:14156:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a87561b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:94394728-4014-4ef0-b525-989290f008aa+13:14796:x1870073693305088:12345-0@lo:101:mount.lustre.0 Request processed in 111us (605us total) trans 0 rc 0/0 00000100:00100000:2.0:1783441632.495198:0:14156:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00100000:3.0:1783441632.495286:0:14796:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff91a874dcea00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:94394728-4014-4ef0-b525-989290f008aa:14796:1870073693305088:0@lo:101:mount.lustre.0 00010000:00010000:3.0:1783441632.495302:0:14796:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.113@tcp lock: ffff91a841476800/0xa2426164df2c88a0 lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xa2426164df2c88a7 expref: -99 pid: 14796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783441632.495311:0:14796:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.113@tcp lock: ffff91a841476800/0xa2426164df2c88a0 lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xa2426164df2c88a7 expref: -99 pid: 14796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1783441632.495328:0:14796:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.201.113@tcp: configuration from log 'nodemap' succeeded (0). 00010000:00010000:3.0:1783441632.495345:0:14796:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.113@tcp lock: ffff91a841476800/0xa2426164df2c88a0 lrc: 3/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xa2426164df2c88a7 expref: -99 pid: 14796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783441632.495353:0:14796:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.113@tcp lock: ffff91a841476800/0xa2426164df2c88a0 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xa2426164df2c88a7 expref: -99 pid: 14796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1783441632.495371:0:14796:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-OST0000-0000000000000000 10000000:01000000:3.0:1783441632.495375:0:14796:0:(mgc_request.c:68:mgc_name2resid()) log lustre-OST0000 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:3.0:1783441632.495379:0:14796:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-OST0000-0000000000000000 from 1 10000000:01000000:3.0:1783441632.495382:0:14796:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0000 (res 0x65727473756c) 00010000:00010000:3.0:1783441632.495398:0:14796:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.113@tcp lock: ffff91a841476e00/0xa2426164df2c88ae lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783441632.495406:0:14796:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.113@tcp lock: ffff91a841476e00/0xa2426164df2c88ae lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783441632.495413:0:14796:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.113@tcp lock: ffff91a841476e00/0xa2426164df2c88ae lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783441632.495426:0:14796:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff91a874dcea00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:94394728-4014-4ef0-b525-989290f008aa:14796:1870073693305216:0@lo:101:mount.lustre.0 00000100:00100000:3.0:1783441632.495452:0:14796:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783441632.495463:0:14796:0:(client.c:2702:ptlrpc_set_wait()) set ffff91a8504a30c0 going to sleep for 11 seconds 00000100:00100000:2.0:1783441632.495517:0:14156:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073693305216 00000100:00100000:2.0:1783441632.495521:0:14156:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073693305216 00000100:00100000:2.0:1783441632.495539:0:14156:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:2.0:1783441632.495546:0:14156:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a875618050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:94394728-4014-4ef0-b525-989290f008aa+13:14796:x1870073693305216:12345-0@lo:101:mount.lustre.0 00010000:00010000:2.0:1783441632.495553:0:14156:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1783441632.495561:0:14156:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff91a85f83ca00/0xa2426164df2c88b5 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0xa2426164df2c88ae expref: -99 pid: 14156 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783441632.495575:0:14156:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff91a85f83ca00/0xa2426164df2c88b5 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xa2426164df2c88ae expref: 14 pid: 14156 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783441632.495583:0:14156:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff91a85f83ca00/0xa2426164df2c88b5 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xa2426164df2c88ae expref: 14 pid: 14156 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783441632.495684:0:14156:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91a85f83ca00, rc 0) 00000100:00100000:2.0:1783441632.495718:0:14156:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a875618050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:94394728-4014-4ef0-b525-989290f008aa+14:14796:x1870073693305216:12345-0@lo:101:mount.lustre.0 Request processed in 173us (266us total) trans 0 rc 0/0 00000100:00100000:2.0:1783441632.495733:0:14156:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00000100:00100000:3.0:1783441632.495862:0:14796:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff91a874dcea00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:94394728-4014-4ef0-b525-989290f008aa:14796:1870073693305216:0@lo:101:mount.lustre.0 00010000:00010000:3.0:1783441632.495875:0:14796:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.113@tcp lock: ffff91a841476e00/0xa2426164df2c88ae lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xa2426164df2c88b5 expref: -99 pid: 14796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783441632.495883:0:14796:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.113@tcp lock: ffff91a841476e00/0xa2426164df2c88ae lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0xa2426164df2c88b5 expref: -99 pid: 14796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:3.0:1783441632.499164:0:14796:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 8 count 8 00000040:00080000:3.0:1783441632.500523:0:14796:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1783441632.501317:0:14796:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].1, 224 off8416 00000040:00080000:2.0:1783441632.501383:0:14796:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].2, 128 off8544 00000040:00080000:2.0:1783441632.501418:0:14796:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].3, 112 off8656 00000040:00080000:2.0:1783441632.501483:0:14796:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].4, 224 off8880 00000040:00080000:2.0:1783441632.501524:0:14796:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].5, 224 off9104 00000040:00080000:2.0:1783441632.501554:0:14796:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].6, 80 off9184 00000040:00080000:2.0:1783441632.505077:0:14796:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].7, 224 off9408 00000040:00080000:2.0:1783441632.505100:0:14796:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 7 count 8 00000100:00100000:2.0:1783441632.505221:0:14796:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff91a859087b80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:94394728-4014-4ef0-b525-989290f008aa:14796:1870073693305344:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1783441632.505292:0:14796:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783441632.505340:0:14796:0:(client.c:2702:ptlrpc_set_wait()) set ffff91a848552b40 going to sleep for 11 seconds 00000100:00100000:1.0:1783441632.505473:0:14156:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073693305344 00000100:00100000:1.0:1783441632.505481:0:14156:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073693305344 00000100:00100000:1.0:1783441632.505534:0:14156:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:1.0:1783441632.505544:0:14156:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a875618450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:94394728-4014-4ef0-b525-989290f008aa+14:14796:x1870073693305344:12345-0@lo:501:mount.lustre.0 00000100:00100000:1.0:1783441632.505916:0:14156:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a875618450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:94394728-4014-4ef0-b525-989290f008aa+14:14796:x1870073693305344:12345-0@lo:501:mount.lustre.0 Request processed in 372us (623us total) trans 0 rc 0/0 00000100:00100000:1.0:1783441632.505924:0:14156:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00000100:00100000:2.0:1783441632.506100:0:14796:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff91a859087b80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:94394728-4014-4ef0-b525-989290f008aa:14796:1870073693305344:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1783441632.506136:0:14796:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff91a859087b80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:94394728-4014-4ef0-b525-989290f008aa:14796:1870073693305472:0@lo:503:mount.lustre.0 00000100:00100000:2.0:1783441632.506176:0:14796:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783441632.506206:0:14796:0:(client.c:2702:ptlrpc_set_wait()) set ffff91a848552b40 going to sleep for 11 seconds 00000100:00100000:0.0:1783441632.506260:0:14157:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073693305472 00000100:00100000:0.0:1783441632.506265:0:14157:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073693305472 00000100:00100000:0.0:1783441632.506650:0:14157:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:0.0:1783441632.506658:0:14157:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a87563f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:94394728-4014-4ef0-b525-989290f008aa+14:14796:x1870073693305472:12345-0@lo:503:mount.lustre.0 00000100:00100000:0.0:1783441632.507261:0:14157:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a87563f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:94394728-4014-4ef0-b525-989290f008aa+14:14796:x1870073693305472:12345-0@lo:503:mount.lustre.0 Request processed in 602us (1082us total) trans 0 rc 0/0 00000100:00100000:0.0:1783441632.507268:0:14157:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00000100:00100000:3.0:1783441632.507427:0:14796:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff91a859087b80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:94394728-4014-4ef0-b525-989290f008aa:14796:1870073693305472:0@lo:503:mount.lustre.0 00000040:00080000:3.0:1783441632.508319:0:14796:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:3.0:1783441632.508400:0:14796:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff91a874dcea00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:94394728-4014-4ef0-b525-989290f008aa:14796:1870073693305600:0@lo:502:mount.lustre.0 00000100:00100000:3.0:1783441632.508456:0:14796:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783441632.508599:0:14796:0:(client.c:2702:ptlrpc_set_wait()) set ffff91a8504a33c0 going to sleep for 11 seconds 00000100:00100000:1.0:1783441632.508688:0:14155:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073693305600 00000100:00100000:1.0:1783441632.508694:0:14155:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073693305600 00000100:00100000:1.0:1783441632.508726:0:14155:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:1.0:1783441632.508734:0:14155:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a87563e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:94394728-4014-4ef0-b525-989290f008aa+14:14796:x1870073693305600:12345-0@lo:502:mount.lustre.0 00000100:00100000:1.0:1783441632.509076:0:14155:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a87563e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:94394728-4014-4ef0-b525-989290f008aa+14:14796:x1870073693305600:12345-0@lo:502:mount.lustre.0 Request processed in 342us (620us total) trans 0 rc 0/0 00000100:00100000:1.0:1783441632.509083:0:14155:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00000100:00100000:3.0:1783441632.509177:0:14796:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff91a874dcea00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:94394728-4014-4ef0-b525-989290f008aa:14796:1870073693305600:0@lo:502:mount.lustre.0 00000040:00080000:3.0:1783441632.509418:0:14796:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].1, 224 off8416 00000040:00080000:3.0:1783441632.509475:0:14796:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].2, 128 off8544 00000040:00080000:3.0:1783441632.509512:0:14796:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].3, 112 off8656 00000040:00080000:3.0:1783441632.509560:0:14796:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].4, 224 off8880 00000040:00080000:3.0:1783441632.509595:0:14796:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].5, 224 off9104 00000040:00080000:3.0:1783441632.509628:0:14796:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].6, 80 off9184 00000040:00080000:3.0:1783441632.509674:0:14796:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].7, 224 off9408 00000040:00080000:3.0:1783441632.509712:0:14796:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].8, 224 off9632 00000040:00080000:3.0:1783441632.509784:0:14796:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].9, 80 off9712 00000040:00080000:3.0:1783441632.509834:0:14796:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].10, 224 off9936 00000040:00080000:3.0:1783441632.509868:0:14796:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].11, 224 off10160 00000040:00080000:3.0:1783441632.509918:0:14796:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].12, 120 off10280 00000100:00100000:3.0:1783441632.510096:0:14796:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff91a874dcea00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:94394728-4014-4ef0-b525-989290f008aa:14796:1870073693305728:0@lo:502:mount.lustre.0 00000100:00100000:3.0:1783441632.510147:0:14796:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783441632.510178:0:14796:0:(client.c:2702:ptlrpc_set_wait()) set ffff91a8504a33c0 going to sleep for 11 seconds 00000100:00100000:1.0:1783441632.510264:0:14155:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073693305728 00000100:00100000:1.0:1783441632.510269:0:14155:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073693305728 00000100:00100000:1.0:1783441632.510299:0:14155:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:1.0:1783441632.510307:0:14155:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a87563fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:94394728-4014-4ef0-b525-989290f008aa+14:14796:x1870073693305728:12345-0@lo:502:mount.lustre.0 00000100:00100000:1.0:1783441632.510480:0:14155:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a87563fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:94394728-4014-4ef0-b525-989290f008aa+14:14796:x1870073693305728:12345-0@lo:502:mount.lustre.0 Request processed in 173us (332us total) trans 0 rc 0/0 00000100:00100000:1.0:1783441632.510487:0:14155:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00000100:00100000:3.0:1783441632.510608:0:14796:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff91a874dcea00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:94394728-4014-4ef0-b525-989290f008aa:14796:1870073693305728:0@lo:502:mount.lustre.0 00000040:00080000:3.0:1783441632.510673:0:14796:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].13, 224 off10504 00000040:00080000:3.0:1783441632.510683:0:14796:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 13 count 14 00000020:01000000:1.0:1783441632.517364:0:14810:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:1.0:1783441632.517378:0:14810:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0000 (0) in 0 of lustre-ost1/ost1 00000020:00000080:1.0:1783441632.517385:0:14810:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1783441632.517388:0:14810:0:(obd_config.c:1561:class_process_config()) marker 11 (0x1) lustre-OST0000 add ost 00000020:00000080:1.0:1783441632.517580:0:14810:0:(obd_config.c:1470:class_process_config()) processing cmd: cf001 00000020:00000080:1.0:1783441632.517806:0:14810:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000 (ffff91a7463419c0) 00000020:00000080:1.0:1783441632.517833:0:14810:0:(obd_config.c:720:class_attach_name()) OBD: dev 13 attached type obdfilter with refcount 2 00000020:00000080:1.0:1783441632.517841:0:14810:0:(obd_config.c:1470:class_process_config()) processing cmd: cf003 00000020:01000004:1.0:1783441632.517967:0:14810:0:(tgt_mount.c:153:server_get_mount()) get mount ffff91a745264800 from lustre-OST0000, refs=2 00080000:01000000:1.0:1783441632.517976:0:14810:0:(osd_handler.c:1569:osd_obd_connect()) connect #1 00000020:00000080:1.0:1783441632.517986:0:14810:0:(genops.c:1406:class_connect()) connect: client lustre-OST0000-osd_UUID, cookie 0xa2426164df2c88c3 00010000:00010000:1.0:1783441632.521364:0:14810:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-filter-lustre-OST0000_UUID-2 is initialized 00000001:00000004:1.0:1783441632.522022:0:14810:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 2, last_transno is 4294967324 00080000:10000000:1.0:1783441632.524651:0:14810:0:(osd_index.c:2102:osd_index_try()) lustre-OST0000: index object [0x200000003:0xb:0x0] (8/8/4) registered 00000020:00000080:3.0:1783441632.530123:0:14810:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000 (uuid lustre-OST0000_UUID) 00000020:01000000:3.0:1783441632.530137:0:14810:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1783441632.530143:0:14810:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1783441632.530146:0:14810:0:(obd_config.c:1561:class_process_config()) marker 11 (0x2) lustre-OST0000 add ost 00000020:01000000:3.0:1783441632.530150:0:14810:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:3.0:1783441632.530153:0:14810:0:(obd_config.c:1899:class_config_llog_handler()) SKIP #14 00000020:01000000:3.0:1783441632.530154:0:14810:0:(obd_config.c:1925:class_config_llog_handler()) skipping 0x6 00000020:01000000:3.0:1783441632.530161:0:14810:0:(obd_config.c:1925:class_config_llog_handler()) skipping 0x6 00000020:01000000:3.0:1783441632.530163:0:14810:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:3.0:1783441632.530165:0:14810:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1783441632.530166:0:14810:0:(obd_config.c:1561:class_process_config()) marker 14 (0x6) lustre sys.timeout 00000020:01000000:3.0:1783441632.530169:0:14810:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1783441632.530172:0:14810:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1783441632.530173:0:14810:0:(obd_config.c:1561:class_process_config()) marker 20 (0x1) lustre sys.timeout 00000020:00000080:3.0:1783441632.530176:0:14810:0:(obd_config.c:1470:class_process_config()) processing cmd: cf009 00000020:00000080:3.0:1783441632.530178:0:14810:0:(obd_config.c:1535:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:3.0:1783441632.530180:0:14810:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1783441632.530183:0:14810:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1783441632.530184:0:14810:0:(obd_config.c:1561:class_process_config()) marker 20 (0x2) lustre sys.timeout 00000020:01000000:3.0:1783441632.530186:0:14810:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1783441632.530188:0:14810:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1783441632.530189:0:14810:0:(obd_config.c:1561:class_process_config()) marker 24 (0x1) lustre sys.jobid_var 00000020:00000080:3.0:1783441632.530191:0:14810:0:(obd_config.c:1470:class_process_config()) processing cmd: cf00f 00000020:01000000:3.0:1783441632.530252:0:14810:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1783441632.530255:0:14810:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1783441632.530256:0:14810:0:(obd_config.c:1561:class_process_config()) marker 24 (0x2) lustre sys.jobid_var 00000040:00080000:3.0:1783441632.530259:0:14810:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x6:0x0] index 14 count 14 00000020:01000000:2.0:1783441632.530684:0:14796:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0000 gen 1-13 (rc=0) 10000000:01000000:2.0:1783441632.530713:0:14796:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.201.113@tcp: configuration from log 'lustre-OST0000' succeeded (0). 00010000:00010000:2.0:1783441632.530808:0:14796:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.113@tcp lock: ffff91a841476e00/0xa2426164df2c88ae lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xa2426164df2c88b5 expref: -99 pid: 14796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783441632.530821:0:14796:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.113@tcp lock: ffff91a841476e00/0xa2426164df2c88ae lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xa2426164df2c88b5 expref: -99 pid: 14796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1783441632.530830:0:14796:0:(mgc_request.c:1801:mgc_process_log()) Process log params-ffff91a745264800 from 1 10000000:01000000:2.0:1783441632.530833:0:14796:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:2.0:1783441632.530886:0:14796:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.113@tcp lock: ffff91a85f83c600/0xa2426164df2c88ca lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783441632.530899:0:14796:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.113@tcp lock: ffff91a85f83c600/0xa2426164df2c88ca lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783441632.530911:0:14796:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.113@tcp lock: ffff91a85f83c600/0xa2426164df2c88ca lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783441632.530945:0:14796:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff91a859084700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:94394728-4014-4ef0-b525-989290f008aa:14796:1870073693305856:0@lo:101:mount.lustre.0 00000100:00100000:2.0:1783441632.531021:0:14796:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783441632.531062:0:14796:0:(client.c:2702:ptlrpc_set_wait()) set ffff91a848552e40 going to sleep for 11 seconds 00000100:00100000:0.0:1783441632.531631:0:14155:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073693305856 00000100:00100000:0.0:1783441632.531639:0:14155:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073693305856 00000100:00100000:0.0:1783441632.531695:0:14155:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:0.0:1783441632.531704:0:14155:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a87563ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:94394728-4014-4ef0-b525-989290f008aa+14:14796:x1870073693305856:12345-0@lo:101:mount.lustre.0 00010000:00010000:0.0:1783441632.531716:0:14155:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1783441632.531729:0:14155:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff91a85fe59a00/0xa2426164df2c88d1 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xa2426164df2c88ca expref: -99 pid: 14155 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783441632.531775:0:14155:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff91a85fe59a00/0xa2426164df2c88d1 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xa2426164df2c88ca expref: 15 pid: 14155 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783441632.531786:0:14155:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff91a85fe59a00/0xa2426164df2c88d1 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xa2426164df2c88ca expref: 15 pid: 14155 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783441632.531795:0:14155:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91a85fe59a00, rc 0) 00000100:00100000:0.0:1783441632.531838:0:14155:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a87563ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:94394728-4014-4ef0-b525-989290f008aa+15:14796:x1870073693305856:12345-0@lo:101:mount.lustre.0 Request processed in 135us (817us total) trans 0 rc 0/0 00000100:00100000:0.0:1783441632.531844:0:14155:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00000100:00100000:3.0:1783441632.532029:0:14796:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff91a859084700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:94394728-4014-4ef0-b525-989290f008aa:14796:1870073693305856:0@lo:101:mount.lustre.0 00010000:00010000:3.0:1783441632.532045:0:14796:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.113@tcp lock: ffff91a85f83c600/0xa2426164df2c88ca lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xa2426164df2c88d1 expref: -99 pid: 14796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783441632.532054:0:14796:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.113@tcp lock: ffff91a85f83c600/0xa2426164df2c88ca lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xa2426164df2c88d1 expref: -99 pid: 14796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:3.0:1783441632.532622:0:14796:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 4 count 4 00000040:00080000:3.0:1783441632.533116:0:14796:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1783441632.533358:0:14796:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].1, 224 off8416 00000040:00080000:3.0:1783441632.533472:0:14796:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].2, 112 off8528 00000040:00080000:3.0:1783441632.533540:0:14796:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].3, 224 off8752 00000040:00080000:3.0:1783441632.533548:0:14796:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 3 count 4 00000100:00100000:3.0:1783441632.533700:0:14796:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff91a874dcea00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:94394728-4014-4ef0-b525-989290f008aa:14796:1870073693305984:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1783441632.533776:0:14796:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783441632.533819:0:14796:0:(client.c:2702:ptlrpc_set_wait()) set ffff91a8504a33c0 going to sleep for 11 seconds 00000100:00100000:2.0:1783441632.533855:0:14156:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073693305984 00000100:00100000:2.0:1783441632.533861:0:14156:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073693305984 00000100:00100000:2.0:1783441632.533905:0:14156:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 39 00000100:00100000:2.0:1783441632.533914:0:14156:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a87563e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:94394728-4014-4ef0-b525-989290f008aa+15:14796:x1870073693305984:12345-0@lo:501:mount.lustre.0 00000100:00100000:2.0:1783441632.534159:0:14156:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a87563e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:94394728-4014-4ef0-b525-989290f008aa+15:14796:x1870073693305984:12345-0@lo:501:mount.lustre.0 Request processed in 245us (381us total) trans 0 rc 0/0 00000100:00100000:2.0:1783441632.534167:0:14156:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 39 00000100:00100000:3.0:1783441632.534183:0:14796:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff91a874dcea00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:94394728-4014-4ef0-b525-989290f008aa:14796:1870073693305984:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1783441632.534215:0:14796:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff91a874dcea00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:94394728-4014-4ef0-b525-989290f008aa:14796:1870073693306112:0@lo:503:mount.lustre.0 00000100:00100000:3.0:1783441632.534250:0:14796:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783441632.534271:0:14796:0:(client.c:2702:ptlrpc_set_wait()) set ffff91a8504a33c0 going to sleep for 11 seconds 00000100:00100000:2.0:1783441632.534300:0:14157:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073693306112 00000100:00100000:2.0:1783441632.534304:0:14157:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073693306112 00000100:00100000:2.0:1783441632.534326:0:14157:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:2.0:1783441632.534330:0:14157:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a87563c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:94394728-4014-4ef0-b525-989290f008aa+15:14796:x1870073693306112:12345-0@lo:503:mount.lustre.0 00000100:00100000:2.0:1783441632.534444:0:14157:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a87563c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:94394728-4014-4ef0-b525-989290f008aa+15:14796:x1870073693306112:12345-0@lo:503:mount.lustre.0 Request processed in 112us (193us total) trans 0 rc 0/0 00000100:00100000:2.0:1783441632.534451:0:14157:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00000100:00100000:3.0:1783441632.534479:0:14796:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff91a874dcea00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:94394728-4014-4ef0-b525-989290f008aa:14796:1870073693306112:0@lo:503:mount.lustre.0 00000040:00080000:3.0:1783441632.534893:0:14796:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:3.0:1783441632.535119:0:14796:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff91a874dcea00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:94394728-4014-4ef0-b525-989290f008aa:14796:1870073693306240:0@lo:502:mount.lustre.0 00000100:00100000:3.0:1783441632.535158:0:14796:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783441632.535176:0:14796:0:(client.c:2702:ptlrpc_set_wait()) set ffff91a8504a33c0 going to sleep for 11 seconds 00000100:00100000:1.0:1783441632.536346:0:14155:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073693306240 00000100:00100000:1.0:1783441632.536357:0:14155:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073693306240 00000100:00100000:1.0:1783441632.536405:0:14155:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:1.0:1783441632.536414:0:14155:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a87563cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:94394728-4014-4ef0-b525-989290f008aa+15:14796:x1870073693306240:12345-0@lo:502:mount.lustre.0 00000100:00100000:1.0:1783441632.536623:0:14155:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a87563cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:94394728-4014-4ef0-b525-989290f008aa+15:14796:x1870073693306240:12345-0@lo:502:mount.lustre.0 Request processed in 209us (1463us total) trans 0 rc 0/0 00000100:00100000:1.0:1783441632.536630:0:14155:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00000100:00100000:3.0:1783441632.537211:0:14796:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff91a874dcea00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:94394728-4014-4ef0-b525-989290f008aa:14796:1870073693306240:0@lo:502:mount.lustre.0 00000040:00080000:3.0:1783441632.537486:0:14796:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].1, 224 off8416 00000040:00080000:3.0:1783441632.537538:0:14796:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].2, 112 off8528 00000040:00080000:3.0:1783441632.537580:0:14796:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].3, 224 off8752 00000040:00080000:3.0:1783441632.538966:0:14796:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].4, 224 off8976 00000040:00080000:3.0:1783441632.539020:0:14796:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].5, 112 off9088 00000040:00080000:3.0:1783441632.539084:0:14796:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].6, 224 off9312 00000040:00080000:3.0:1783441632.539120:0:14796:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].7, 224 off9536 00000040:00080000:3.0:1783441632.539171:0:14796:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].8, 128 off9664 00000100:00100000:3.0:1783441632.539218:0:14796:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff91a874dcea00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:94394728-4014-4ef0-b525-989290f008aa:14796:1870073693306368:0@lo:502:mount.lustre.0 00000100:00100000:3.0:1783441632.539283:0:14796:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783441632.539320:0:14796:0:(client.c:2702:ptlrpc_set_wait()) set ffff91a8504a33c0 going to sleep for 11 seconds 00000100:00100000:0.0:1783441632.540091:0:14157:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073693306368 00000100:00100000:0.0:1783441632.540100:0:14157:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073693306368 00000100:00100000:0.0:1783441632.540156:0:14157:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:0.0:1783441632.540163:0:14157:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a87563d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:94394728-4014-4ef0-b525-989290f008aa+15:14796:x1870073693306368:12345-0@lo:502:mount.lustre.0 00000100:00100000:0.0:1783441632.540366:0:14157:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a87563d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:94394728-4014-4ef0-b525-989290f008aa+15:14796:x1870073693306368:12345-0@lo:502:mount.lustre.0 Request processed in 202us (1083us total) trans 0 rc 0/0 00000100:00100000:0.0:1783441632.540382:0:14157:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00000100:00100000:3.0:1783441632.540594:0:14796:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff91a874dcea00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:94394728-4014-4ef0-b525-989290f008aa:14796:1870073693306368:0@lo:502:mount.lustre.0 00000040:00080000:3.0:1783441632.540703:0:14796:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].9, 224 off9888 00000040:00080000:3.0:1783441632.540718:0:14796:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 9 count 10 00000020:01000000:3.0:1783441632.541690:0:14814:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1783441632.541697:0:14814:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1783441632.541698:0:14814:0:(obd_config.c:1561:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:3.0:1783441632.541703:0:14814:0:(obd_config.c:2005:class_config_llog_handler()) cmd ce032, instance name: general-ffff91a745264800 00000020:00000080:3.0:1783441632.541704:0:14814:0:(obd_config.c:1470:class_process_config()) processing cmd: ce032 00000020:01000000:3.0:1783441632.541709:0:14814:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1783441632.541711:0:14814:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1783441632.541712:0:14814:0:(obd_config.c:1561:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000020:01000000:3.0:1783441632.541713:0:14814:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1783441632.541714:0:14814:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1783441632.541715:0:14814:0:(obd_config.c:1561:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:3.0:1783441632.541717:0:14814:0:(obd_config.c:2005:class_config_llog_handler()) cmd ce032, instance name: general-ffff91a745264800 00000020:00000080:3.0:1783441632.541718:0:14814:0:(obd_config.c:1470:class_process_config()) processing cmd: ce032 00000020:01000000:3.0:1783441632.541781:0:14814:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1783441632.541785:0:14814:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1783441632.541786:0:14814:0:(obd_config.c:1561:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000020:01000000:3.0:1783441632.541789:0:14814:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1783441632.541791:0:14814:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1783441632.541792:0:14814:0:(obd_config.c:1561:class_process_config()) marker 4 (0x1) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:3.0:1783441632.541796:0:14814:0:(obd_config.c:2005:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff91a745264800 00000020:00000080:3.0:1783441632.541797:0:14814:0:(obd_config.c:1470:class_process_config()) processing cmd: ce032 00000020:01000000:3.0:1783441632.541831:0:14814:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1783441632.541835:0:14814:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1783441632.541837:0:14814:0:(obd_config.c:1561:class_process_config()) marker 4 (0x2) lustre mdt.lustre-MDT0000.hsm_control 00000040:00080000:3.0:1783441632.541840:0:14814:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 10 count 10 00000020:01000000:0.0:1783441632.541928:0:14796:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-9 (rc=0) 10000000:01000000:0.0:1783441632.541960:0:14796:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.201.113@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:0.0:1783441632.541981:0:14796:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.113@tcp lock: ffff91a85f83c600/0xa2426164df2c88ca lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xa2426164df2c88d1 expref: -99 pid: 14796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783441632.541993:0:14796:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.113@tcp lock: ffff91a85f83c600/0xa2426164df2c88ca lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xa2426164df2c88d1 expref: -99 pid: 14796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1783441632.542047:0:14796:0:(mgc_request.c:1943:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:0.0:1783441632.542050:0:14796:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff91a745264800 10000000:01000000:0.0:1783441632.542053:0:14796:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff91a745264800 10000000:01000000:0.0:1783441632.542056:0:14796:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:0.0:1783441632.542061:0:14796:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-client-ffff91a745264800 from 1 10000000:01000000:0.0:1783441632.542063:0:14796:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:0.0:1783441632.542095:0:14796:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.113@tcp lock: ffff91a85fe58400/0xa2426164df2c88d8 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783441632.542103:0:14796:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.113@tcp lock: ffff91a85fe58400/0xa2426164df2c88d8 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783441632.542113:0:14796:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.113@tcp lock: ffff91a85fe58400/0xa2426164df2c88d8 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783441632.542134:0:14796:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff91a877fadc00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:94394728-4014-4ef0-b525-989290f008aa:14796:1870073693306496:0@lo:101:mount.lustre.0 00000100:00100000:0.0:1783441632.542187:0:14796:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783441632.542229:0:14796:0:(client.c:2702:ptlrpc_set_wait()) set ffff91a846fb4f00 going to sleep for 11 seconds 00000100:00100000:1.0:1783441632.543032:0:14157:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073693306496 00000100:00100000:1.0:1783441632.543040:0:14157:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073693306496 00000100:00100000:1.0:1783441632.543084:0:14157:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 43 00000100:00100000:1.0:1783441632.543093:0:14157:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a87563dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:94394728-4014-4ef0-b525-989290f008aa+15:14796:x1870073693306496:12345-0@lo:101:mount.lustre.0 00010000:00010000:1.0:1783441632.543117:0:14157:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1783441632.543130:0:14157:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff91a87da47400/0xa2426164df2c88df lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0xa2426164df2c88d8 expref: -99 pid: 14157 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783441632.543153:0:14157:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff91a87da47400/0xa2426164df2c88df lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xa2426164df2c88d8 expref: 16 pid: 14157 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783441632.543164:0:14157:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff91a87da47400/0xa2426164df2c88df lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xa2426164df2c88d8 expref: 16 pid: 14157 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783441632.543173:0:14157:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91a87da47400, rc 0) 00000100:00100000:1.0:1783441632.543222:0:14157:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a87563dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:94394728-4014-4ef0-b525-989290f008aa+16:14796:x1870073693306496:12345-0@lo:101:mount.lustre.0 Request processed in 129us (1035us total) trans 0 rc 0/0 00000100:00100000:1.0:1783441632.543228:0:14157:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 43 00000100:00100000:0.0:1783441632.543400:0:14796:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff91a877fadc00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:94394728-4014-4ef0-b525-989290f008aa:14796:1870073693306496:0@lo:101:mount.lustre.0 00010000:00010000:0.0:1783441632.543415:0:14796:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.113@tcp lock: ffff91a85fe58400/0xa2426164df2c88d8 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xa2426164df2c88df expref: -99 pid: 14796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783441632.543430:0:14796:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.113@tcp lock: ffff91a85fe58400/0xa2426164df2c88d8 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0xa2426164df2c88df expref: -99 pid: 14796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:0.0:1783441632.547879:0:14796:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 30 count 30 00000040:00080000:0.0:1783441632.548374:0:14796:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1783441632.548636:0:14796:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].1, 224 off8416 00000040:00080000:0.0:1783441632.548681:0:14796:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].2, 120 off8536 00000040:00080000:0.0:1783441632.548716:0:14796:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].3, 168 off8704 00000040:00080000:0.0:1783441632.548810:0:14796:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].4, 224 off8928 00000040:00080000:0.0:1783441632.548862:0:14796:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].5, 224 off9152 00000040:00080000:0.0:1783441632.548910:0:14796:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].6, 120 off9272 00000040:00080000:0.0:1783441632.548946:0:14796:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].7, 168 off9440 00000040:00080000:0.0:1783441632.548979:0:14796:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].8, 224 off9664 00000040:00080000:0.0:1783441632.549056:0:14796:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].9, 224 off9888 00000040:00080000:0.0:1783441632.549093:0:14796:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].10, 120 off10008 00000040:00080000:0.0:1783441632.549130:0:14796:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].11, 224 off10232 00000040:00080000:0.0:1783441632.549183:0:14796:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].12, 224 off10456 00000040:00080000:0.0:1783441632.549220:0:14796:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].13, 88 off10544 00000040:00080000:0.0:1783441632.549255:0:14796:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].14, 128 off10672 00000040:00080000:0.0:1783441632.549302:0:14796:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].15, 144 off10816 00000040:00080000:0.0:1783441632.549338:0:14796:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].16, 160 off10976 00000040:00080000:0.0:1783441632.549372:0:14796:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].17, 224 off11200 00000040:00080000:0.0:1783441632.549421:0:14796:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].18, 224 off11424 00000040:00080000:0.0:1783441632.549457:0:14796:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].19, 80 off11504 00000040:00080000:0.0:1783441632.549488:0:14796:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].20, 224 off11728 00000040:00080000:0.0:1783441632.549543:0:14796:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].21, 224 off11952 00000040:00080000:0.0:1783441632.549573:0:14796:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].22, 88 off12040 00000040:00080000:0.0:1783441632.549601:0:14796:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].23, 128 off12168 00000040:00080000:0.0:1783441632.549647:0:14796:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].24, 144 off12312 00000040:00080000:0.0:1783441632.549678:0:14796:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].25, 128 off12440 00000040:00080000:0.0:1783441632.549705:0:14796:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].26, 224 off12664 00000040:00080000:0.0:1783441632.549783:0:14796:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].27, 224 off12888 00000040:00080000:0.0:1783441632.549819:0:14796:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].28, 80 off12968 00000040:00080000:0.0:1783441632.549894:0:14796:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].29, 224 off13192 00000040:00080000:0.0:1783441632.549901:0:14796:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 29 count 30 00000100:00100000:0.0:1783441632.549994:0:14796:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff91a877fadc00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:94394728-4014-4ef0-b525-989290f008aa:14796:1870073693306624:0@lo:501:mount.lustre.0 00000100:00100000:0.0:1783441632.550072:0:14796:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783441632.550118:0:14796:0:(client.c:2702:ptlrpc_set_wait()) set ffff91a846fb4f00 going to sleep for 11 seconds 00000100:00100000:3.0:1783441632.553525:0:14155:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073693306624 00000100:00100000:3.0:1783441632.553540:0:14155:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073693306624 00000100:00100000:3.0:1783441632.554075:0:14155:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 44 00000100:00100000:3.0:1783441632.554087:0:14155:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a87563f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:94394728-4014-4ef0-b525-989290f008aa+16:14796:x1870073693306624:12345-0@lo:501:mount.lustre.0 00000100:00100000:3.0:1783441632.555137:0:14155:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a87563f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:94394728-4014-4ef0-b525-989290f008aa+16:14796:x1870073693306624:12345-0@lo:501:mount.lustre.0 Request processed in 1047us (5059us total) trans 0 rc 0/0 00000100:00100000:3.0:1783441632.555157:0:14155:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 44 00000100:00100000:0.0:1783441632.557117:0:14796:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff91a877fadc00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:94394728-4014-4ef0-b525-989290f008aa:14796:1870073693306624:0@lo:501:mount.lustre.0 00000100:00100000:0.0:1783441632.557178:0:14796:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff91a877fadc00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:94394728-4014-4ef0-b525-989290f008aa:14796:1870073693306752:0@lo:503:mount.lustre.0 00000100:00100000:0.0:1783441632.557247:0:14796:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783441632.557291:0:14796:0:(client.c:2702:ptlrpc_set_wait()) set ffff91a846fb4f00 going to sleep for 11 seconds 00000100:00100000:3.0:1783441632.557314:0:14156:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073693306752 00000100:00100000:3.0:1783441632.557321:0:14156:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073693306752 00000100:00100000:3.0:1783441632.557374:0:14156:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 45 00000100:00100000:3.0:1783441632.557382:0:14156:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a87563f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:94394728-4014-4ef0-b525-989290f008aa+16:14796:x1870073693306752:12345-0@lo:503:mount.lustre.0 00000100:00100000:3.0:1783441632.559775:0:14156:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a87563f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:94394728-4014-4ef0-b525-989290f008aa+16:14796:x1870073693306752:12345-0@lo:503:mount.lustre.0 Request processed in 2383us (2518us total) trans 0 rc 0/0 00000100:00100000:3.0:1783441632.559790:0:14156:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 45 00000100:00100000:0.0:1783441632.563257:0:14796:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff91a877fadc00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:94394728-4014-4ef0-b525-989290f008aa:14796:1870073693306752:0@lo:503:mount.lustre.0 00000040:00080000:0.0:1783441632.564035:0:14796:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:0.0:1783441632.564116:0:14796:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff91a877fadc00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:94394728-4014-4ef0-b525-989290f008aa:14796:1870073693306880:0@lo:502:mount.lustre.0 00000100:00100000:0.0:1783441632.564193:0:14796:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783441632.564239:0:14796:0:(client.c:2702:ptlrpc_set_wait()) set ffff91a846fb4f00 going to sleep for 11 seconds 00000100:00100000:3.0:1783441632.564484:0:14157:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073693306880 00000100:00100000:3.0:1783441632.564490:0:14157:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073693306880 00000100:00100000:3.0:1783441632.564540:0:14157:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 46 00000100:00100000:3.0:1783441632.564549:0:14157:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a87563d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:94394728-4014-4ef0-b525-989290f008aa+16:14796:x1870073693306880:12345-0@lo:502:mount.lustre.0 00000100:00100000:3.0:1783441632.564786:0:14157:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a87563d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:94394728-4014-4ef0-b525-989290f008aa+16:14796:x1870073693306880:12345-0@lo:502:mount.lustre.0 Request processed in 237us (592us total) trans 0 rc 0/0 00000100:00100000:3.0:1783441632.564794:0:14157:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 46 00000100:00100000:3.0:1783441632.564841:0:14796:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff91a877fadc00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:94394728-4014-4ef0-b525-989290f008aa:14796:1870073693306880:0@lo:502:mount.lustre.0 00000040:00080000:3.0:1783441632.565249:0:14796:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].1, 224 off8416 00000040:00080000:3.0:1783441632.565296:0:14796:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].2, 120 off8536 00000040:00080000:3.0:1783441632.565329:0:14796:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].3, 168 off8704 00000040:00080000:3.0:1783441632.565402:0:14796:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].4, 224 off8928 00000040:00080000:3.0:1783441632.565442:0:14796:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].5, 224 off9152 00000040:00080000:3.0:1783441632.565490:0:14796:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].6, 120 off9272 00000040:00080000:3.0:1783441632.565525:0:14796:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].7, 168 off9440 00000040:00080000:3.0:1783441632.565559:0:14796:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].8, 224 off9664 00000040:00080000:3.0:1783441632.565619:0:14796:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].9, 224 off9888 00000040:00080000:3.0:1783441632.565653:0:14796:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].10, 120 off10008 00000040:00080000:3.0:1783441632.565687:0:14796:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].11, 224 off10232 00000040:00080000:3.0:1783441632.565768:0:14796:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].12, 224 off10456 00000040:00080000:3.0:1783441632.565804:0:14796:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].13, 88 off10544 00000040:00080000:3.0:1783441632.565835:0:14796:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].14, 128 off10672 00000040:00080000:3.0:1783441632.565903:0:14796:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].15, 144 off10816 00000040:00080000:3.0:1783441632.566154:0:14796:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].16, 160 off10976 00000040:00080000:3.0:1783441632.566193:0:14796:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].17, 224 off11200 00000040:00080000:3.0:1783441632.566236:0:14796:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].18, 224 off11424 00000040:00080000:3.0:1783441632.566268:0:14796:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].19, 80 off11504 00000040:00080000:3.0:1783441632.566298:0:14796:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].20, 224 off11728 00000040:00080000:3.0:1783441632.566342:0:14796:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].21, 224 off11952 00000040:00080000:3.0:1783441632.566378:0:14796:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].22, 88 off12040 00000040:00080000:3.0:1783441632.566426:0:14796:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].23, 128 off12168 00000040:00080000:3.0:1783441632.566492:0:14796:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].24, 144 off12312 00000040:00080000:3.0:1783441632.566529:0:14796:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].25, 128 off12440 00000040:00080000:3.0:1783441632.566562:0:14796:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].26, 224 off12664 00000040:00080000:3.0:1783441632.566764:0:14796:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].27, 224 off12888 00000040:00080000:3.0:1783441632.566805:0:14796:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].28, 80 off12968 00000040:00080000:3.0:1783441632.566839:0:14796:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].29, 224 off13192 00000040:00080000:3.0:1783441632.567040:0:14796:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].30, 224 off13416 00000040:00080000:3.0:1783441632.567088:0:14796:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].31, 88 off13504 00000040:00080000:3.0:1783441632.567116:0:14796:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].32, 128 off13632 00000040:00080000:3.0:1783441632.567143:0:14796:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].33, 144 off13776 00000040:00080000:3.0:1783441632.567185:0:14796:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].34, 128 off13904 00000040:00080000:3.0:1783441632.567214:0:14796:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].35, 224 off14128 00000040:00080000:3.0:1783441632.567268:0:14796:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].36, 224 off14352 00000040:00080000:3.0:1783441632.567301:0:14796:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].37, 80 off14432 00000040:00080000:3.0:1783441632.567328:0:14796:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].38, 224 off14656 00000040:00080000:3.0:1783441632.567367:0:14796:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].39, 224 off14880 00000040:00080000:3.0:1783441632.568766:0:14796:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].40, 120 off15000 00000100:00100000:3.0:1783441632.568833:0:14796:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff91a874dcea00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:94394728-4014-4ef0-b525-989290f008aa:14796:1870073693307008:0@lo:502:mount.lustre.0 00000100:00100000:3.0:1783441632.568920:0:14796:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783441632.569143:0:14156:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073693307008 00000100:00100000:3.0:1783441632.569158:0:14156:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073693307008 00000100:00100000:3.0:1783441632.569205:0:14156:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 47 00000100:00100000:3.0:1783441632.569214:0:14156:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a87563e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:94394728-4014-4ef0-b525-989290f008aa+16:14796:x1870073693307008:12345-0@lo:502:mount.lustre.0 00000100:00100000:3.0:1783441632.570137:0:14156:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a87563e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:94394728-4014-4ef0-b525-989290f008aa+16:14796:x1870073693307008:12345-0@lo:502:mount.lustre.0 Request processed in 920us (1213us total) trans 0 rc 0/0 00000100:00100000:3.0:1783441632.570147:0:14156:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 47 00000100:00100000:3.0:1783441632.570205:0:14796:0:(client.c:2702:ptlrpc_set_wait()) set ffff91a85fe52000 going to sleep for 11 seconds 00000100:00100000:3.0:1783441632.570227:0:14796:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff91a874dcea00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:94394728-4014-4ef0-b525-989290f008aa:14796:1870073693307008:0@lo:502:mount.lustre.0 00000040:00080000:3.0:1783441632.570326:0:14796:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].41, 224 off15224 00000040:00080000:3.0:1783441632.570338:0:14796:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 41 count 42 00000020:01000004:3.0:1783441632.575874:0:14819:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-OST0000 (typ=lwp) 00000020:00000080:3.0:1783441632.575891:0:14819:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-OST0000 (ffff91a877f7cd40) 00000020:00000080:3.0:1783441632.575911:0:14819:0:(obd_config.c:720:class_attach_name()) OBD: dev 14 attached type lwp with refcount 2 00000020:01000004:3.0:1783441632.576084:0:14819:0:(tgt_mount.c:153:server_get_mount()) get mount ffff91a745264800 from lustre-OST0000, refs=3 00000020:01000004:3.0:1783441632.576088:0:14819:0:(tgt_mount.c:187:server_put_mount()) put mount ffff91a745264800 from lustre-OST0000, refs=3 00000020:01000004:3.0:1783441632.576091:0:14819:0:(obd_mount.c:710:lustre_put_lsi()) put ffff91a745264800 3 00010000:00080000:3.0:1783441632.576130:0:14819:0:(ldlm_lib.c:102:import_set_conn()) imp ffff91a84388d800@lustre-MDT0000-lwp-OST0000: add connection 192.168.201.113@tcp at head 00010000:00010000:3.0:1783441632.584230:0:14819:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-OST0000-4 is initialized 00000020:00000080:3.0:1783441632.584341:0:14819:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-OST0000 (uuid lustre-MDT0000-lwp-OST0000_UUID) 00000010:01000000:3.0:1783441632.584384:0:14819:0:(lwp_dev.c:497:lwp_obd_connect()) connect #0 00000020:00000080:3.0:1783441632.584783:0:14819:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-lwp-OST0000, cookie 0xa2426164df2c88ed 00000100:00080000:3.0:1783441632.584796:0:14819:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 0 00000100:00080000:3.0:1783441632.584803:0:14819:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff91a84388d800 using connection 192.168.201.113@tcp/0@lo 00000100:00100000:3.0:1783441632.584840:0:14819:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff91a874dcea00 x1870073693307136/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1783441632.585485:0:14819:0:(pinger.c:374:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID 00000100:00080000:3.0:1783441632.585521:0:33:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1783441632.585540:0:33:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:3.0:1783441632.585543:0:33:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1783441632.585546:0:33:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:3.0:1783441632.585775:0:3306:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1783441632.585792:0:3306:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff91a874dced80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3306:1870073693307264:0@lo:400:kworker.0 00000100:00100000:3.0:1783441632.586555:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783441632.586691:0:3302:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff91a874dcea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3302:1870073693307136:0@lo:38:llog_process_th.0 00000100:00100000:1.0:1783441632.586758:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000040:00080000:3.0:1783441632.587090:0:14819:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xa:0x0] index 42 count 42 00000020:01000000:1.0:1783441632.596796:0:14796:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-41 (rc=0) 10000000:01000000:1.0:1783441632.596841:0:14796:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.201.113@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:1.0:1783441632.596862:0:14796:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.113@tcp lock: ffff91a85fe58400/0xa2426164df2c88d8 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xa2426164df2c88df expref: -99 pid: 14796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783441632.596875:0:14796:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.113@tcp lock: ffff91a85fe58400/0xa2426164df2c88d8 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xa2426164df2c88df expref: -99 pid: 14796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:1.0:1783441632.596929:0:14796:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:1.0:1783441632.597003:0:14796:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:1.0:1783441632.597013:0:14796:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1783441632.597015:0:14796:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1783441632.597016:0:14796:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1783441632.597017:0:14796:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1783441632.597024:0:14796:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:1.0:1783441632.597026:0:14796:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1783441632.597028:0:14796:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:1.0:1783441632.597031:0:14796:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0000 0x40020002 00000020:01000004:1.0:1783441632.597034:0:14796:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:1.0:1783441632.597035:0:14796:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:1.0:1783441632.597036:0:14796:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1783441632.597037:0:14796:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1783441632.597038:0:14796:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1783441632.597039:0:14796:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1783441632.597040:0:14796:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:1.0:1783441632.597041:0:14796:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1783441632.597042:0:14796:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:1.0:1783441632.597069:0:14796:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0000 00000100:00100000:1.0:1783441632.597088:0:14796:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff91a745553480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:94394728-4014-4ef0-b525-989290f008aa:14796:1870073693307392:0@lo:253:mount.lustre.0 00000100:00100000:1.0:1783441632.597149:0:14796:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783441632.597176:0:14155:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073693307392 00000100:00100000:1.0:1783441632.597182:0:14155:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073693307392 00000100:00100000:1.0:1783441632.597219:0:14155:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 48 00000100:00100000:1.0:1783441632.597226:0:14155:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a87563d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:94394728-4014-4ef0-b525-989290f008aa+16:14796:x1870073693307392:12345-0@lo:253:mount.lustre.0 20000000:01000000:1.0:1783441632.597263:0:14155:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 0 is ready to reconnect. 20000000:01000000:1.0:1783441632.597276:0:14155:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 00000100:00100000:0.0:1783441632.597710:0:14162:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073693307264 00000100:00100000:0.0:1783441632.597716:0:14162:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073693307264 00000100:00100000:0.0:1783441632.597770:0:14162:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073693307136 00000100:00100000:0.0:1783441632.597773:0:14162:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073693307136 00000100:00100000:0.0:1783441632.597785:0:14162:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1783441632.597792:0:14162:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a874dcd180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3306:x1870073693307264:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1783441632.598055:0:14164:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 3 min 3 max 116 00000100:00100000:2.0:1783441632.598064:0:14164:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt00_003' 00000100:00100000:0.0:1783441632.598464:0:14162:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a874dcd180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3306:x1870073693307264:12345-0@lo:400:kworker.0 Request processed in 57us (11297us total) trans 0 rc 0/0 00000100:00100000:0.0:1783441632.598475:0:14162:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1783441632.598495:0:14162:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1783441632.598500:0:14162:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a745550380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3302:x1870073693307136:12345-0@lo:38:llog_process_th.0 00010000:00080000:0.0:1783441632.598530:0:14162:0:(ldlm_lib.c:1432:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-OST0000_UUID@0@lo t0 exp 0000000000000000 cur 470 last 0 00000020:00000080:0.0:1783441632.598564:0:14162:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-lwp-OST0000_UUID, cookie 0xa2426164df2c88f4 00000004:00100000:0.0:1783441632.598578:0:14162:0:(mdt_handler.c:7286:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:0.0:1783441632.598960:0:14162:0:(import.c:65:import_set_state_nolock()) ffff91a8655b5000 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1783441632.599027:0:14162:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a745550380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3302:x1870073693307136:12345-0@lo:38:llog_process_th.0 Request processed in 525us (12286us total) trans 0 rc 0/0 00000100:00100000:0.0:1783441632.599033:0:14162:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00080000:3.0:1783441632.599533:0:3306:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@ffff91a874dced80 x1870073693307264/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1783441648 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1783441632.599548:0:3306:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff91a874dced80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3306:1870073693307264:0@lo:400:kworker.0 00000100:00100000:0.0:1783441632.601889:0:14796:0:(client.c:2702:ptlrpc_set_wait()) set ffff91a848630f00 going to sleep for 11 seconds 00010000:00080000:1.0:1783441632.602477:0:3302:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@ffff91a874dcea00 x1870073693307136/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/416 e 0 to 0 dl 1783441642 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1783441632.602489:0:3302:0:(client.c:3112:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0000: committing for last_committed 0 gen 2 00000100:00080000:1.0:1783441632.602499:0:3302:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-OST0000: connect to target with instance 2 00000100:00080000:1.0:1783441632.602508:0:3302:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-OST0000: Resetting ns_connect_flags to server flags: 0x2041401043000020 00000100:00080000:1.0:1783441632.602514:0:3302:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:1.0:1783441632.602517:0:3302:0:(import.c:65:import_set_state_nolock()) ffff91a84388d800 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:1.0:1783441632.602525:0:3302:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff91a874dcea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3302:1870073693307136:0@lo:38:llog_process_th.0 20000000:01000000:2.0:1783441632.646841:0:14155:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:2.0:1783441632.646864:0:14155:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0000, index=0, rc=0 20000000:01000000:1.0:1783441632.646952:0:14178:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:1.0:1783441632.646964:0:14178:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:1.0:1783441632.646987:0:14178:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff91a87da47200/0xa2426164df2c88fb lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14178 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783441632.647015:0:14178:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff91a85eaa0200/0xa2426164df2c8868 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xa2426164df2c8861 expref: 16 pid: 14157 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783441632.647024:0:14178:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff91a87da47200/0xa2426164df2c88fb lrc: 4/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 14178 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783441632.647069:0:14178:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff91a85eaa0200/0xa2426164df2c8868 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xa2426164df2c8861 expref: 16 pid: 14157 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783441632.647086:0:14178:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff91a85eaa0200/0xa2426164df2c8868 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xa2426164df2c8861 expref: 16 pid: 14157 timeout: 570 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783441632.647102:0:14178:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff91a745550000 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:14178:1870073693307520:0@lo:104: 00000100:00100000:1.0:1783441632.647183:0:14178:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783441632.647289:0:14178:0:(client.c:2702:ptlrpc_set_wait()) set ffff91a746c8d900 going to sleep for 11 seconds 00000100:00100000:2.0:1783441632.647478:0:14147:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073693307520 00000100:00100000:2.0:1783441632.647486:0:14147:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073693307520 00000100:00100000:2.0:1783441632.647574:0:14147:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1783441632.647584:0:14147:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a745550e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:94394728-4014-4ef0-b525-989290f008aa+3:14178:x1870073693307520:12345-0@lo:104: 00010000:00010000:2.0:1783441632.647599:0:14147:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.113@tcp lock: ffff91a87da46a00/0xa2426164df2c8861 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xa2426164df2c8868 expref: -99 pid: 14160 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783441632.647664:0:14147:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:2.0:1783441632.647670:0:14147:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a745550e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:94394728-4014-4ef0-b525-989290f008aa+3:14178:x1870073693307520:12345-0@lo:104: Request processed in 88us (489us total) trans 0 rc 0/0 00000100:00100000:2.0:1783441632.647677:0:14147:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1783441632.647778:0:14178:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff91a745550000 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:14178:1870073693307520:0@lo:104: 00010000:00010000:3.0:1783441632.647801:0:14178:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff91a87da47200/0xa2426164df2c88fb lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14178 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783441632.647824:0:14151:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1783441632.647830:0:14151:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.113@tcp lock: ffff91a87da46a00/0xa2426164df2c8861 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xa2426164df2c8868 expref: -99 pid: 14160 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783441632.647838:0:14151:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91a87da46a00 already unused, calling callback (ffffffffc1b78c20) 10000000:00010000:1.0:1783441632.647842:0:14151:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.113@tcp lock: ffff91a87da46a00/0xa2426164df2c8861 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xa2426164df2c8868 expref: -99 pid: 14160 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783441632.647851:0:14151:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.113@tcp lock: ffff91a87da46a00/0xa2426164df2c8861 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xa2426164df2c8868 expref: -99 pid: 14160 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1783441632.647858:0:14151:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.113@tcp lock: ffff91a87da46a00/0xa2426164df2c8861 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xa2426164df2c8868 expref: -99 pid: 14160 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1783441632.647874:0:14151:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:1.0:1783441632.647917:0:14151:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.113@tcp lock: ffff91a87da46a00/0xa2426164df2c8861 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xa2426164df2c8868 expref: -99 pid: 14160 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783441632.647924:0:14151:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00000100:00100000:0.0:1783441632.648041:0:3306:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff91a745551f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:94394728-4014-4ef0-b525-989290f008aa:3306:1870073693307648:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1783441632.648076:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1783441632.648122:0:14151:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.113@tcp lock: ffff91a87da46a00/0xa2426164df2c8861 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xa2426164df2c8868 expref: -99 pid: 14160 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783441632.648130:0:14151:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.113@tcp lock: ffff91a87da46a00/0xa2426164df2c8861 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xa2426164df2c8868 expref: -99 pid: 14160 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783441632.648154:0:14151:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783441632.648156:0:14151:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783441632.648158:0:14151:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1783441632.648178:0:14150:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073693307648 00000100:00100000:1.0:1783441632.648182:0:14150:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073693307648 00010000:00010000:1.0:1783441632.648201:0:14150:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff91a85eaa0200/0xa2426164df2c8868 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xa2426164df2c8861 expref: 17 pid: 14157 timeout: 570 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783441632.648222:0:14150:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1783441632.648227:0:14150:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a877fadc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:94394728-4014-4ef0-b525-989290f008aa+17:3306:x1870073693307648:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1783441632.648236:0:14150:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1783441632.648240:0:14150:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff91a85eaa0200/0xa2426164df2c8868 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xa2426164df2c8861 expref: 17 pid: 14157 timeout: 570 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783441632.648250:0:14150:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff91a85eaa0200/0xa2426164df2c8868 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xa2426164df2c8861 expref: 17 pid: 14157 timeout: 570 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783441632.648263:0:14150:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff91a85eaa0200/0xa2426164df2c8868 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xa2426164df2c8861 expref: 17 pid: 14157 timeout: 570 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783441632.648285:0:14150:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff91a87da47200/0xa2426164df2c88fb lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 14178 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783441632.648294:0:14150:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff91a87da47200/0xa2426164df2c88fb lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 14178 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:1.0:1783441632.648311:0:14150:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.003386120s 00010000:00010000:1.0:1783441632.648316:0:14150:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff91a87da47200/0xa2426164df2c88fb lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14178 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783441632.648324:0:14150:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff91a87da47200/0xa2426164df2c88fb lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 14178 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783441632.648330:0:14150:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff91a87da47200/0xa2426164df2c88fb lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 14178 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783441632.648337:0:14150:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff91a87da47200/0xa2426164df2c88fb lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 14178 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783441632.648343:0:14150:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91a87da47200 already unused, calling callback (ffffffffc155ff90) 00010000:00010000:1.0:1783441632.648347:0:14150:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff91a87da47200/0xa2426164df2c88fb lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 14178 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783441632.648354:0:14150:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff91a87da47200/0xa2426164df2c88fb lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 14178 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783441632.648367:0:14150:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff91a87da47200/0xa2426164df2c88fb lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14178 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783441632.648376:0:14150:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1783441632.648623:0:14150:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a877fadc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:94394728-4014-4ef0-b525-989290f008aa+16:3306:x1870073693307648:12345-0@lo:103:ldlm_bl.0 Request processed in 394us (545us total) trans 0 rc 0/0 00000100:00100000:1.0:1783441632.648630:0:14150:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00010000:1.0:1783441632.648658:0:14178:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff91a87da47200/0xa2426164df2c88fb lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14178 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783441632.648667:0:14178:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff91a87da47200/0xa2426164df2c88fb lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14178 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783441632.648674:0:14178:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff91a87da47200/0xa2426164df2c88fb lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14178 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783441632.649357:0:3306:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff91a745551f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:94394728-4014-4ef0-b525-989290f008aa:3306:1870073693307648:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1783441632.661001:0:14155:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a87563d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:94394728-4014-4ef0-b525-989290f008aa+15:14796:x1870073693307392:12345-0@lo:253:mount.lustre.0 Request processed in 63767us (63844us total) trans 0 rc 0/0 00000100:00100000:0.0:1783441632.661026:0:14155:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 48 00000100:00100000:3.0:1783441632.661184:0:14796:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff91a745553480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:94394728-4014-4ef0-b525-989290f008aa:14796:1870073693307392:0@lo:253:mount.lustre.0 10000000:01000000:3.0:1783441632.661203:0:14796:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0000 got index = 0 00000020:01000004:3.0:1783441632.661207:0:14796:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:3.0:1783441632.661209:0:14796:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:3.0:1783441632.661210:0:14796:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1783441632.661211:0:14796:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1783441632.661212:0:14796:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1783441632.661213:0:14796:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1783441632.661214:0:14796:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:3.0:1783441632.661217:0:14796:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1783441632.661218:0:14796:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:3.0:1783441632.661234:0:14796:0:(tgt_mount.c:2690:server_calc_timeout()) lustre-OST0000: Imperative Recovery not enabled, recovery window 60-180 00080000:10000000:3.0:1783441632.668416:0:14796:0:(osd_index.c:2102:osd_index_try()) lustre-OST0000: index object [0x200000003:0x5:0x0] (8/8/4) registered 00080000:10000000:3.0:1783441632.668612:0:14796:0:(osd_index.c:2102:osd_index_try()) lustre-OST0000: index object [0x200000005:0x1:0x0] (8/8/1) registered 00080000:10000000:3.0:1783441632.668806:0:14796:0:(osd_index.c:2102:osd_index_try()) lustre-OST0000: index object [0x200000003:0x6:0x0] (8/8/4) registered 00080000:10000000:3.0:1783441632.668974:0:14796:0:(osd_index.c:2102:osd_index_try()) lustre-OST0000: index object [0x200000005:0x2:0x0] (8/8/1) registered 00080000:10000000:3.0:1783441632.669149:0:14796:0:(osd_index.c:2102:osd_index_try()) lustre-OST0000: index object [0x200000003:0x7:0x0] (8/8/4) registered 00080000:10000000:3.0:1783441632.669358:0:14796:0:(osd_index.c:2102:osd_index_try()) lustre-OST0000: index object [0x200000005:0x3:0x0] (8/8/1) registered 00000001:00000004:0.0:1783441632.670691:0:14796:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 2, last_transno is 8589934592 00002000:00080000:0.0:1783441632.736792:0:14796:0:(ofd_obd.c:539:ofd_postrecov()) lustre-OST0000: recovery is over 00100000:10000000:0.0:1783441632.736803:0:14796:0:(lfsck_lib.c:3085:lfsck_start()) lustre-OST0000-osd: start master thread 00000020:01000004:0.0:1783441632.736844:0:14796:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:0.0:1783441632.736908:0:14796:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.201.113@tcp: cl_mgc_mutex unlock 00000020:01000004:0.0:1783441632.736925:0:14796:0:(tgt_mount.c:2459:server_fill_super_common()) Server sb, dev=48 00000080:00000004:0.0:1783441632.737143:0:14796:0:(super25.c:187:lustre_fill_super()) lustre-ost1/ost1: Mount complete 00010000:00010000:0.0:1783441633.132946:0:14152:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783441634.158155:0:14151:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:1.0:1783441634.485542:0:14160:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:1.0:1783441634.485553:0:14160:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-mdtir-ffff91a844b0f000 from 7 10000000:01000000:1.0:1783441634.485559:0:14160:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:1.0:1783441634.485624:0:14160:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.113@tcp lock: ffff91a87da46400/0xa2426164df2c8902 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14160 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783441634.485638:0:14160:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.113@tcp lock: ffff91a87da46400/0xa2426164df2c8902 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14160 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783441634.485651:0:14160:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.113@tcp lock: ffff91a87da46400/0xa2426164df2c8902 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14160 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783441634.485685:0:14160:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff91a745552680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:94394728-4014-4ef0-b525-989290f008aa:14160:1870073693307776:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1783441634.485811:0:14160:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783441634.485876:0:14160:0:(client.c:2702:ptlrpc_set_wait()) set ffff91a848552e40 going to sleep for 11 seconds 00000100:00100000:3.0:1783441634.486373:0:14157:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073693307776 00000100:00100000:3.0:1783441634.486385:0:14157:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073693307776 00000100:00100000:3.0:1783441634.486466:0:14157:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 49 00000100:00100000:3.0:1783441634.486478:0:14157:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a87563c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:94394728-4014-4ef0-b525-989290f008aa+15:14160:x1870073693307776:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1783441634.486501:0:14157:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1783441634.486527:0:14157:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff91a841477e00/0xa2426164df2c8909 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xa2426164df2c8902 expref: -99 pid: 14157 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783441634.486559:0:14157:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff91a841477e00/0xa2426164df2c8909 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xa2426164df2c8902 expref: 16 pid: 14157 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783441634.486573:0:14157:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff91a841477e00/0xa2426164df2c8909 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xa2426164df2c8902 expref: 16 pid: 14157 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783441634.486585:0:14157:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91a841477e00, rc 0) 00000100:00100000:3.0:1783441634.486652:0:14157:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a87563c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:94394728-4014-4ef0-b525-989290f008aa+16:14160:x1870073693307776:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 176us (841us total) trans 0 rc 0/0 00000100:00100000:3.0:1783441634.486659:0:14157:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 49 00000100:00100000:3.0:1783441634.486731:0:14160:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff91a745552680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:94394728-4014-4ef0-b525-989290f008aa:14160:1870073693307776:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1783441634.486772:0:14160:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.113@tcp lock: ffff91a87da46400/0xa2426164df2c8902 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xa2426164df2c8909 expref: -99 pid: 14160 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783441634.486782:0:14160:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.113@tcp lock: ffff91a87da46400/0xa2426164df2c8902 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xa2426164df2c8909 expref: -99 pid: 14160 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783441634.486881:0:14160:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff91a874dced80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:94394728-4014-4ef0-b525-989290f008aa:14160:1870073693307904:0@lo:256:ll_cfg_requeue.0 00000100:00100000:3.0:1783441634.486919:0:14160:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783441634.491135:0:14160:0:(client.c:2702:ptlrpc_set_wait()) set ffff91a875345300 going to sleep for 11 seconds 00000100:00100000:1.0:1783441634.491579:0:14156:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073693307904 00000100:00100000:1.0:1783441634.491593:0:14156:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073693307904 00000100:00100000:2.0:1783441634.500721:0:14156:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 50 00000100:00100000:2.0:1783441634.500759:0:14156:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a87563c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:94394728-4014-4ef0-b525-989290f008aa+16:14160:x1870073693307904:12345-0@lo:256:ll_cfg_requeue.0 20000000:01000000:2.0:1783441634.500798:0:14156:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:2.0:1783441634.500821:0:14156:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:2.0:1783441634.500824:0:14156:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 7 00000100:00100000:2.0:1783441634.501012:0:14156:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a87563c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:94394728-4014-4ef0-b525-989290f008aa+16:14160:x1870073693307904:12345-0@lo:256:ll_cfg_requeue.0 Request processed in 279us (14092us total) trans 0 rc 0/0 00000100:00100000:2.0:1783441634.501021:0:14156:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 50 00000100:00100000:2.0:1783441634.501089:0:14160:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff91a874dced80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:94394728-4014-4ef0-b525-989290f008aa:14160:1870073693307904:0@lo:256:ll_cfg_requeue.0 10000000:01000000:2.0:1783441634.501181:0:14160:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.201.113@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:2.0:1783441634.501196:0:14160:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.113@tcp lock: ffff91a87da46400/0xa2426164df2c8902 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xa2426164df2c8909 expref: -99 pid: 14160 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783441634.501209:0:14160:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.113@tcp lock: ffff91a87da46400/0xa2426164df2c8902 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xa2426164df2c8909 expref: -99 pid: 14160 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783441635.181019:0:14152:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783441636.206439:0:14151:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783441637.229335:0:14152:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:3.0:1783441637.743063:0:33:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1783441637.743074:0:33:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:3.0:1783441637.743077:0:33:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1783441637.743081:0:33:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:3.0:1783441637.743153:0:3304:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff91a874dcdf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3304:1870073693308160:0@lo:400:kworker.0 00000100:00100000:3.0:1783441637.743239:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783441637.743308:0:3304:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1783441637.743315:0:3304:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff91a874dcdc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:94394728-4014-4ef0-b525-989290f008aa:3304:1870073693308032:0@lo:400:kworker.0 00000100:00100000:3.0:1783441637.743346:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783441637.743376:0:3306:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1783441637.743385:0:3306:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff91a874dcd500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3306:1870073693308288:0@lo:400:kworker.0 00000100:00100000:3.0:1783441637.743413:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783441637.743441:0:14162:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073693308160 00000100:00100000:3.0:1783441637.743448:0:14162:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073693308160 00000100:00100000:3.0:1783441637.743487:0:14162:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073693308288 00000100:00100000:3.0:1783441637.743490:0:14162:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073693308288 00000100:00100000:3.0:1783441637.743519:0:14162:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1783441637.743527:0:14162:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a874dcca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3304:x1870073693308160:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1783441637.743580:0:14162:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a874dcca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3304:x1870073693308160:12345-0@lo:400:kworker.0 Request processed in 53us (341us total) trans 0 rc 0/0 00000100:00100000:3.0:1783441637.743606:0:14162:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1783441637.743627:0:14162:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1783441637.743633:0:14162:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a874dce680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3306:x1870073693308288:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1783441637.743665:0:14162:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a874dce680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3306:x1870073693308288:12345-0@lo:400:kworker.0 Request processed in 33us (251us total) trans 0 rc 0/0 00000100:00100000:3.0:1783441637.743671:0:14162:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1783441637.743688:0:14155:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073693308032 00000100:00100000:3.0:1783441637.743691:0:14155:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073693308032 00000100:00100000:3.0:1783441637.743714:0:14155:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 51 00000100:00100000:3.0:1783441637.743721:0:14155:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a874be9050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:94394728-4014-4ef0-b525-989290f008aa+16:3304:x1870073693308032:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1783441637.743771:0:14155:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a874be9050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:94394728-4014-4ef0-b525-989290f008aa+16:3304:x1870073693308032:12345-0@lo:400:kworker.0 Request processed in 51us (424us total) trans 0 rc 0/0 00000100:00100000:3.0:1783441637.743777:0:14155:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 51 00000100:00080000:3.0:1783441637.743823:0:14159:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1783441637.748523:0:3304:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff91a874dcdc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:94394728-4014-4ef0-b525-989290f008aa:3304:1870073693308032:0@lo:400:kworker.0 00010000:00080000:3.0:1783441637.749467:0:3306:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff91a874dcd500 x1870073693308288/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1783441653 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1783441637.749484:0:3306:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff91a874dcd500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3306:1870073693308288:0@lo:400:kworker.0 00010000:00080000:3.0:1783441637.749541:0:3304:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff91a874dcdf80 x1870073693308160/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1783441653 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1783441637.749552:0:3304:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff91a874dcdf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3304:1870073693308160:0@lo:400:kworker.0 00010000:00010000:1.0:1783441638.256108:0:14151:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783441639.277131:0:14152:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:3.0:1783441639.925282:0:15165:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg113-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00010000:00010000:1.0:1783441640.302017:0:14151:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783441641.325041:0:14152:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:1.0:1783441641.837490:0:14197:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:1.0:1783441642.354332:0:14151:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:3.0:1783441642.866062:0:33:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1783441642.866069:0:33:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:3.0:1783441642.866073:0:33:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1783441642.866076:0:33:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:3.0:1783441642.866246:0:3303:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff91a874dcdc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3303:1870073693308544:0@lo:400:kworker.0 00000100:00100000:3.0:1783441642.866325:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783441642.866386:0:3303:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1783441642.866435:0:3303:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff91a874dcd500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3303:1870073693308672:0@lo:400:kworker.0 00000100:00100000:3.0:1783441642.866461:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783441642.866497:0:14162:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073693308544 00000100:00100000:3.0:1783441642.866505:0:14162:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073693308544 00000100:00100000:3.0:1783441642.866544:0:14162:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073693308672 00000100:00100000:3.0:1783441642.866548:0:14162:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073693308672 00000100:00100000:2.0:1783441642.866721:0:3306:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff91a874dcdf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:94394728-4014-4ef0-b525-989290f008aa:3306:1870073693308416:0@lo:400:kworker.0 00000100:00100000:2.0:1783441642.866787:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783441642.866854:0:14162:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:3.0:1783441642.866864:0:14162:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a874dcfb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3303:x1870073693308544:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1783441642.866917:0:14162:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a874dcfb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3303:x1870073693308544:12345-0@lo:400:kworker.0 Request processed in 54us (591us total) trans 0 rc 0/0 00000100:00100000:3.0:1783441642.866924:0:14162:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:0.0:1783441642.872832:0:14157:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073693308416 00000100:00100000:0.0:1783441642.872857:0:14157:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073693308416 00000100:00100000:0.0:1783441642.872920:0:14157:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 52 00000100:00100000:0.0:1783441642.872932:0:14157:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a874bea850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:94394728-4014-4ef0-b525-989290f008aa+16:3306:x1870073693308416:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1783441642.873041:0:14157:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a874bea850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:94394728-4014-4ef0-b525-989290f008aa+16:3306:x1870073693308416:12345-0@lo:400:kworker.0 Request processed in 112us (6252us total) trans 0 rc 0/0 00000100:00100000:0.0:1783441642.873049:0:14157:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 52 00000100:00100000:0.0:1783441642.873091:0:14821:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:0.0:1783441642.873101:0:14821:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a874dcf480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3303:x1870073693308672:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1783441642.873139:0:14821:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a874dcf480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3303:x1870073693308672:12345-0@lo:400:kworker.0 Request processed in 40us (6676us total) trans 0 rc 0/0 00000100:00100000:0.0:1783441642.873145:0:14821:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00080000:0.0:1783441642.873168:0:14159:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1783441642.874456:0:3306:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff91a874dcdf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:94394728-4014-4ef0-b525-989290f008aa:3306:1870073693308416:0@lo:400:kworker.0 00010000:00080000:2.0:1783441642.875849:0:3303:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff91a874dcd500 x1870073693308672/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1783441658 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1783441642.875867:0:3303:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff91a874dcd500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3303:1870073693308672:0@lo:400:kworker.0 00010000:00080000:2.0:1783441642.875881:0:3303:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff91a874dcdc00 x1870073693308544/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1783441658 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1783441642.875891:0:3303:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff91a874dcdc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3303:1870073693308544:0@lo:400:kworker.0 00010000:00010000:0.0:1783441643.373358:0:14152:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783441644.398362:0:14151:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1783441644.847186:0:3302:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1783441629/real 1783441629] req@ffff91a745553800 x1870073693304576/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1783441644 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1783441644.847221:0:3302:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff91a745553800 x1870073693304576/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1783441644 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1783441644.847232:0:3302:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1783441629/real 1783441629] req@ffff91a745551500 x1870073693304704/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1783441644 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1783441644.847244:0:3302:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff91a745551500 x1870073693304704/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1783441644 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:3.0:1783441644.847282:0:3302:0:(import.c:65:import_set_state_nolock()) ffff91a84869f800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1783441644.847292:0:3302:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 0@lo failed (-110) 00000100:00100000:3.0:1783441644.847297:0:3302:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff91a745553800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3302:1870073693304576:0@lo:8:kworker.0 00000100:00080000:3.0:1783441644.847302:0:3302:0:(import.c:65:import_set_state_nolock()) ffff91a848696000 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1783441644.847307:0:3302:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-110) 00000100:00100000:3.0:1783441644.847310:0:3302:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff91a745551500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3302:1870073693304704:0@lo:8:kworker.0 00000100:00100000:0.0:1783441644.847916:0:3305:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff91a874dcd880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:94394728-4014-4ef0-b525-989290f008aa:3305:1870073693308800:0@lo:400:kworker.0 00000100:00100000:0.0:1783441644.849464:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:3.0:1783441644.849563:0:33:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1783441644.849568:0:33:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery 00000100:00080000:3.0:1783441644.849571:0:33:0:(import.c:65:import_set_state_nolock()) ffff91a84869f800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1783441644.849577:0:33:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-MDT0000: connect to NID 0@lo last attempt 467 00000100:00080000:3.0:1783441644.849582:0:33:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-MDT0000: tried all connections, increasing latency to 10s 00000100:00080000:3.0:1783441644.849589:0:33:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-MDT0000: import ffff91a84869f800 using connection 192.168.201.113@tcp/0@lo 00000100:00100000:3.0:1783441644.849622:0:33:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff91a874dcc700 x1870073693308928/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1783441644.849640:0:33:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1783441644.849644:0:33:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:3.0:1783441644.849646:0:33:0:(import.c:65:import_set_state_nolock()) ffff91a848696000 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1783441644.849649:0:33:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-MDT0000: connect to NID 0@lo last attempt 467 00000100:00080000:3.0:1783441644.849652:0:33:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-MDT0000: tried all connections, increasing latency to 10s 00000100:00080000:3.0:1783441644.849656:0:33:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff91a848696000 using connection 192.168.201.113@tcp/0@lo 00000100:00100000:3.0:1783441644.849668:0:33:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff91a874dcf100 x1870073693309056/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1783441644.849722:0:3303:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff91a874dcc000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3303:1870073693309312:0@lo:400:kworker.0 00000100:00100000:3.0:1783441644.849788:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783441644.850968:0:3302:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff91a874dcc700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3302:1870073693308928:0@lo:8:kworker.0 00000100:00100000:3.0:1783441644.851006:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783441644.851032:0:3302:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff91a874dcf100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3302:1870073693309056:0@lo:8:kworker.0 00000100:00100000:3.0:1783441644.851050:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783441644.851139:0:3305:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1783441644.851146:0:3305:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff91a874dcc380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3305:1870073693309184:0@lo:400:kworker.0 00000100:00100000:0.0:1783441644.851168:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783441644.851201:0:14821:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073693309312 00000100:00100000:0.0:1783441644.851207:0:14821:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073693309312 00000100:00100000:0.0:1783441644.851249:0:14821:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073693309184 00000100:00100000:0.0:1783441644.851252:0:14821:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073693309184 00000100:00100000:0.0:1783441644.851266:0:14821:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:0.0:1783441644.851273:0:14821:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a874dcf800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3303:x1870073693309312:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1783441644.851317:0:14821:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a874dcf800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3303:x1870073693309312:12345-0@lo:400:kworker.0 Request processed in 44us (1528us total) trans 0 rc 0/0 00000100:00100000:0.0:1783441644.851323:0:14821:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:0.0:1783441644.851336:0:14821:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:0.0:1783441644.851341:0:14821:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a877fae300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3305:x1870073693309184:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1783441644.851375:0:14821:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a877fae300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3305:x1870073693309184:12345-0@lo:400:kworker.0 Request processed in 33us (205us total) trans 0 rc 0/0 00000100:00100000:0.0:1783441644.851381:0:14821:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:0.0:1783441644.851401:0:14798:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073693308928 00000100:00100000:0.0:1783441644.851404:0:14798:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073693308928 00000100:00100000:0.0:1783441644.851415:0:14798:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073693309056 00000100:00100000:0.0:1783441644.851417:0:14798:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073693309056 00000100:00100000:0.0:1783441644.851424:0:14798:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1783441644.851428:0:14798:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a874dcce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:3302:x1870073693308928:12345-0@lo:8:kworker.0 00010000:00080000:0.0:1783441644.851447:0:14798:0:(ldlm_lib.c:1432:target_handle_connect()) lustre-OST0000: connection from lustre-MDT0000-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 482 last 0 00000020:00000080:0.0:1783441644.851471:0:14798:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0xa2426164df2c8910 00002000:00100000:0.0:1783441644.851482:0:14798:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli lustre-MDT0000-mdtlov_UUID/ffff91a8655b6000 ocd_connect_flags: 0xa044401443000026 ocd_version: 2113669 ocd_grant: 0 ocd_index: 0 ocd_group 0 00002000:00080000:0.0:1783441644.851486:0:14798:0:(ofd_obd.c:139:ofd_parse_connect_data()) lustre-OST0000: Received MDS connection for group 0 00002000:00100000:0.0:1783441644.851488:0:14798:0:(ofd_obd.c:227:ofd_parse_connect_data()) lustre-OST0000: cli does not support OBD_CONNECT_CKSUM 00002000:00080000:0.0:1783441644.851791:0:14798:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:0.0:1783441644.852032:0:14798:0:(import.c:65:import_set_state_nolock()) ffff91a8655b4000 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1783441644.852070:0:14798:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a874dcce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3302:x1870073693308928:12345-0@lo:8:kworker.0 Request processed in 640us (1063us total) trans 0 rc 0/0 00000100:00100000:0.0:1783441644.852077:0:14798:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1783441644.852093:0:14798:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1783441644.852097:0:14798:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a874dce300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:3302:x1870073693309056:12345-0@lo:8:kworker.0 00010000:00020000:0.0:1783441644.852108:0:14798:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-OST0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:0.0:1783441644.852129:0:14798:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a874dce300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:3302:x1870073693309056:12345-0@lo:8:kworker.0 Request processed in 32us (1078us total) trans 0 rc -19/-19 00000100:00100000:0.0:1783441644.852134:0:14798:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00080000:0.0:1783441644.852149:0:14159:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:0.0:1783441644.852186:0:3305:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff91a874dcc380 x1870073693309184/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1783441660 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1783441644.852200:0:3305:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff91a874dcc380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3305:1870073693309184:0@lo:400:kworker.0 00010000:00080000:3.0:1783441644.852297:0:3303:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff91a874dcc000 x1870073693309312/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1783441660 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1783441644.852308:0:3303:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff91a874dcc000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3303:1870073693309312:0@lo:400:kworker.0 00010000:00080000:3.0:1783441644.852327:0:3302:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff91a874dcc700 x1870073693308928/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/416 e 0 to 0 dl 1783441664 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1783441644.852335:0:3302:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:3.0:1783441644.852340:0:3302:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-OST0000-osc-MDT0000: connect to target with instance 2 00000100:00080000:3.0:1783441644.852347:0:3302:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-OST0000-osc-MDT0000: Resetting ns_connect_flags to server flags: 0xa040401443000026 00000100:00080000:3.0:1783441644.852351:0:3302:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-OST0000_UUID 00000100:00080000:3.0:1783441644.852354:0:3302:0:(import.c:65:import_set_state_nolock()) ffff91a84869f800 lustre-OST0000_UUID: changing import state from CONNECTING to FULL 00000004:00080000:3.0:1783441644.852377:0:3302:0:(osp_dev.c:1648:osp_import_event()) got connected 00000100:00100000:3.0:1783441644.852381:0:3302:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff91a874dcc700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3302:1870073693308928:0@lo:8:kworker.0 00000100:00080000:3.0:1783441644.852391:0:3302:0:(import.c:65:import_set_state_nolock()) ffff91a848696000 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1783441644.852394:0:3302:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-19) 00000100:00100000:3.0:1783441644.852397:0:3302:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff91a874dcf100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3302:1870073693309056:0@lo:8:kworker.0 00000004:00080000:0.0:1783441644.852533:0:14185:0:(osp_precreate.c:882:osp_precreate_cleanup_orphans()) lustre-OST0000-osc-MDT0000: going to cleanup orphans since [0x240000400:0x6:0x0] 00000100:00100000:0.0:1783441644.852549:0:14185:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff91a877faea00 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:14185:1870073693309568:0@lo:5:osp-pre-0-0.0 00000100:00100000:0.0:1783441644.852575:0:14185:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783441644.852590:0:14185:0:(client.c:2702:ptlrpc_set_wait()) set ffff91a842bd2b40 going to sleep for 11 seconds 00000100:00100000:0.0:1783441644.852600:0:14798:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073693309568 00000100:00100000:0.0:1783441644.852603:0:14798:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073693309568 00000100:00100000:0.0:1783441644.852626:0:14798:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1783441644.852631:0:14798:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a877fad880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:14185:x1870073693309568:12345-0@lo:5:osp-pre-0-0.0 00000100:00100000:3.0:1783441644.854945:0:3304:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff91a877faca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3304:1870073693309440:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1783441644.855015:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783441644.855776:0:14156:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073693308800 00000100:00100000:2.0:1783441644.855786:0:14156:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073693308800 00000100:00100000:2.0:1783441644.855911:0:14156:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 53 00000100:00100000:2.0:1783441644.855922:0:14156:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a874be9c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:94394728-4014-4ef0-b525-989290f008aa+16:3305:x1870073693308800:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1783441644.856086:0:14156:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a874be9c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:94394728-4014-4ef0-b525-989290f008aa+16:3305:x1870073693308800:12345-0@lo:400:kworker.0 Request processed in 165us (6627us total) trans 0 rc 0/0 00000100:00100000:2.0:1783441644.856094:0:14156:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 53 00000004:00080000:2.0:1783441644.856137:0:14184:0:(osp_sync.c:1045:osp_sync_process_record()) processed all old entries 00000004:00080000:2.0:1783441644.856390:0:14184:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 482730647882ns, next at 0ns, rc = 0 00000100:00080000:1.0:1783441644.858279:0:14159:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1783441644.858687:0:14801:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073693309440 00000100:00100000:0.0:1783441644.858697:0:14801:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073693309440 00000100:00100000:0.0:1783441644.858769:0:14801:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1783441644.858778:0:14801:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a874dcf100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3304:x1870073693309440:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1783441644.858828:0:14801:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40960000 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1783441644.858906:0:14801:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a874dcf100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3304:x1870073693309440:12345-0@lo:13:osp-pre-0-0.0 Request processed in 129us (3889us total) trans 0 rc 0/0 00000100:00100000:0.0:1783441644.858913:0:14801:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1783441644.858980:0:3305:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff91a874dcd880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:94394728-4014-4ef0-b525-989290f008aa:3305:1870073693308800:0@lo:400:kworker.0 00010000:00080000:3.0:1783441644.860050:0:3304:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff91a877faca80 x1870073693309440/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1783441660 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1783441644.860087:0:3304:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff91a877faca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3304:1870073693309440:0@lo:13:osp-pre-0-0.0 00002000:00080000:0.0:1783441644.862527:0:14798:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0000: adding sequence 0x240000400 00002000:00080000:0.0:1783441644.862538:0:14798:0:(ofd_dev.c:1640:ofd_create_hdl()) ofd_last_id() = 33 -> diff = -27 00002000:02000040:0.0:1783441644.862543:0:14798:0:(ofd_dev.c:1491:ofd_orphans_destroy()) lustre-OST0000: new connection from lustre-MDT0000-mdtlov (cleaning up unused objects from 0x240000400:7 to 0x240000400:33) 00002000:00010000:0.0:1783441644.875275:0:14798:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x21:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1783441644.875289:0:14798:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000004620269b/0xa2426164df2c8917 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783441644.875313:0:14798:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x21:0x0].0x0 since=482s v=(0 0) 00010000:00010000:0.0:1783441644.875318:0:14798:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x21:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1783441644.875325:0:14798:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000004620269b/0xa2426164df2c8917 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783441644.875342:0:14798:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000004620269b/0xa2426164df2c8917 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783441644.875352:0:14798:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000004620269b/0xa2426164df2c8917 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783441644.875361:0:14798:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000004620269b/0xa2426164df2c8917 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783441644.875378:0:14798:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1783441644.875391:0:14152:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1783441644.875396:0:14152:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000004620269b/0xa2426164df2c8917 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783441644.875403:0:14152:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91a85fe59400 already unused, calling callback (ffffffffc155ff90) 00010000:00010000:0.0:1783441644.875408:0:14152:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000004620269b/0xa2426164df2c8917 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783441644.875417:0:14152:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000004620269b/0xa2426164df2c8917 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783441644.875446:0:14152:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000004620269b/0xa2426164df2c8917 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783441644.875454:0:14152:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000004620269b/0xa2426164df2c8917 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783441644.875473:0:14152:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783441644.875474:0:14152:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783441644.875476:0:14152:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1783441644.876284:0:14798:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x20:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1783441644.876291:0:14798:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000009f9f71a1/0xa2426164df2c891e lrc: 3/0,1 mode: --/PW res: [0x240000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783441644.876302:0:14798:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x20:0x0].0x0 since=482s v=(0 0) 00010000:00010000:0.0:1783441644.876306:0:14798:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x20:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1783441644.876310:0:14798:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000009f9f71a1/0xa2426164df2c891e lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783441644.876320:0:14798:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000009f9f71a1/0xa2426164df2c891e lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783441644.876329:0:14798:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000009f9f71a1/0xa2426164df2c891e lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783441644.876337:0:14798:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000009f9f71a1/0xa2426164df2c891e lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783441644.876363:0:14798:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1783441644.876373:0:14151:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1783441644.876378:0:14151:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000009f9f71a1/0xa2426164df2c891e lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783441644.876385:0:14151:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91a85fe58000 already unused, calling callback (ffffffffc155ff90) 00010000:00010000:0.0:1783441644.876389:0:14151:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000009f9f71a1/0xa2426164df2c891e lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783441644.876397:0:14151:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000009f9f71a1/0xa2426164df2c891e lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783441644.876410:0:14151:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000009f9f71a1/0xa2426164df2c891e lrc: 1/0,0 mode: --/PW res: [0x240000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783441644.876418:0:14151:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000009f9f71a1/0xa2426164df2c891e lrc: 0/0,0 mode: --/PW res: [0x240000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783441644.876430:0:14151:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783441644.876432:0:14151:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783441644.876434:0:14151:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1783441644.877378:0:14798:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x1f:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1783441644.877386:0:14798:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000034d76276/0xa2426164df2c8925 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783441644.877397:0:14798:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1f:0x0].0x0 since=482s v=(0 0) 00010000:00010000:0.0:1783441644.877406:0:14798:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1f:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1783441644.877411:0:14798:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000034d76276/0xa2426164df2c8925 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783441644.877421:0:14798:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000034d76276/0xa2426164df2c8925 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783441644.877428:0:14798:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000034d76276/0xa2426164df2c8925 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783441644.877435:0:14798:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000034d76276/0xa2426164df2c8925 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783441644.877505:0:14798:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:0.0:1783441644.878169:0:14798:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x1e:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1783441644.878176:0:14798:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000012ecb445/0xa2426164df2c892c lrc: 3/0,1 mode: --/PW res: [0x240000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783441644.878186:0:14798:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1e:0x0].0x0 since=482s v=(0 0) 00010000:00010000:0.0:1783441644.878189:0:14798:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1e:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1783441644.878193:0:14798:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000012ecb445/0xa2426164df2c892c lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783441644.878201:0:14798:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000012ecb445/0xa2426164df2c892c lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783441644.878209:0:14798:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000012ecb445/0xa2426164df2c892c lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783441644.878222:0:14798:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000012ecb445/0xa2426164df2c892c lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783441644.879093:0:14152:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1783441644.879103:0:14152:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000034d76276/0xa2426164df2c8925 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783441644.879113:0:14152:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91a85fe59000 already unused, calling callback (ffffffffc155ff90) 00010000:00010000:3.0:1783441644.879118:0:14152:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000034d76276/0xa2426164df2c8925 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783441644.879128:0:14152:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000034d76276/0xa2426164df2c8925 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783441644.879148:0:14152:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000034d76276/0xa2426164df2c8925 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783441644.879155:0:14152:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000034d76276/0xa2426164df2c8925 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783441644.879171:0:14152:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1783441644.879174:0:14152:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000012ecb445/0xa2426164df2c892c lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783441644.879180:0:14152:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91a85fe58800 already unused, calling callback (ffffffffc155ff90) 00010000:00010000:3.0:1783441644.879183:0:14152:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000012ecb445/0xa2426164df2c892c lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783441644.879202:0:14152:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000012ecb445/0xa2426164df2c892c lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783441644.879212:0:14152:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000012ecb445/0xa2426164df2c892c lrc: 2/0,0 mode: --/PW res: [0x240000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783441644.879219:0:14152:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783441644.879220:0:14152:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783441644.879222:0:14152:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783441644.879353:0:14798:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:0.0:1783441644.879360:0:14798:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000012ecb445/0xa2426164df2c892c lrc: 0/0,0 mode: --/PW res: [0x240000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1783441644.884450:0:14798:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x1d:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1783441644.884463:0:14798:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000095adc0b9/0xa2426164df2c8933 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783441644.884480:0:14798:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1d:0x0].0x0 since=482s v=(0 0) 00010000:00010000:0.0:1783441644.884485:0:14798:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1d:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1783441644.884491:0:14798:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000095adc0b9/0xa2426164df2c8933 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783441644.884503:0:14798:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000095adc0b9/0xa2426164df2c8933 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783441644.884512:0:14798:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000095adc0b9/0xa2426164df2c8933 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783441644.884519:0:14798:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000095adc0b9/0xa2426164df2c8933 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783441644.884556:0:14798:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1783441644.884574:0:14152:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1783441644.884580:0:14152:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000095adc0b9/0xa2426164df2c8933 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783441644.884587:0:14152:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91a85fe59200 already unused, calling callback (ffffffffc155ff90) 00010000:00010000:0.0:1783441644.884592:0:14152:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000095adc0b9/0xa2426164df2c8933 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783441644.884601:0:14152:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000095adc0b9/0xa2426164df2c8933 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783441644.884619:0:14152:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000095adc0b9/0xa2426164df2c8933 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783441644.884625:0:14152:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000095adc0b9/0xa2426164df2c8933 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783441644.884642:0:14152:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783441644.884644:0:14152:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783441644.884645:0:14152:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1783441644.885243:0:14798:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x1c:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1783441644.885249:0:14798:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000004bc0e53c/0xa2426164df2c893a lrc: 3/0,1 mode: --/PW res: [0x240000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783441644.885259:0:14798:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1c:0x0].0x0 since=482s v=(0 0) 00010000:00010000:0.0:1783441644.885267:0:14798:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1c:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1783441644.885271:0:14798:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000004bc0e53c/0xa2426164df2c893a lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783441644.885281:0:14798:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000004bc0e53c/0xa2426164df2c893a lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783441644.885288:0:14798:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000004bc0e53c/0xa2426164df2c893a lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783441644.885294:0:14798:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000004bc0e53c/0xa2426164df2c893a lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783441644.885310:0:14798:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1783441644.885319:0:14152:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1783441644.885323:0:14152:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000004bc0e53c/0xa2426164df2c893a lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783441644.885330:0:14152:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91a85fe58e00 already unused, calling callback (ffffffffc155ff90) 00010000:00010000:0.0:1783441644.885333:0:14152:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000004bc0e53c/0xa2426164df2c893a lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783441644.885340:0:14152:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000004bc0e53c/0xa2426164df2c893a lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783441644.885351:0:14152:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000004bc0e53c/0xa2426164df2c893a lrc: 1/0,0 mode: --/PW res: [0x240000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783441644.885369:0:14152:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000004bc0e53c/0xa2426164df2c893a lrc: 0/0,0 mode: --/PW res: [0x240000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783441644.885383:0:14152:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783441644.885385:0:14152:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783441644.885386:0:14152:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1783441644.888297:0:14798:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x1b:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1783441644.888311:0:14798:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000cc470fc7/0xa2426164df2c8941 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783441644.888329:0:14798:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1b:0x0].0x0 since=482s v=(0 0) 00010000:00010000:0.0:1783441644.888334:0:14798:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1b:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1783441644.888339:0:14798:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000cc470fc7/0xa2426164df2c8941 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783441644.888353:0:14798:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000cc470fc7/0xa2426164df2c8941 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783441644.888363:0:14798:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000cc470fc7/0xa2426164df2c8941 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783441644.888370:0:14798:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000cc470fc7/0xa2426164df2c8941 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783441644.888395:0:14798:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1783441644.888410:0:14152:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1783441644.888427:0:14152:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000cc470fc7/0xa2426164df2c8941 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783441644.888434:0:14152:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91a85fe59600 already unused, calling callback (ffffffffc155ff90) 00010000:00010000:0.0:1783441644.888439:0:14152:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000cc470fc7/0xa2426164df2c8941 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783441644.888447:0:14152:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000cc470fc7/0xa2426164df2c8941 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783441644.888465:0:14152:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000cc470fc7/0xa2426164df2c8941 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783441644.888473:0:14152:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000cc470fc7/0xa2426164df2c8941 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783441644.888491:0:14152:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783441644.888493:0:14152:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783441644.888495:0:14152:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783441644.888861:0:14151:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1783441644.892380:0:14798:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x1a:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1783441644.892393:0:14798:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000e62c61d4/0xa2426164df2c8948 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783441644.892409:0:14798:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1a:0x0].0x0 since=482s v=(0 0) 00010000:00010000:1.0:1783441644.892413:0:14798:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1a:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1783441644.892420:0:14798:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000e62c61d4/0xa2426164df2c8948 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783441644.892434:0:14798:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000e62c61d4/0xa2426164df2c8948 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783441644.892444:0:14798:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000e62c61d4/0xa2426164df2c8948 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783441644.892450:0:14798:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000e62c61d4/0xa2426164df2c8948 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783441644.892467:0:14798:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1783441644.895307:0:14152:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1783441644.895323:0:14152:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000e62c61d4/0xa2426164df2c8948 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783441644.895337:0:14152:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91a87da47200 already unused, calling callback (ffffffffc155ff90) 00010000:00010000:0.0:1783441644.895342:0:14152:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000e62c61d4/0xa2426164df2c8948 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783441644.895366:0:14152:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000e62c61d4/0xa2426164df2c8948 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783441644.895391:0:14152:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000e62c61d4/0xa2426164df2c8948 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783441644.895399:0:14152:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000e62c61d4/0xa2426164df2c8948 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783441644.895420:0:14152:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783441644.895422:0:14152:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783441644.895424:0:14152:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1783441644.909261:0:14798:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x19:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1783441644.909276:0:14798:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000004c53ebee/0xa2426164df2c894f lrc: 3/0,1 mode: --/PW res: [0x240000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783441644.909294:0:14798:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x19:0x0].0x0 since=482s v=(0 0) 00010000:00010000:1.0:1783441644.909305:0:14798:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x19:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1783441644.909312:0:14798:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000004c53ebee/0xa2426164df2c894f lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783441644.909326:0:14798:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000004c53ebee/0xa2426164df2c894f lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783441644.909336:0:14798:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000004c53ebee/0xa2426164df2c894f lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783441644.909343:0:14798:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000004c53ebee/0xa2426164df2c894f lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783441644.909365:0:14798:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1783441644.909378:0:14151:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1783441644.909383:0:14151:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000004c53ebee/0xa2426164df2c894f lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783441644.909391:0:14151:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91a87da46a00 already unused, calling callback (ffffffffc155ff90) 00010000:00010000:1.0:1783441644.909395:0:14151:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000004c53ebee/0xa2426164df2c894f lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783441644.909404:0:14151:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000004c53ebee/0xa2426164df2c894f lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783441644.909421:0:14151:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000004c53ebee/0xa2426164df2c894f lrc: 1/0,0 mode: --/PW res: [0x240000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783441644.909440:0:14151:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000004c53ebee/0xa2426164df2c894f lrc: 0/0,0 mode: --/PW res: [0x240000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783441644.909459:0:14151:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783441644.909461:0:14151:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783441644.909463:0:14151:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1783441644.910049:0:14798:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x18:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1783441644.910055:0:14798:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000725429ac/0xa2426164df2c8956 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783441644.910064:0:14798:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x18:0x0].0x0 since=482s v=(0 0) 00010000:00010000:1.0:1783441644.910067:0:14798:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x18:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1783441644.910072:0:14798:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000725429ac/0xa2426164df2c8956 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783441644.910081:0:14798:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000725429ac/0xa2426164df2c8956 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783441644.910089:0:14798:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000725429ac/0xa2426164df2c8956 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783441644.910095:0:14798:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000725429ac/0xa2426164df2c8956 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783441644.910111:0:14798:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1783441644.910120:0:14152:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1783441644.910129:0:14152:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000725429ac/0xa2426164df2c8956 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783441644.910135:0:14152:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91a87da47c00 already unused, calling callback (ffffffffc155ff90) 00010000:00010000:1.0:1783441644.910139:0:14152:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000725429ac/0xa2426164df2c8956 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783441644.910146:0:14152:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000725429ac/0xa2426164df2c8956 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783441644.910158:0:14152:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000725429ac/0xa2426164df2c8956 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783441644.910165:0:14152:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000725429ac/0xa2426164df2c8956 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783441644.910180:0:14152:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783441644.910182:0:14152:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783441644.910183:0:14152:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1783441644.910570:0:14798:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x17:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1783441644.910578:0:14798:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000007c7c5344/0xa2426164df2c895d lrc: 3/0,1 mode: --/PW res: [0x240000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783441644.910586:0:14798:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x17:0x0].0x0 since=482s v=(0 0) 00010000:00010000:1.0:1783441644.910590:0:14798:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x17:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1783441644.910594:0:14798:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000007c7c5344/0xa2426164df2c895d lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783441644.910615:0:14798:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000007c7c5344/0xa2426164df2c895d lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783441644.910623:0:14798:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000007c7c5344/0xa2426164df2c895d lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783441644.910631:0:14798:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000007c7c5344/0xa2426164df2c895d lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783441644.910645:0:14798:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1783441644.910654:0:14151:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1783441644.910658:0:14151:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000007c7c5344/0xa2426164df2c895d lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783441644.910665:0:14151:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91a87da47e00 already unused, calling callback (ffffffffc155ff90) 00010000:00010000:1.0:1783441644.910668:0:14151:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000007c7c5344/0xa2426164df2c895d lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783441644.910676:0:14151:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000007c7c5344/0xa2426164df2c895d lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783441644.910687:0:14151:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000007c7c5344/0xa2426164df2c895d lrc: 1/0,0 mode: --/PW res: [0x240000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783441644.910694:0:14151:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000007c7c5344/0xa2426164df2c895d lrc: 0/0,0 mode: --/PW res: [0x240000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783441644.910714:0:14151:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783441644.910716:0:14151:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783441644.910717:0:14151:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1783441644.915559:0:14798:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x16:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1783441644.915572:0:14798:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000961b26f4/0xa2426164df2c8964 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783441644.915589:0:14798:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x16:0x0].0x0 since=482s v=(0 0) 00010000:00010000:1.0:1783441644.915594:0:14798:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x16:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1783441644.915600:0:14798:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000961b26f4/0xa2426164df2c8964 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783441644.915615:0:14798:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000961b26f4/0xa2426164df2c8964 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783441644.915625:0:14798:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000961b26f4/0xa2426164df2c8964 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783441644.915633:0:14798:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000961b26f4/0xa2426164df2c8964 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783441644.915665:0:14798:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1783441644.916090:0:14152:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1783441644.916098:0:14152:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000961b26f4/0xa2426164df2c8964 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783441644.916107:0:14152:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91a87da46c00 already unused, calling callback (ffffffffc155ff90) 00010000:00010000:0.0:1783441644.916112:0:14152:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000961b26f4/0xa2426164df2c8964 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783441644.916121:0:14152:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000961b26f4/0xa2426164df2c8964 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783441644.916139:0:14152:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000961b26f4/0xa2426164df2c8964 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783441644.916159:0:14152:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000961b26f4/0xa2426164df2c8964 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783441644.916181:0:14152:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783441644.916184:0:14152:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783441644.916185:0:14152:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1783441644.916556:0:14798:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x15:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1783441644.916562:0:14798:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000006a8a89ea/0xa2426164df2c896b lrc: 3/0,1 mode: --/PW res: [0x240000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783441644.916582:0:14798:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x15:0x0].0x0 since=482s v=(0 0) 00010000:00010000:1.0:1783441644.916586:0:14798:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x15:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1783441644.916591:0:14798:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000006a8a89ea/0xa2426164df2c896b lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783441644.916600:0:14798:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000006a8a89ea/0xa2426164df2c896b lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783441644.916609:0:14798:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000006a8a89ea/0xa2426164df2c896b lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783441644.916616:0:14798:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000006a8a89ea/0xa2426164df2c896b lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783441644.916638:0:14798:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1783441644.916841:0:14151:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1783441644.916846:0:14151:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000006a8a89ea/0xa2426164df2c896b lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783441644.916853:0:14151:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91a87da46200 already unused, calling callback (ffffffffc155ff90) 00010000:00010000:0.0:1783441644.916857:0:14151:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000006a8a89ea/0xa2426164df2c896b lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783441644.916864:0:14151:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000006a8a89ea/0xa2426164df2c896b lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783441644.916876:0:14151:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000006a8a89ea/0xa2426164df2c896b lrc: 1/0,0 mode: --/PW res: [0x240000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783441644.916883:0:14151:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000006a8a89ea/0xa2426164df2c896b lrc: 0/0,0 mode: --/PW res: [0x240000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783441644.916895:0:14151:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783441644.916896:0:14151:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783441644.916898:0:14151:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1783441644.917305:0:14798:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x14:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1783441644.917312:0:14798:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000e62c61d4/0xa2426164df2c8972 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783441644.917321:0:14798:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x14:0x0].0x0 since=482s v=(0 0) 00010000:00010000:1.0:1783441644.917325:0:14798:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x14:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1783441644.917329:0:14798:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000e62c61d4/0xa2426164df2c8972 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783441644.917339:0:14798:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000e62c61d4/0xa2426164df2c8972 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783441644.917359:0:14798:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000e62c61d4/0xa2426164df2c8972 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783441644.917366:0:14798:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000e62c61d4/0xa2426164df2c8972 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783441644.917420:0:14798:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:1.0:1783441644.917917:0:14798:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x13:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1783441644.917923:0:14798:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000f65f79b8/0xa2426164df2c8979 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783441644.917932:0:14798:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x13:0x0].0x0 since=482s v=(0 0) 00010000:00010000:1.0:1783441644.917936:0:14798:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x13:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1783441644.917940:0:14798:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000f65f79b8/0xa2426164df2c8979 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783441644.917950:0:14798:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000f65f79b8/0xa2426164df2c8979 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783441644.917957:0:14798:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000f65f79b8/0xa2426164df2c8979 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783441644.917963:0:14798:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000f65f79b8/0xa2426164df2c8979 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783441644.918644:0:14152:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1783441644.918653:0:14152:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000e62c61d4/0xa2426164df2c8972 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783441644.918662:0:14152:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91a87da47200 already unused, calling callback (ffffffffc155ff90) 00010000:00010000:0.0:1783441644.918667:0:14152:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000e62c61d4/0xa2426164df2c8972 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783441644.918675:0:14152:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000e62c61d4/0xa2426164df2c8972 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783441644.918690:0:14152:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000e62c61d4/0xa2426164df2c8972 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783441644.918696:0:14152:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000e62c61d4/0xa2426164df2c8972 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783441644.918717:0:14152:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1783441644.918721:0:14152:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000f65f79b8/0xa2426164df2c8979 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783441644.918737:0:14152:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91a87da46800 already unused, calling callback (ffffffffc155ff90) 00010000:00010000:0.0:1783441644.918756:0:14152:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000f65f79b8/0xa2426164df2c8979 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783441644.918763:0:14152:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000f65f79b8/0xa2426164df2c8979 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783441644.918788:0:14152:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000f65f79b8/0xa2426164df2c8979 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783441644.918796:0:14152:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783441644.918797:0:14152:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783441644.918808:0:14152:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783441644.925149:0:14798:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:1.0:1783441644.925163:0:14798:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000f65f79b8/0xa2426164df2c8979 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783441644.925198:0:14151:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1783441644.925916:0:14798:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x12:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1783441644.925924:0:14798:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000004c53ebee/0xa2426164df2c8980 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783441644.925938:0:14798:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x12:0x0].0x0 since=482s v=(0 0) 00010000:00010000:1.0:1783441644.925942:0:14798:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x12:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1783441644.925947:0:14798:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000004c53ebee/0xa2426164df2c8980 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783441644.925960:0:14798:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000004c53ebee/0xa2426164df2c8980 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783441644.925970:0:14798:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000004c53ebee/0xa2426164df2c8980 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783441644.925977:0:14798:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000004c53ebee/0xa2426164df2c8980 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783441644.925996:0:14798:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1783441644.926007:0:14152:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1783441644.926017:0:14152:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000004c53ebee/0xa2426164df2c8980 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783441644.926025:0:14152:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91a87da46a00 already unused, calling callback (ffffffffc155ff90) 00010000:00010000:1.0:1783441644.926029:0:14152:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000004c53ebee/0xa2426164df2c8980 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783441644.926038:0:14152:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000004c53ebee/0xa2426164df2c8980 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783441644.926053:0:14152:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000004c53ebee/0xa2426164df2c8980 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783441644.926060:0:14152:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000004c53ebee/0xa2426164df2c8980 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783441644.926076:0:14152:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783441644.926078:0:14152:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783441644.926080:0:14152:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1783441644.926461:0:14798:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x11:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1783441644.926467:0:14798:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000e625cedb/0xa2426164df2c8987 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783441644.926475:0:14798:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x11:0x0].0x0 since=482s v=(0 0) 00010000:00010000:1.0:1783441644.926478:0:14798:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x11:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1783441644.926482:0:14798:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000e625cedb/0xa2426164df2c8987 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783441644.926501:0:14798:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000e625cedb/0xa2426164df2c8987 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783441644.926509:0:14798:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000e625cedb/0xa2426164df2c8987 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783441644.926515:0:14798:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000e625cedb/0xa2426164df2c8987 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783441644.926527:0:14798:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1783441644.926536:0:14151:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1783441644.926540:0:14151:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000e625cedb/0xa2426164df2c8987 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783441644.926547:0:14151:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91a87da47a00 already unused, calling callback (ffffffffc155ff90) 00010000:00010000:1.0:1783441644.926550:0:14151:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000e625cedb/0xa2426164df2c8987 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783441644.926558:0:14151:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000e625cedb/0xa2426164df2c8987 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783441644.926569:0:14151:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000e625cedb/0xa2426164df2c8987 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783441644.926576:0:14151:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000e625cedb/0xa2426164df2c8987 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783441644.926597:0:14151:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783441644.926599:0:14151:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783441644.926600:0:14151:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1783441644.927039:0:14798:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x10:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1783441644.927044:0:14798:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000038612815/0xa2426164df2c898e lrc: 3/0,1 mode: --/PW res: [0x240000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783441644.927052:0:14798:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x10:0x0].0x0 since=482s v=(0 0) 00010000:00010000:1.0:1783441644.927055:0:14798:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x10:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1783441644.927059:0:14798:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000038612815/0xa2426164df2c898e lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783441644.927067:0:14798:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000038612815/0xa2426164df2c898e lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783441644.927074:0:14798:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000038612815/0xa2426164df2c898e lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783441644.927081:0:14798:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000038612815/0xa2426164df2c898e lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783441644.927096:0:14798:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1783441644.927103:0:14152:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1783441644.927107:0:14152:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000038612815/0xa2426164df2c898e lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783441644.927125:0:14152:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91a87da47600 already unused, calling callback (ffffffffc155ff90) 00010000:00010000:1.0:1783441644.927128:0:14152:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000038612815/0xa2426164df2c898e lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783441644.927136:0:14152:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000038612815/0xa2426164df2c898e lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783441644.927146:0:14152:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000038612815/0xa2426164df2c898e lrc: 1/0,0 mode: --/PW res: [0x240000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783441644.927153:0:14152:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000038612815/0xa2426164df2c898e lrc: 0/0,0 mode: --/PW res: [0x240000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783441644.927166:0:14152:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783441644.927168:0:14152:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783441644.927169:0:14152:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1783441644.927544:0:14798:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0xf:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1783441644.927551:0:14798:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000aa2f20f4/0xa2426164df2c8995 lrc: 3/0,1 mode: --/PW res: [0x240000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783441644.927559:0:14798:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xf:0x0].0x0 since=482s v=(0 0) 00010000:00010000:1.0:1783441644.927562:0:14798:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xf:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1783441644.927566:0:14798:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000aa2f20f4/0xa2426164df2c8995 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783441644.927574:0:14798:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000aa2f20f4/0xa2426164df2c8995 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783441644.927588:0:14798:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000aa2f20f4/0xa2426164df2c8995 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783441644.927594:0:14798:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000aa2f20f4/0xa2426164df2c8995 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783441644.927606:0:14798:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1783441644.927614:0:14151:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1783441644.927617:0:14151:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000aa2f20f4/0xa2426164df2c8995 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783441644.927624:0:14151:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91a87da46e00 already unused, calling callback (ffffffffc155ff90) 00010000:00010000:1.0:1783441644.927627:0:14151:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000aa2f20f4/0xa2426164df2c8995 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783441644.927635:0:14151:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000aa2f20f4/0xa2426164df2c8995 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783441644.927645:0:14151:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000aa2f20f4/0xa2426164df2c8995 lrc: 1/0,0 mode: --/PW res: [0x240000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783441644.927652:0:14151:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000aa2f20f4/0xa2426164df2c8995 lrc: 0/0,0 mode: --/PW res: [0x240000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783441644.927667:0:14151:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783441644.927674:0:14151:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783441644.927676:0:14151:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1783441644.928097:0:14798:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0xe:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1783441644.928103:0:14798:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000009aa69062/0xa2426164df2c899c lrc: 3/0,1 mode: --/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783441644.928110:0:14798:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xe:0x0].0x0 since=482s v=(0 0) 00010000:00010000:1.0:1783441644.928114:0:14798:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xe:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1783441644.928118:0:14798:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000009aa69062/0xa2426164df2c899c lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783441644.928127:0:14798:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000009aa69062/0xa2426164df2c899c lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783441644.928135:0:14798:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000009aa69062/0xa2426164df2c899c lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783441644.928142:0:14798:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000009aa69062/0xa2426164df2c899c lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783441644.928156:0:14798:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1783441644.928164:0:14152:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1783441644.928168:0:14152:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000009aa69062/0xa2426164df2c899c lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783441644.928175:0:14152:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91a87da47800 already unused, calling callback (ffffffffc155ff90) 00010000:00010000:1.0:1783441644.928178:0:14152:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000009aa69062/0xa2426164df2c899c lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783441644.928197:0:14152:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000009aa69062/0xa2426164df2c899c lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783441644.928208:0:14152:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000009aa69062/0xa2426164df2c899c lrc: 1/0,0 mode: --/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783441644.928215:0:14152:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000009aa69062/0xa2426164df2c899c lrc: 0/0,0 mode: --/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783441644.928229:0:14152:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783441644.928231:0:14152:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783441644.928233:0:14152:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1783441644.930502:0:14798:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0xd:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1783441644.930516:0:14798:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000007c7c5344/0xa2426164df2c89a3 lrc: 3/0,1 mode: --/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783441644.930532:0:14798:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xd:0x0].0x0 since=482s v=(0 0) 00010000:00010000:1.0:1783441644.930537:0:14798:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xd:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1783441644.930542:0:14798:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000007c7c5344/0xa2426164df2c89a3 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783441644.930554:0:14798:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000007c7c5344/0xa2426164df2c89a3 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783441644.930564:0:14798:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000007c7c5344/0xa2426164df2c89a3 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783441644.930584:0:14798:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000007c7c5344/0xa2426164df2c89a3 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783441644.930599:0:14798:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1783441644.930610:0:14151:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1783441644.930615:0:14151:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000007c7c5344/0xa2426164df2c89a3 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783441644.930623:0:14151:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91a87da47e00 already unused, calling callback (ffffffffc155ff90) 00010000:00010000:1.0:1783441644.930628:0:14151:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000007c7c5344/0xa2426164df2c89a3 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783441644.930636:0:14151:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000007c7c5344/0xa2426164df2c89a3 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783441644.930651:0:14151:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000007c7c5344/0xa2426164df2c89a3 lrc: 1/0,0 mode: --/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783441644.930658:0:14151:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000007c7c5344/0xa2426164df2c89a3 lrc: 0/0,0 mode: --/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783441644.930674:0:14151:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783441644.930675:0:14151:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783441644.930677:0:14151:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1783441644.937283:0:14798:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0xc:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1783441644.937306:0:14798:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000725429ac/0xa2426164df2c89aa lrc: 3/0,1 mode: --/PW res: [0x240000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783441644.937324:0:14798:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xc:0x0].0x0 since=482s v=(0 0) 00010000:00010000:1.0:1783441644.937329:0:14798:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xc:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1783441644.937335:0:14798:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000725429ac/0xa2426164df2c89aa lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783441644.937349:0:14798:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000725429ac/0xa2426164df2c89aa lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783441644.937360:0:14798:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000725429ac/0xa2426164df2c89aa lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783441644.937368:0:14798:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000725429ac/0xa2426164df2c89aa lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783441644.937391:0:14798:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1783441644.937404:0:14152:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1783441644.937409:0:14152:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000725429ac/0xa2426164df2c89aa lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783441644.937417:0:14152:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91a87da47c00 already unused, calling callback (ffffffffc155ff90) 00010000:00010000:1.0:1783441644.937422:0:14152:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000725429ac/0xa2426164df2c89aa lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783441644.937431:0:14152:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000725429ac/0xa2426164df2c89aa lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783441644.937456:0:14152:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000725429ac/0xa2426164df2c89aa lrc: 1/0,0 mode: --/PW res: [0x240000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783441644.937463:0:14152:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000725429ac/0xa2426164df2c89aa lrc: 0/0,0 mode: --/PW res: [0x240000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783441644.937488:0:14152:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783441644.937490:0:14152:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783441644.937492:0:14152:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1783441644.939508:0:14798:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0xb:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1783441644.939520:0:14798:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000f65f79b8/0xa2426164df2c89b1 lrc: 3/0,1 mode: --/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783441644.939537:0:14798:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xb:0x0].0x0 since=482s v=(0 0) 00010000:00010000:1.0:1783441644.939541:0:14798:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xb:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1783441644.939547:0:14798:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000f65f79b8/0xa2426164df2c89b1 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783441644.939560:0:14798:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000f65f79b8/0xa2426164df2c89b1 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783441644.939570:0:14798:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000f65f79b8/0xa2426164df2c89b1 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783441644.939578:0:14798:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000f65f79b8/0xa2426164df2c89b1 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783441644.939609:0:14798:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1783441644.939620:0:14151:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1783441644.939626:0:14151:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000f65f79b8/0xa2426164df2c89b1 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783441644.939634:0:14151:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91a87da46800 already unused, calling callback (ffffffffc155ff90) 00010000:00010000:1.0:1783441644.939638:0:14151:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000f65f79b8/0xa2426164df2c89b1 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783441644.939646:0:14151:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000f65f79b8/0xa2426164df2c89b1 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783441644.939660:0:14151:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000f65f79b8/0xa2426164df2c89b1 lrc: 1/0,0 mode: --/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783441644.939667:0:14151:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000f65f79b8/0xa2426164df2c89b1 lrc: 0/0,0 mode: --/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783441644.939685:0:14151:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783441644.939686:0:14151:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783441644.939688:0:14151:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1783441644.941423:0:14798:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0xa:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1783441644.941435:0:14798:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000f585b7da/0xa2426164df2c89b8 lrc: 3/0,1 mode: --/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783441644.941449:0:14798:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xa:0x0].0x0 since=482s v=(0 0) 00010000:00010000:1.0:1783441644.941459:0:14798:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xa:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1783441644.941465:0:14798:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000f585b7da/0xa2426164df2c89b8 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783441644.941476:0:14798:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000f585b7da/0xa2426164df2c89b8 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783441644.941486:0:14798:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000f585b7da/0xa2426164df2c89b8 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783441644.941494:0:14798:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000f585b7da/0xa2426164df2c89b8 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783441644.941515:0:14798:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1783441644.941529:0:14152:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1783441644.941535:0:14152:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000f585b7da/0xa2426164df2c89b8 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783441644.941542:0:14152:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91a87da46600 already unused, calling callback (ffffffffc155ff90) 00010000:00010000:1.0:1783441644.941546:0:14152:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000f585b7da/0xa2426164df2c89b8 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783441644.941555:0:14152:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000f585b7da/0xa2426164df2c89b8 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783441644.941570:0:14152:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000f585b7da/0xa2426164df2c89b8 lrc: 1/0,0 mode: --/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783441644.941589:0:14152:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000f585b7da/0xa2426164df2c89b8 lrc: 0/0,0 mode: --/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783441644.941608:0:14152:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783441644.941610:0:14152:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783441644.941612:0:14152:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1783441644.942134:0:14798:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x9:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1783441644.942140:0:14798:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000000615ae02/0xa2426164df2c89bf lrc: 3/0,1 mode: --/PW res: [0x240000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783441644.942149:0:14798:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x9:0x0].0x0 since=482s v=(0 0) 00010000:00010000:1.0:1783441644.942153:0:14798:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x9:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1783441644.942158:0:14798:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000000615ae02/0xa2426164df2c89bf lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783441644.942166:0:14798:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000000615ae02/0xa2426164df2c89bf lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783441644.942174:0:14798:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000000615ae02/0xa2426164df2c89bf lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783441644.942181:0:14798:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000000615ae02/0xa2426164df2c89bf lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783441644.942196:0:14798:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1783441644.942205:0:14151:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1783441644.942216:0:14151:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000000615ae02/0xa2426164df2c89bf lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783441644.942224:0:14151:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91a87da47000 already unused, calling callback (ffffffffc155ff90) 00010000:00010000:1.0:1783441644.942227:0:14151:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000000615ae02/0xa2426164df2c89bf lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783441644.942234:0:14151:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000000615ae02/0xa2426164df2c89bf lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783441644.942246:0:14151:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000000615ae02/0xa2426164df2c89bf lrc: 1/0,0 mode: --/PW res: [0x240000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783441644.942253:0:14151:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000000615ae02/0xa2426164df2c89bf lrc: 0/0,0 mode: --/PW res: [0x240000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783441644.942269:0:14151:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783441644.942272:0:14151:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783441644.942273:0:14151:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1783441644.942667:0:14798:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x8:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1783441644.942673:0:14798:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000e62c61d4/0xa2426164df2c89c6 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783441644.942681:0:14798:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x8:0x0].0x0 since=482s v=(0 0) 00010000:00010000:1.0:1783441644.942684:0:14798:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x8:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1783441644.942687:0:14798:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000e62c61d4/0xa2426164df2c89c6 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783441644.942706:0:14798:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000e62c61d4/0xa2426164df2c89c6 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783441644.942713:0:14798:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000e62c61d4/0xa2426164df2c89c6 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783441644.942719:0:14798:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000e62c61d4/0xa2426164df2c89c6 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783441644.944855:0:14798:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1783441644.944881:0:14152:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1783441644.944890:0:14152:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000e62c61d4/0xa2426164df2c89c6 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783441644.944905:0:14152:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91a87da47200 already unused, calling callback (ffffffffc155ff90) 00010000:00010000:1.0:1783441644.944909:0:14152:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000e62c61d4/0xa2426164df2c89c6 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783441644.944920:0:14152:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000e62c61d4/0xa2426164df2c89c6 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783441644.944939:0:14152:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000e62c61d4/0xa2426164df2c89c6 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783441644.944947:0:14152:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000e62c61d4/0xa2426164df2c89c6 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783441644.944981:0:14152:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783441644.944983:0:14152:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783441644.944985:0:14152:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1783441644.945579:0:14798:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x7:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1783441644.945587:0:14798:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000006a8a89ea/0xa2426164df2c89cd lrc: 3/0,1 mode: --/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783441644.945598:0:14798:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x7:0x0].0x0 since=482s v=(0 0) 00010000:00010000:1.0:1783441644.945603:0:14798:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x7:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1783441644.945608:0:14798:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000006a8a89ea/0xa2426164df2c89cd lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783441644.945618:0:14798:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000006a8a89ea/0xa2426164df2c89cd lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783441644.945627:0:14798:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000006a8a89ea/0xa2426164df2c89cd lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783441644.945634:0:14798:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000006a8a89ea/0xa2426164df2c89cd lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783441644.945652:0:14798:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1783441644.945661:0:14151:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1783441644.945665:0:14151:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000006a8a89ea/0xa2426164df2c89cd lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783441644.945683:0:14151:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91a87da46200 already unused, calling callback (ffffffffc155ff90) 00010000:00010000:1.0:1783441644.945687:0:14151:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000006a8a89ea/0xa2426164df2c89cd lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783441644.945695:0:14151:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000006a8a89ea/0xa2426164df2c89cd lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783441644.945706:0:14151:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000006a8a89ea/0xa2426164df2c89cd lrc: 1/0,0 mode: --/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783441644.945712:0:14151:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000006a8a89ea/0xa2426164df2c89cd lrc: 0/0,0 mode: --/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783441644.949954:0:14151:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783441644.949962:0:14151:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783441644.949965:0:14151:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00080000:1.0:1783441644.950340:0:14798:0:(ofd_dev.c:1518:ofd_orphans_destroy()) lustre-OST0000: after destroy: set last_id to 0x240000400:6 00000100:00100000:1.0:1783441644.950444:0:14798:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a877fad880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:14185:x1870073693309568:12345-0@lo:5:osp-pre-0-0.0 Request processed in 97807us (97862us total) trans 0 rc 0/0 00000100:00100000:1.0:1783441644.950458:0:14798:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1783441644.950513:0:14185:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff91a877faea00 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:14185:1870073693309568:0@lo:5:osp-pre-0-0.0 00000004:00080000:1.0:1783441644.950527:0:14185:0:(osp_precreate.c:960:osp_precreate_cleanup_orphans()) lustre-OST0000-osc-MDT0000: Got last_id [0x240000400:0x21:0x0] from OST, last_created [0x240000400:0x21:0x0]last_used is [0x240000400:0x6:0x0] 00000100:00100000:1.0:1783441644.950573:0:14185:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff91a745551880 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:14185:1870073693309696:0@lo:5:osp-pre-0-0.0 00000100:00100000:1.0:1783441644.950606:0:14185:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783441644.950654:0:14185:0:(client.c:2702:ptlrpc_set_wait()) set ffff91a8486289c0 going to sleep for 11 seconds 00000100:00100000:1.0:1783441644.950676:0:14799:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073693309696 00000100:00100000:1.0:1783441644.950682:0:14799:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073693309696 00000100:00100000:1.0:1783441644.950719:0:14799:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000004:00080000:3.0:1783441644.952833:0:5807:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1 committed 00000100:00100000:1.0:1783441644.952985:0:14799:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a745552d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:14185:x1870073693309696:12345-0@lo:5:osp-pre-0-0.0 00002000:00080000:1.0:1783441644.953037:0:14799:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0000: reserve 32 objects in group 0x240000400 at 34 00000100:00100000:1.0:1783441644.967659:0:14799:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a745552d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+7:14185:x1870073693309696:12345-0@lo:5:osp-pre-0-0.0 Request processed in 16925us (17045us total) trans 8589934593 rc 0/0 00000100:00100000:1.0:1783441644.967673:0:14799:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1783441644.969347:0:14185:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff91a745551880 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:14185:1870073693309696:0@lo:5:osp-pre-0-0.0 00000004:00080000:1.0:1783441644.969368:0:14185:0:(osp_precreate.c:705:osp_precreate_send()) lustre-OST0000-osc-MDT0000: current precreated pool: [0x240000400:0x21:0x0]-[0x240000400:0x41:0x0] 00010000:00010000:1.0:1783441645.421979:0:14152:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783441646.445086:0:14151:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:0.0:1783441646.561348:0:15467:0:(obd_mount.c:923:lmd_print()) mount data: 00000020:01000004:0.0:1783441646.561353:0:15467:0:(obd_mount.c:926:lmd_print()) device: lustre-ost2/ost2 00000080:01200004:0.0:1783441646.561589:0:15467:0:(super25.c:130:lustre_fill_super()) VFS Op: sb ffff91a843888000 00000020:01000004:0.0:1783441646.561607:0:15467:0:(tgt_mount.c:2501:osd_start()) Attempting to start lustre-OST0001, type=osd-zfs, lsifl=200002, mountfl=0 00000020:01000004:0.0:1783441646.561620:0:15467:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-OST0001-osd (typ=osd-zfs) 00000020:00000080:0.0:1783441646.561632:0:15467:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001-osd (ffff91a87cf899c0) 00000020:00000080:0.0:1783441646.561648:0:15467:0:(obd_config.c:720:class_attach_name()) OBD: dev 15 attached type osd-zfs with refcount 2 00100000:10000000:1.0:1783441646.608564:0:15467:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0001: refresh OI map for scrub, op 1, force yes, [0x200000007:0x1:0x0] => 0 (ROOT): rc = 1 00100000:10000000:1.0:1783441646.610770:0:15467:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-OST0001: registered index [0x200000001:0x3:0x0] (8/24) 00100000:10000000:1.0:1783441646.612039:0:15467:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0001: refresh OI map for scrub, op 1, force yes, [0x200000009:0x0:0x0] => 0 (update_log): rc = 1 00100000:10000000:1.0:1783441646.613235:0:15467:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0001: refresh OI map for scrub, op 1, force yes, [0x20000000a:0x0:0x0] => 0 (update_log_dir): rc = 1 00100000:10000000:1.0:1783441646.613496:0:15467:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-OST0001: registered index [0x200000003:0x3:0x0] (8/32) 00100000:10000000:2.0:1783441646.622184:0:15467:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0001: initial OI scrub handled lustre-client under 405: rc = 0 00100000:10000000:2.0:1783441646.624439:0:15467:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0001: initial OI scrub handled lustre-OST0001 under 405: rc = 0 00100000:10000000:2.0:1783441646.625038:0:15467:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0001: initial OI scrub handled params under 405: rc = 0 00100000:10000000:2.0:1783441646.627048:0:15467:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0001: initial OI scrub handled 0x1020000-OST0001 under 768: rc = 0 00100000:10000000:2.0:1783441646.628081:0:15467:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0001: initial OI scrub handled 0x1020000 under 768: rc = 0 00100000:10000000:2.0:1783441646.629168:0:15467:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0001: initial OI scrub handled 0x20000 under 768: rc = 0 00100000:10000000:2.0:1783441646.630164:0:15467:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0001: initial OI scrub handled 0x2020000 under 768: rc = 0 00100000:10000000:2.0:1783441646.630504:0:15467:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0001: initial OI scrub handled 0x2020000-OST0001 under 768: rc = 0 00100000:10000000:2.0:1783441646.631070:0:15467:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0001: initial OI scrub handled 0x20000-OST0001 under 768: rc = 0 00000020:00000080:2.0:1783441646.638269:0:15467:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001-osd (uuid lustre-OST0001-osd_UUID) 00080000:01000000:2.0:1783441646.638286:0:15467:0:(osd_handler.c:1569:osd_obd_connect()) connect #0 00000020:00000080:2.0:1783441646.638298:0:15467:0:(genops.c:1406:class_connect()) connect: client lustre-OST0001-osd_UUID, cookie 0xa2426164df2c89db 00000020:01000004:2.0:1783441646.638307:0:15467:0:(tgt_mount.c:2586:server_fill_super()) Found service lustre-OST0001 on device lustre-ost2/ost2 00000020:01000004:2.0:1783441646.638330:0:15467:0:(obd_mount.c:403:lustre_start_mgc()) MGC192.168.201.113@tcp:Set MGC reconnect 1 10000000:01000000:2.0:1783441646.638334:0:15467:0:(mgc_request.c:1071:mgc_set_info_async()) InitRecov MGC192.168.201.113@tcp 1/d0:i0:r0:or0:FULL 00000020:01000004:2.0:1783441646.638342:0:15467:0:(tgt_mount.c:1810:server_start_targets()) starting target lustre-OST0001 00000020:01000004:2.0:1783441646.638364:0:15467:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for lustre-ost2/ost2 10000000:01000000:2.0:1783441646.638368:0:15467:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.201.113@tcp: cl_mgc_mutex lustre-OST0001-osd for locked: rc = 0 00000040:01000000:2.0:1783441646.666716:0:15467:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.201.113@tcp ctxt 0 is initialized 00000020:01000004:2.0:1783441646.667632:0:15467:0:(tgt_mount.c:1418:server_register_target()) Registration lustre-OST0001, fs=lustre, 192.168.201.113@tcp, index=0001, flags=0x20002 00000020:01000004:2.0:1783441646.667640:0:15467:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:2.0:1783441646.667642:0:15467:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:2.0:1783441646.667643:0:15467:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1783441646.667644:0:15467:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1783441646.667646:0:15467:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1783441646.667647:0:15467:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1783441646.667649:0:15467:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1783441646.667651:0:15467:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1783441646.667652:0:15467:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:2.0:1783441646.667657:0:15467:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0001 0x10020002 00000020:01000004:2.0:1783441646.667659:0:15467:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:2.0:1783441646.667661:0:15467:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:2.0:1783441646.667662:0:15467:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1783441646.667663:0:15467:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1783441646.667664:0:15467:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1783441646.667666:0:15467:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1783441646.667667:0:15467:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1783441646.667668:0:15467:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1783441646.667669:0:15467:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:2.0:1783441646.667700:0:15467:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0001 00000100:00100000:2.0:1783441646.667722:0:15467:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff91a859085f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:94394728-4014-4ef0-b525-989290f008aa:15467:1870073693309824:0@lo:253:mount.lustre.0 00000100:00100000:2.0:1783441646.667957:0:15467:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783441646.668096:0:15467:0:(client.c:2702:ptlrpc_set_wait()) set ffff91a846f7c300 going to sleep for 11 seconds 00000100:00100000:3.0:1783441646.675354:0:14155:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073693309824 00000100:00100000:3.0:1783441646.675368:0:14155:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073693309824 00000100:00100000:3.0:1783441646.675447:0:14155:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 54 00000100:00100000:3.0:1783441646.675458:0:14155:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a874be8050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:94394728-4014-4ef0-b525-989290f008aa+16:15467:x1870073693309824:12345-0@lo:253:mount.lustre.0 20000000:01000000:3.0:1783441646.675498:0:14155:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 1 is registered to MGS. 20000000:01000000:3.0:1783441646.675502:0:14155:0:(mgs_handler.c:529:mgs_target_reg()) Server lustre-OST0001 is running on 0@lo 20000000:01000000:3.0:1783441646.675506:0:14155:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0001, index=1, rc=0 00000100:00100000:2.0:1783441646.707477:0:14155:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a874be8050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:94394728-4014-4ef0-b525-989290f008aa+16:15467:x1870073693309824:12345-0@lo:253:mount.lustre.0 Request processed in 32011us (39510us total) trans 0 rc 0/0 00000100:00100000:2.0:1783441646.707493:0:14155:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 54 00000100:00100000:0.0:1783441646.707572:0:15467:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff91a859085f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:94394728-4014-4ef0-b525-989290f008aa:15467:1870073693309824:0@lo:253:mount.lustre.0 10000000:01000000:0.0:1783441646.707589:0:15467:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0001 got index = 1 00000020:01000004:0.0:1783441646.707592:0:15467:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:0.0:1783441646.707594:0:15467:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:0.0:1783441646.707595:0:15467:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1783441646.707596:0:15467:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1783441646.707598:0:15467:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1783441646.707599:0:15467:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1783441646.707601:0:15467:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:0.0:1783441646.707603:0:15467:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1783441646.707605:0:15467:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:0.0:1783441646.707625:0:15467:0:(tgt_mount.c:101:server_register_mount()) register mount ffff91a843888000 from lustre-OST0001 10000000:01000000:0.0:1783441646.707659:0:15467:0:(mgc_request.c:1943:mgc_process_config()) parse_log lustre-OST0001 from 0 10000000:01000000:0.0:1783441646.707663:0:15467:0:(mgc_request.c:329:config_log_add()) add config log lustre-OST0001-0000000000000000 10000000:01000000:0.0:1783441646.707671:0:15467:0:(mgc_request_server.c:874:mgc_get_local_copy()) Get log lustre-sptlrpc-ffff91a744388000 local copy 00010000:00010000:0.0:1783441646.707680:0:15467:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.113@tcp lock: ffff91a841476400/0xa2426164df2c8788 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xa2426164df2c878f expref: -99 pid: 14145 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783441646.708995:0:15467:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff91a877fadf80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:94394728-4014-4ef0-b525-989290f008aa:15467:1870073693309952:0@lo:501:mount.lustre.0 00000100:00100000:0.0:1783441646.709056:0:15467:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783441646.709109:0:15467:0:(client.c:2702:ptlrpc_set_wait()) set ffff91a848e410c0 going to sleep for 11 seconds 00000100:00100000:2.0:1783441646.709217:0:14157:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073693309952 00000100:00100000:2.0:1783441646.709225:0:14157:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073693309952 00000100:00100000:2.0:1783441646.709367:0:14157:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 55 00000100:00100000:2.0:1783441646.709376:0:14157:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a874beb850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:94394728-4014-4ef0-b525-989290f008aa+16:15467:x1870073693309952:12345-0@lo:501:mount.lustre.0 00000100:00100000:2.0:1783441646.710300:0:14157:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a874beb850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:94394728-4014-4ef0-b525-989290f008aa+16:15467:x1870073693309952:12345-0@lo:501:mount.lustre.0 Request processed in 920us (1239us total) trans 0 rc -2/-2 00000100:00100000:2.0:1783441646.710311:0:14157:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 55 00000100:00100000:1.0:1783441646.714180:0:15467:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff91a877fadf80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:94394728-4014-4ef0-b525-989290f008aa:15467:1870073693309952:0@lo:501:mount.lustre.0 10000000:01000000:1.0:1783441646.714215:0:15467:0:(mgc_request_server.c:765:mgc_llog_local_copy()) MGC192.168.201.113@tcp: no remote llog for lustre-sptlrpc, check MGS config 10000000:01000000:1.0:1783441646.716181:0:15467:0:(mgc_request_server.c:897:mgc_get_local_copy()) MGC192.168.201.113@tcp: can't save local copy of 'lustre-sptlrpc': rc = -2. 00010000:00010000:1.0:1783441646.716198:0:15467:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.113@tcp lock: ffff91a841476400/0xa2426164df2c8788 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xa2426164df2c878f expref: -99 pid: 14145 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783441646.716209:0:15467:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.113@tcp lock: ffff91a841476400/0xa2426164df2c8788 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xa2426164df2c878f expref: -99 pid: 14145 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1783441646.716375:0:15467:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff91a843888000 10000000:01000000:1.0:1783441646.716381:0:15467:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:1.0:1783441646.716388:0:15467:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-OST0001-0000000000000000 10000000:01000000:1.0:1783441646.716391:0:15467:0:(mgc_request.c:68:mgc_name2resid()) log lustre-OST0001 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:1.0:1783441646.716395:0:15467:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-OST0001-0000000000000000 from 1 10000000:01000000:1.0:1783441646.716575:0:15467:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0001 (res 0x65727473756c) 00010000:00010000:1.0:1783441646.717243:0:15467:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.113@tcp lock: ffff91a87da47c00/0xa2426164df2c89e2 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 15467 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783441646.717256:0:15467:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.113@tcp lock: ffff91a87da47c00/0xa2426164df2c89e2 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 15467 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783441646.717505:0:15467:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.113@tcp lock: ffff91a87da47c00/0xa2426164df2c89e2 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 15467 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783441646.717687:0:15467:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff91a745552a00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:94394728-4014-4ef0-b525-989290f008aa:15467:1870073693310080:0@lo:101:mount.lustre.0 00000100:00100000:1.0:1783441646.718174:0:15467:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783441646.718226:0:15467:0:(client.c:2702:ptlrpc_set_wait()) set ffff91a8428ace40 going to sleep for 11 seconds 00000100:00100000:2.0:1783441646.718375:0:14155:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073693310080 00000100:00100000:2.0:1783441646.718384:0:14155:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073693310080 00000100:00100000:2.0:1783441646.719255:0:14155:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 56 00000100:00100000:2.0:1783441646.719551:0:14155:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a874bebc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:94394728-4014-4ef0-b525-989290f008aa+16:15467:x1870073693310080:12345-0@lo:101:mount.lustre.0 00010000:00010000:2.0:1783441646.719569:0:14155:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1783441646.719807:0:14155:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff91a85f83c200/0xa2426164df2c89e9 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0xa2426164df2c89e2 expref: -99 pid: 14155 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783441646.720089:0:14155:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff91a85f83c200/0xa2426164df2c89e9 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xa2426164df2c89e2 expref: 17 pid: 14155 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783441646.720176:0:14155:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff91a85f83c200/0xa2426164df2c89e9 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xa2426164df2c89e2 expref: 17 pid: 14155 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783441646.720186:0:14155:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91a85f83c200, rc 0) 00000100:00100000:2.0:1783441646.720363:0:14155:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a874bebc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:94394728-4014-4ef0-b525-989290f008aa+17:15467:x1870073693310080:12345-0@lo:101:mount.lustre.0 Request processed in 1097us (2258us total) trans 0 rc 0/0 00000100:00100000:2.0:1783441646.720395:0:14155:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 56 00000100:00100000:1.0:1783441646.720687:0:15467:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff91a745552a00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:94394728-4014-4ef0-b525-989290f008aa:15467:1870073693310080:0@lo:101:mount.lustre.0 00010000:00010000:1.0:1783441646.721249:0:15467:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.113@tcp lock: ffff91a87da47c00/0xa2426164df2c89e2 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0xa2426164df2c89e9 expref: -99 pid: 15467 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783441646.721262:0:15467:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.113@tcp lock: ffff91a87da47c00/0xa2426164df2c89e2 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0xa2426164df2c89e9 expref: -99 pid: 15467 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:0.0:1783441646.729368:0:15467:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 8 count 8 00000040:00080000:0.0:1783441646.737716:0:15467:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1783441646.739870:0:15467:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].1, 224 off8416 00000040:00080000:0.0:1783441646.739982:0:15467:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].2, 128 off8544 00000040:00080000:0.0:1783441646.741608:0:15467:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].3, 112 off8656 00000040:00080000:0.0:1783441646.741719:0:15467:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].4, 224 off8880 00000040:00080000:0.0:1783441646.741794:0:15467:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].5, 224 off9104 00000040:00080000:0.0:1783441646.741848:0:15467:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].6, 80 off9184 00000040:00080000:0.0:1783441646.741970:0:15467:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].7, 224 off9408 00000040:00080000:0.0:1783441646.741979:0:15467:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 7 count 8 00000100:00100000:0.0:1783441646.743928:0:15467:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff91a877fac380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:94394728-4014-4ef0-b525-989290f008aa:15467:1870073693310208:0@lo:501:mount.lustre.0 00000100:00100000:0.0:1783441646.744014:0:15467:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783441646.744071:0:15467:0:(client.c:2702:ptlrpc_set_wait()) set ffff91a848e410c0 going to sleep for 11 seconds 00000100:00100000:2.0:1783441646.744146:0:14156:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073693310208 00000100:00100000:2.0:1783441646.744155:0:14156:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073693310208 00000100:00100000:2.0:1783441646.744213:0:14156:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 57 00000100:00100000:2.0:1783441646.744223:0:14156:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a874be8850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:94394728-4014-4ef0-b525-989290f008aa+17:15467:x1870073693310208:12345-0@lo:501:mount.lustre.0 00000100:00100000:2.0:1783441646.745705:0:14156:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a874be8850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:94394728-4014-4ef0-b525-989290f008aa+17:15467:x1870073693310208:12345-0@lo:501:mount.lustre.0 Request processed in 1479us (1687us total) trans 0 rc 0/0 00000100:00100000:2.0:1783441646.745718:0:14156:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 57 00000100:00100000:0.0:1783441646.745783:0:15467:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff91a877fac380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:94394728-4014-4ef0-b525-989290f008aa:15467:1870073693310208:0@lo:501:mount.lustre.0 00000100:00100000:0.0:1783441646.745839:0:15467:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff91a877fac380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:94394728-4014-4ef0-b525-989290f008aa:15467:1870073693310336:0@lo:503:mount.lustre.0 00000100:00100000:0.0:1783441646.745894:0:15467:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783441646.745926:0:15467:0:(client.c:2702:ptlrpc_set_wait()) set ffff91a848e410c0 going to sleep for 11 seconds 00000100:00100000:2.0:1783441646.746667:0:14155:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073693310336 00000100:00100000:2.0:1783441646.746677:0:14155:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073693310336 00000100:00100000:2.0:1783441646.746728:0:14155:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 58 00000100:00100000:2.0:1783441646.746763:0:14155:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a874beb050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:94394728-4014-4ef0-b525-989290f008aa+17:15467:x1870073693310336:12345-0@lo:503:mount.lustre.0 00000100:00100000:2.0:1783441646.749530:0:14155:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a874beb050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:94394728-4014-4ef0-b525-989290f008aa+17:15467:x1870073693310336:12345-0@lo:503:mount.lustre.0 Request processed in 2774us (3616us total) trans 0 rc 0/0 00000100:00100000:2.0:1783441646.749545:0:14155:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 58 00000100:00100000:0.0:1783441646.750249:0:15467:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff91a877fac380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:94394728-4014-4ef0-b525-989290f008aa:15467:1870073693310336:0@lo:503:mount.lustre.0 00000040:00080000:1.0:1783441646.752966:0:15467:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:1.0:1783441646.753073:0:15467:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff91a745552a00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:94394728-4014-4ef0-b525-989290f008aa:15467:1870073693310464:0@lo:502:mount.lustre.0 00000100:00100000:1.0:1783441646.753437:0:15467:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783441646.753488:0:15467:0:(client.c:2702:ptlrpc_set_wait()) set ffff91a8428ace40 going to sleep for 11 seconds 00000100:00100000:2.0:1783441646.754326:0:14156:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073693310464 00000100:00100000:2.0:1783441646.754336:0:14156:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073693310464 00000100:00100000:2.0:1783441646.754401:0:14156:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 59 00000100:00100000:2.0:1783441646.754412:0:14156:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a874be8450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:94394728-4014-4ef0-b525-989290f008aa+17:15467:x1870073693310464:12345-0@lo:502:mount.lustre.0 00000100:00100000:2.0:1783441646.755370:0:14156:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a874be8450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:94394728-4014-4ef0-b525-989290f008aa+17:15467:x1870073693310464:12345-0@lo:502:mount.lustre.0 Request processed in 955us (1928us total) trans 0 rc 0/0 00000100:00100000:2.0:1783441646.755381:0:14156:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 59 00000100:00100000:1.0:1783441646.755646:0:15467:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff91a745552a00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:94394728-4014-4ef0-b525-989290f008aa:15467:1870073693310464:0@lo:502:mount.lustre.0 00000040:00080000:1.0:1783441646.756413:0:15467:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].1, 224 off8416 00000040:00080000:1.0:1783441646.757193:0:15467:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].2, 128 off8544 00000040:00080000:1.0:1783441646.757246:0:15467:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].3, 112 off8656 00000040:00080000:1.0:1783441646.760475:0:15467:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].4, 224 off8880 00000040:00080000:1.0:1783441646.760551:0:15467:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].5, 224 off9104 00000040:00080000:1.0:1783441646.760602:0:15467:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].6, 80 off9184 00000040:00080000:1.0:1783441646.760658:0:15467:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].7, 224 off9408 00000040:00080000:1.0:1783441646.760697:0:15467:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].8, 224 off9632 00000040:00080000:1.0:1783441646.760912:0:15467:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].9, 120 off9752 00000100:00100000:1.0:1783441646.761219:0:15467:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff91a745552a00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:94394728-4014-4ef0-b525-989290f008aa:15467:1870073693310592:0@lo:502:mount.lustre.0 00000100:00100000:1.0:1783441646.761311:0:15467:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783441646.761349:0:15467:0:(client.c:2702:ptlrpc_set_wait()) set ffff91a8428ace40 going to sleep for 11 seconds 00000100:00100000:2.0:1783441646.761503:0:14155:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073693310592 00000100:00100000:2.0:1783441646.761520:0:14155:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073693310592 00000100:00100000:2.0:1783441646.761575:0:14155:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 60 00000100:00100000:2.0:1783441646.761583:0:14155:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a874be9850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:94394728-4014-4ef0-b525-989290f008aa+17:15467:x1870073693310592:12345-0@lo:502:mount.lustre.0 00000100:00100000:2.0:1783441646.761850:0:14155:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a874be9850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:94394728-4014-4ef0-b525-989290f008aa+17:15467:x1870073693310592:12345-0@lo:502:mount.lustre.0 Request processed in 266us (538us total) trans 0 rc 0/0 00000100:00100000:2.0:1783441646.761858:0:14155:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 60 00000100:00100000:1.0:1783441646.762384:0:15467:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff91a745552a00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:94394728-4014-4ef0-b525-989290f008aa:15467:1870073693310592:0@lo:502:mount.lustre.0 00000040:00080000:1.0:1783441646.762481:0:15467:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].10, 224 off9976 00000040:00080000:1.0:1783441646.762494:0:15467:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x9:0x0] index 10 count 11 00000020:01000000:1.0:1783441646.765716:0:15469:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:1.0:1783441646.765730:0:15469:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0001 (1) in 0 of lustre-ost2/ost2 00000020:00000080:1.0:1783441646.765738:0:15469:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1783441646.765782:0:15469:0:(obd_config.c:1561:class_process_config()) marker 17 (0x1) lustre-OST0001 add ost 00000020:00000080:1.0:1783441646.765790:0:15469:0:(obd_config.c:1470:class_process_config()) processing cmd: cf001 00000020:00000080:1.0:1783441646.765805:0:15469:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001 (ffff91a746343380) 00000020:00000080:1.0:1783441646.766053:0:15469:0:(obd_config.c:720:class_attach_name()) OBD: dev 16 attached type obdfilter with refcount 2 00000020:00000080:1.0:1783441646.766061:0:15469:0:(obd_config.c:1470:class_process_config()) processing cmd: cf003 00000020:01000004:1.0:1783441646.766355:0:15469:0:(tgt_mount.c:153:server_get_mount()) get mount ffff91a843888000 from lustre-OST0001, refs=2 00080000:01000000:1.0:1783441646.766364:0:15469:0:(osd_handler.c:1569:osd_obd_connect()) connect #1 00000020:00000080:1.0:1783441646.766371:0:15469:0:(genops.c:1406:class_connect()) connect: client lustre-OST0001-osd_UUID, cookie 0xa2426164df2c89f7 00010000:00010000:1.0:1783441646.774376:0:15469:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-filter-lustre-OST0001_UUID-3 is initialized 00000001:00000004:1.0:1783441646.777413:0:15469:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 2, last_transno is 4294967310 00080000:10000000:2.0:1783441646.785586:0:15469:0:(osd_index.c:2102:osd_index_try()) lustre-OST0001: index object [0x200000003:0xb:0x0] (8/8/4) registered 00000020:00000080:2.0:1783441646.789592:0:15469:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001 (uuid lustre-OST0001_UUID) 00000020:01000000:2.0:1783441646.789606:0:15469:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1783441646.789614:0:15469:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1783441646.789616:0:15469:0:(obd_config.c:1561:class_process_config()) marker 17 (0x2) lustre-OST0001 add ost 00000020:01000000:2.0:1783441646.789621:0:15469:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1783441646.789625:0:15469:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1783441646.789627:0:15469:0:(obd_config.c:1561:class_process_config()) marker 23 (0x1) lustre sys.timeout 00000020:00000080:2.0:1783441646.789629:0:15469:0:(obd_config.c:1470:class_process_config()) processing cmd: cf009 00000020:00000080:2.0:1783441646.789631:0:15469:0:(obd_config.c:1535:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:2.0:1783441646.789633:0:15469:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1783441646.789635:0:15469:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1783441646.789636:0:15469:0:(obd_config.c:1561:class_process_config()) marker 23 (0x2) lustre sys.timeout 00000020:01000000:2.0:1783441646.789638:0:15469:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1783441646.789640:0:15469:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1783441646.789642:0:15469:0:(obd_config.c:1561:class_process_config()) marker 27 (0x1) lustre sys.jobid_var 00000020:00000080:2.0:1783441646.789646:0:15469:0:(obd_config.c:1470:class_process_config()) processing cmd: cf00f 00000020:01000000:2.0:1783441646.789718:0:15469:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1783441646.789722:0:15469:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1783441646.789723:0:15469:0:(obd_config.c:1561:class_process_config()) marker 27 (0x2) lustre sys.jobid_var 00000040:00080000:2.0:1783441646.789726:0:15469:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x6:0x0] index 11 count 11 00000020:01000000:0.0:1783441646.790487:0:15467:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0001 gen 1-10 (rc=0) 10000000:01000000:0.0:1783441646.790521:0:15467:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.201.113@tcp: configuration from log 'lustre-OST0001' succeeded (0). 00010000:00010000:0.0:1783441646.790549:0:15467:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.113@tcp lock: ffff91a87da47c00/0xa2426164df2c89e2 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0xa2426164df2c89e9 expref: -99 pid: 15467 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783441646.790594:0:15467:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.113@tcp lock: ffff91a87da47c00/0xa2426164df2c89e2 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0xa2426164df2c89e9 expref: -99 pid: 15467 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1783441646.790601:0:15467:0:(mgc_request.c:1801:mgc_process_log()) Process log params-ffff91a843888000 from 1 10000000:01000000:0.0:1783441646.790605:0:15467:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:0.0:1783441646.790652:0:15467:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.113@tcp lock: ffff91a85fe59400/0xa2426164df2c89fe lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 15467 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783441646.790660:0:15467:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.113@tcp lock: ffff91a85fe59400/0xa2426164df2c89fe lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 15467 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783441646.790683:0:15467:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.113@tcp lock: ffff91a85fe59400/0xa2426164df2c89fe lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 15467 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783441646.790709:0:15467:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff91a877fac380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:94394728-4014-4ef0-b525-989290f008aa:15467:1870073693310720:0@lo:101:mount.lustre.0 00000100:00100000:0.0:1783441646.791007:0:15467:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783441646.791070:0:15467:0:(client.c:2702:ptlrpc_set_wait()) set ffff91a844b19900 going to sleep for 11 seconds 00000100:00100000:1.0:1783441646.791353:0:14156:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073693310720 00000100:00100000:1.0:1783441646.791362:0:14156:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073693310720 00000100:00100000:1.0:1783441646.791425:0:14156:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 61 00000100:00100000:1.0:1783441646.791443:0:14156:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a874be9450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:94394728-4014-4ef0-b525-989290f008aa+17:15467:x1870073693310720:12345-0@lo:101:mount.lustre.0 00010000:00010000:1.0:1783441646.791459:0:14156:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1783441646.791475:0:14156:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff91a87da47e00/0xa2426164df2c8a05 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0xa2426164df2c89fe expref: -99 pid: 14156 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783441646.791502:0:14156:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff91a87da47e00/0xa2426164df2c8a05 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xa2426164df2c89fe expref: 18 pid: 14156 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783441646.791514:0:14156:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff91a87da47e00/0xa2426164df2c8a05 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xa2426164df2c89fe expref: 18 pid: 14156 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783441646.791524:0:14156:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91a87da47e00, rc 0) 00000100:00100000:1.0:1783441646.791565:0:14156:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a874be9450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:94394728-4014-4ef0-b525-989290f008aa+18:15467:x1870073693310720:12345-0@lo:101:mount.lustre.0 Request processed in 131us (559us total) trans 0 rc 0/0 00000100:00100000:1.0:1783441646.791573:0:14156:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 61 00000100:00100000:0.0:1783441646.792397:0:15467:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff91a877fac380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:94394728-4014-4ef0-b525-989290f008aa:15467:1870073693310720:0@lo:101:mount.lustre.0 00010000:00010000:0.0:1783441646.792419:0:15467:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.113@tcp lock: ffff91a85fe59400/0xa2426164df2c89fe lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xa2426164df2c8a05 expref: -99 pid: 15467 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783441646.792430:0:15467:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.113@tcp lock: ffff91a85fe59400/0xa2426164df2c89fe lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0xa2426164df2c8a05 expref: -99 pid: 15467 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:0.0:1783441646.793545:0:15467:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 4 count 4 00000040:00080000:0.0:1783441646.796606:0:15467:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1783441646.796987:0:15467:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].1, 224 off8416 00000040:00080000:0.0:1783441646.797735:0:15467:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].2, 112 off8528 00000040:00080000:0.0:1783441646.797908:0:15467:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].3, 224 off8752 00000040:00080000:0.0:1783441646.797919:0:15467:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 3 count 4 00000100:00100000:0.0:1783441646.798332:0:15467:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff91a877fac380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:94394728-4014-4ef0-b525-989290f008aa:15467:1870073693310848:0@lo:501:mount.lustre.0 00000100:00100000:0.0:1783441646.798401:0:15467:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783441646.798462:0:15467:0:(client.c:2702:ptlrpc_set_wait()) set ffff91a844b19900 going to sleep for 11 seconds 00000100:00100000:1.0:1783441646.798766:0:14157:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073693310848 00000100:00100000:1.0:1783441646.798785:0:14157:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073693310848 00000100:00100000:1.0:1783441646.798855:0:14157:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 62 00000100:00100000:1.0:1783441646.798865:0:14157:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a874beb450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:94394728-4014-4ef0-b525-989290f008aa+18:15467:x1870073693310848:12345-0@lo:501:mount.lustre.0 00000100:00100000:1.0:1783441646.799352:0:14157:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a874beb450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:94394728-4014-4ef0-b525-989290f008aa+18:15467:x1870073693310848:12345-0@lo:501:mount.lustre.0 Request processed in 488us (949us total) trans 0 rc 0/0 00000100:00100000:1.0:1783441646.799361:0:14157:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 62 00000100:00100000:0.0:1783441646.799593:0:15467:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff91a877fac380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:94394728-4014-4ef0-b525-989290f008aa:15467:1870073693310848:0@lo:501:mount.lustre.0 00000100:00100000:0.0:1783441646.799633:0:15467:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff91a877fac380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:94394728-4014-4ef0-b525-989290f008aa:15467:1870073693310976:0@lo:503:mount.lustre.0 00000100:00100000:0.0:1783441646.799679:0:15467:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783441646.799713:0:15467:0:(client.c:2702:ptlrpc_set_wait()) set ffff91a844b19900 going to sleep for 11 seconds 00000100:00100000:1.0:1783441646.799831:0:14155:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073693310976 00000100:00100000:1.0:1783441646.799836:0:14155:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073693310976 00000100:00100000:1.0:1783441646.799875:0:14155:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 63 00000100:00100000:1.0:1783441646.799882:0:14155:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a874bea450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:94394728-4014-4ef0-b525-989290f008aa+18:15467:x1870073693310976:12345-0@lo:503:mount.lustre.0 00000100:00100000:1.0:1783441646.800069:0:14155:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a874bea450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:94394728-4014-4ef0-b525-989290f008aa+18:15467:x1870073693310976:12345-0@lo:503:mount.lustre.0 Request processed in 186us (388us total) trans 0 rc 0/0 00000100:00100000:1.0:1783441646.800076:0:14155:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 63 00000100:00100000:3.0:1783441646.800308:0:15467:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff91a877fac380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:94394728-4014-4ef0-b525-989290f008aa:15467:1870073693310976:0@lo:503:mount.lustre.0 00000040:00080000:3.0:1783441646.801084:0:15467:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:3.0:1783441646.801551:0:15467:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff91a874dcc700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:94394728-4014-4ef0-b525-989290f008aa:15467:1870073693311104:0@lo:502:mount.lustre.0 00000100:00100000:3.0:1783441646.801618:0:15467:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783441646.801670:0:14156:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073693311104 00000100:00100000:3.0:1783441646.801676:0:14156:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073693311104 00000100:00100000:3.0:1783441646.802195:0:14156:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 64 00000100:00100000:3.0:1783441646.802207:0:14156:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a8492a2850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:94394728-4014-4ef0-b525-989290f008aa+18:15467:x1870073693311104:12345-0@lo:502:mount.lustre.0 00000100:00100000:3.0:1783441646.802962:0:14156:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a8492a2850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:94394728-4014-4ef0-b525-989290f008aa+18:15467:x1870073693311104:12345-0@lo:502:mount.lustre.0 Request processed in 754us (1340us total) trans 0 rc 0/0 00000100:00100000:3.0:1783441646.802971:0:14156:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 64 00000100:00100000:3.0:1783441646.803042:0:15467:0:(client.c:2702:ptlrpc_set_wait()) set ffff91a850680b40 going to sleep for 11 seconds 00000100:00100000:3.0:1783441646.803066:0:15467:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff91a874dcc700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:94394728-4014-4ef0-b525-989290f008aa:15467:1870073693311104:0@lo:502:mount.lustre.0 00000040:00080000:3.0:1783441646.803847:0:15467:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].1, 224 off8416 00000040:00080000:3.0:1783441646.803915:0:15467:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].2, 112 off8528 00000040:00080000:3.0:1783441646.804560:0:15467:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].3, 224 off8752 00000040:00080000:3.0:1783441646.804666:0:15467:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].4, 224 off8976 00000040:00080000:3.0:1783441646.804707:0:15467:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].5, 112 off9088 00000040:00080000:3.0:1783441646.804799:0:15467:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].6, 224 off9312 00000040:00080000:3.0:1783441646.805174:0:15467:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].7, 224 off9536 00000040:00080000:3.0:1783441646.805242:0:15467:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].8, 128 off9664 00000100:00100000:3.0:1783441646.805366:0:15467:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff91a874dcc700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:94394728-4014-4ef0-b525-989290f008aa:15467:1870073693311232:0@lo:502:mount.lustre.0 00000100:00100000:3.0:1783441646.807459:0:15467:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783441646.807516:0:15467:0:(client.c:2702:ptlrpc_set_wait()) set ffff91a850680b40 going to sleep for 11 seconds 00000100:00100000:0.0:1783441646.807780:0:14157:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073693311232 00000100:00100000:0.0:1783441646.807790:0:14157:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073693311232 00000100:00100000:0.0:1783441646.807859:0:14157:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 65 00000100:00100000:0.0:1783441646.807870:0:14157:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a8492a0c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:94394728-4014-4ef0-b525-989290f008aa+18:15467:x1870073693311232:12345-0@lo:502:mount.lustre.0 00000100:00100000:0.0:1783441646.808430:0:14157:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a8492a0c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:94394728-4014-4ef0-b525-989290f008aa+18:15467:x1870073693311232:12345-0@lo:502:mount.lustre.0 Request processed in 560us (973us total) trans 0 rc 0/0 00000100:00100000:1.0:1783441646.808561:0:15467:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff91a874dcc700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:94394728-4014-4ef0-b525-989290f008aa:15467:1870073693311232:0@lo:502:mount.lustre.0 00000040:00080000:1.0:1783441646.808724:0:15467:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].9, 224 off9888 00000040:00080000:1.0:1783441646.808764:0:15467:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 9 count 10 00000100:00100000:0.0:1783441646.809355:0:14157:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 65 00000020:01000000:0.0:1783441646.810803:0:15472:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1783441646.810826:0:15472:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1783441646.810829:0:15472:0:(obd_config.c:1561:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:0.0:1783441646.810836:0:15472:0:(obd_config.c:2005:class_config_llog_handler()) cmd ce032, instance name: general-ffff91a843888000 00000020:00000080:0.0:1783441646.810839:0:15472:0:(obd_config.c:1470:class_process_config()) processing cmd: ce032 00000020:01000000:0.0:1783441646.810845:0:15472:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1783441646.810848:0:15472:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1783441646.810849:0:15472:0:(obd_config.c:1561:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000020:01000000:0.0:1783441646.810851:0:15472:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1783441646.810852:0:15472:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1783441646.810853:0:15472:0:(obd_config.c:1561:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:0.0:1783441646.810856:0:15472:0:(obd_config.c:2005:class_config_llog_handler()) cmd ce032, instance name: general-ffff91a843888000 00000020:00000080:0.0:1783441646.810858:0:15472:0:(obd_config.c:1470:class_process_config()) processing cmd: ce032 00000020:01000000:0.0:1783441646.810909:0:15472:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1783441646.810912:0:15472:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1783441646.810913:0:15472:0:(obd_config.c:1561:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000020:01000000:0.0:1783441646.810915:0:15472:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1783441646.810918:0:15472:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1783441646.810919:0:15472:0:(obd_config.c:1561:class_process_config()) marker 4 (0x1) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:0.0:1783441646.810922:0:15472:0:(obd_config.c:2005:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff91a843888000 00000020:00000080:0.0:1783441646.812061:0:15472:0:(obd_config.c:1470:class_process_config()) processing cmd: ce032 00000020:01000000:0.0:1783441646.812541:0:15472:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1783441646.812546:0:15472:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1783441646.812548:0:15472:0:(obd_config.c:1561:class_process_config()) marker 4 (0x2) lustre mdt.lustre-MDT0000.hsm_control 00000040:00080000:0.0:1783441646.812553:0:15472:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 10 count 10 00000020:01000000:1.0:1783441646.813225:0:15467:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-9 (rc=0) 10000000:01000000:1.0:1783441646.813254:0:15467:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.201.113@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:1.0:1783441646.813567:0:15467:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.113@tcp lock: ffff91a85fe59400/0xa2426164df2c89fe lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xa2426164df2c8a05 expref: -99 pid: 15467 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783441646.813593:0:15467:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.113@tcp lock: ffff91a85fe59400/0xa2426164df2c89fe lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xa2426164df2c8a05 expref: -99 pid: 15467 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1783441646.813648:0:15467:0:(mgc_request.c:1943:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:1.0:1783441646.813652:0:15467:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff91a843888000 10000000:01000000:1.0:1783441646.813655:0:15467:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff91a843888000 10000000:01000000:1.0:1783441646.813659:0:15467:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:1.0:1783441646.813664:0:15467:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-client-ffff91a843888000 from 1 10000000:01000000:1.0:1783441646.813667:0:15467:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:1.0:1783441646.813703:0:15467:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.113@tcp lock: ffff91a87da47800/0xa2426164df2c8a0c lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 15467 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783441646.813713:0:15467:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.113@tcp lock: ffff91a87da47800/0xa2426164df2c8a0c lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 15467 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783441646.813725:0:15467:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.113@tcp lock: ffff91a87da47800/0xa2426164df2c8a0c lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 15467 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783441646.813825:0:15467:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff91a745552a00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:94394728-4014-4ef0-b525-989290f008aa:15467:1870073693311360:0@lo:101:mount.lustre.0 00000100:00100000:1.0:1783441646.813902:0:15467:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783441646.813955:0:15467:0:(client.c:2702:ptlrpc_set_wait()) set ffff91a843df40c0 going to sleep for 11 seconds 00000100:00100000:0.0:1783441646.814298:0:14155:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073693311360 00000100:00100000:0.0:1783441646.814305:0:14155:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073693311360 00000100:00100000:0.0:1783441646.814360:0:14155:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 66 00000100:00100000:0.0:1783441646.814371:0:14155:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a8492a0850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:94394728-4014-4ef0-b525-989290f008aa+18:15467:x1870073693311360:12345-0@lo:101:mount.lustre.0 00010000:00010000:0.0:1783441646.814385:0:14155:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1783441646.814399:0:14155:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff91a85fe59800/0xa2426164df2c8a13 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: local remote: 0xa2426164df2c8a0c expref: -99 pid: 14155 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783441646.814423:0:14155:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff91a85fe59800/0xa2426164df2c8a13 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xa2426164df2c8a0c expref: 19 pid: 14155 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783441646.814434:0:14155:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff91a85fe59800/0xa2426164df2c8a13 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xa2426164df2c8a0c expref: 19 pid: 14155 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783441646.814443:0:14155:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91a85fe59800, rc 0) 00000100:00100000:0.0:1783441646.814485:0:14155:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a8492a0850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:94394728-4014-4ef0-b525-989290f008aa+19:15467:x1870073693311360:12345-0@lo:101:mount.lustre.0 Request processed in 117us (584us total) trans 0 rc 0/0 00000100:00100000:0.0:1783441646.814492:0:14155:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 66 00000100:00100000:0.0:1783441646.814553:0:15467:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff91a745552a00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:94394728-4014-4ef0-b525-989290f008aa:15467:1870073693311360:0@lo:101:mount.lustre.0 00010000:00010000:0.0:1783441646.814576:0:15467:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.113@tcp lock: ffff91a87da47800/0xa2426164df2c8a0c lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0xa2426164df2c8a13 expref: -99 pid: 15467 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783441646.814586:0:15467:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.113@tcp lock: ffff91a87da47800/0xa2426164df2c8a0c lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0xa2426164df2c8a13 expref: -99 pid: 15467 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:0.0:1783441646.816563:0:15467:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 39 count 39 00000040:00080000:0.0:1783441646.817950:0:15467:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1783441646.819364:0:15467:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].1, 224 off8416 00000040:00080000:0.0:1783441646.819509:0:15467:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].2, 120 off8536 00000040:00080000:0.0:1783441646.819558:0:15467:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].3, 168 off8704 00000040:00080000:0.0:1783441646.820411:0:15467:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].4, 224 off8928 00000040:00080000:0.0:1783441646.823944:0:15467:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].5, 224 off9152 00000040:00080000:0.0:1783441646.824063:0:15467:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].6, 120 off9272 00000040:00080000:0.0:1783441646.824104:0:15467:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].7, 168 off9440 00000040:00080000:0.0:1783441646.824137:0:15467:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].8, 224 off9664 00000040:00080000:0.0:1783441646.824183:0:15467:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].9, 224 off9888 00000040:00080000:0.0:1783441646.824218:0:15467:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].10, 120 off10008 00000040:00080000:0.0:1783441646.824251:0:15467:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].11, 224 off10232 00000040:00080000:0.0:1783441646.824299:0:15467:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].12, 224 off10456 00000040:00080000:0.0:1783441646.824335:0:15467:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].13, 88 off10544 00000040:00080000:0.0:1783441646.824370:0:15467:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].14, 128 off10672 00000040:00080000:0.0:1783441646.824418:0:15467:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].15, 144 off10816 00000040:00080000:0.0:1783441646.824456:0:15467:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].16, 160 off10976 00000040:00080000:0.0:1783441646.824492:0:15467:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].17, 224 off11200 00000040:00080000:0.0:1783441646.824543:0:15467:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].18, 224 off11424 00000040:00080000:0.0:1783441646.824580:0:15467:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].19, 80 off11504 00000040:00080000:0.0:1783441646.824617:0:15467:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].20, 224 off11728 00000040:00080000:0.0:1783441646.824687:0:15467:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].21, 224 off11952 00000040:00080000:0.0:1783441646.824726:0:15467:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].22, 88 off12040 00000040:00080000:0.0:1783441646.828649:0:15467:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].23, 128 off12168 00000040:00080000:0.0:1783441646.828779:0:15467:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].24, 144 off12312 00000040:00080000:0.0:1783441646.828845:0:15467:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].25, 128 off12440 00000040:00080000:0.0:1783441646.828882:0:15467:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].26, 224 off12664 00000040:00080000:0.0:1783441646.828947:0:15467:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].27, 224 off12888 00000040:00080000:0.0:1783441646.828987:0:15467:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].28, 80 off12968 00000040:00080000:0.0:1783441646.829042:0:15467:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].29, 224 off13192 00000040:00080000:0.0:1783441646.829098:0:15467:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].30, 224 off13416 00000040:00080000:0.0:1783441646.829138:0:15467:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].31, 88 off13504 00000040:00080000:0.0:1783441646.829177:0:15467:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].32, 128 off13632 00000040:00080000:0.0:1783441646.829215:0:15467:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].33, 144 off13776 00000040:00080000:0.0:1783441646.829400:0:15467:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].34, 128 off13904 00000040:00080000:0.0:1783441646.829459:0:15467:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].35, 224 off14128 00000040:00080000:0.0:1783441646.829517:0:15467:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].36, 224 off14352 00000040:00080000:0.0:1783441646.829578:0:15467:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].37, 80 off14432 00000040:00080000:0.0:1783441646.829678:0:15467:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].38, 224 off14656 00000040:00080000:0.0:1783441646.829686:0:15467:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 38 count 39 00000100:00100000:0.0:1783441646.829845:0:15467:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff91a877faf100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:94394728-4014-4ef0-b525-989290f008aa:15467:1870073693311488:0@lo:501:mount.lustre.0 00000100:00100000:0.0:1783441646.829922:0:15467:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783441646.829987:0:15467:0:(client.c:2702:ptlrpc_set_wait()) set ffff91a844b19000 going to sleep for 11 seconds 00000100:00100000:0.0:1783441646.831500:0:14156:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073693311488 00000100:00100000:0.0:1783441646.831514:0:14156:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073693311488 00000100:00100000:0.0:1783441646.831574:0:14156:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 67 00000100:00100000:0.0:1783441646.831584:0:14156:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a8492a2450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:94394728-4014-4ef0-b525-989290f008aa+19:15467:x1870073693311488:12345-0@lo:501:mount.lustre.0 00000100:00100000:0.0:1783441646.835620:0:14156:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a8492a2450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:94394728-4014-4ef0-b525-989290f008aa+19:15467:x1870073693311488:12345-0@lo:501:mount.lustre.0 Request processed in 4027us (5687us total) trans 0 rc 0/0 00000100:00100000:0.0:1783441646.835635:0:14156:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 67 00000100:00100000:0.0:1783441646.835726:0:15467:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff91a877faf100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:94394728-4014-4ef0-b525-989290f008aa:15467:1870073693311488:0@lo:501:mount.lustre.0 00000100:00100000:0.0:1783441646.835818:0:15467:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff91a877faf100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:94394728-4014-4ef0-b525-989290f008aa:15467:1870073693311616:0@lo:503:mount.lustre.0 00000100:00100000:0.0:1783441646.835870:0:15467:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783441646.838621:0:15467:0:(client.c:2702:ptlrpc_set_wait()) set ffff91a848e410c0 going to sleep for 11 seconds 00000100:00100000:2.0:1783441646.839341:0:14157:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073693311616 00000100:00100000:2.0:1783441646.839355:0:14157:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073693311616 00000100:00100000:2.0:1783441646.839422:0:14157:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 68 00000100:00100000:2.0:1783441646.839434:0:14157:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a8492a3c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:94394728-4014-4ef0-b525-989290f008aa+19:15467:x1870073693311616:12345-0@lo:503:mount.lustre.0 00000100:00100000:2.0:1783441646.842627:0:14157:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a8492a3c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:94394728-4014-4ef0-b525-989290f008aa+19:15467:x1870073693311616:12345-0@lo:503:mount.lustre.0 Request processed in 3187us (6747us total) trans 0 rc 0/0 00000100:00100000:2.0:1783441646.842652:0:14157:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 68 00000100:00100000:1.0:1783441646.844115:0:15467:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff91a877faf100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:94394728-4014-4ef0-b525-989290f008aa:15467:1870073693311616:0@lo:503:mount.lustre.0 00000040:00080000:1.0:1783441646.851803:0:15467:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:1.0:1783441646.851909:0:15467:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff91a745550a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:94394728-4014-4ef0-b525-989290f008aa:15467:1870073693311744:0@lo:502:mount.lustre.0 00000100:00100000:1.0:1783441646.852028:0:15467:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783441646.852070:0:15467:0:(client.c:2702:ptlrpc_set_wait()) set ffff91a84867d000 going to sleep for 11 seconds 00000100:00100000:0.0:1783441646.854139:0:14155:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073693311744 00000100:00100000:0.0:1783441646.854155:0:14155:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073693311744 00000100:00100000:0.0:1783441646.854213:0:14155:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 69 00000100:00100000:0.0:1783441646.854222:0:14155:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a8492a2c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:94394728-4014-4ef0-b525-989290f008aa+19:15467:x1870073693311744:12345-0@lo:502:mount.lustre.0 00000100:00100000:0.0:1783441646.854546:0:14155:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a8492a2c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:94394728-4014-4ef0-b525-989290f008aa+19:15467:x1870073693311744:12345-0@lo:502:mount.lustre.0 Request processed in 324us (2518us total) trans 0 rc 0/0 00000100:00100000:0.0:1783441646.854554:0:14155:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 69 00000100:00100000:0.0:1783441646.854625:0:15467:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff91a745550a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:94394728-4014-4ef0-b525-989290f008aa:15467:1870073693311744:0@lo:502:mount.lustre.0 00000040:00080000:0.0:1783441646.856617:0:15467:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].1, 224 off8416 00000040:00080000:0.0:1783441646.856699:0:15467:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].2, 120 off8536 00000040:00080000:0.0:1783441646.856736:0:15467:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].3, 168 off8704 00000040:00080000:0.0:1783441646.858367:0:15467:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].4, 224 off8928 00000040:00080000:0.0:1783441646.859357:0:15467:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].5, 224 off9152 00000040:00080000:0.0:1783441646.860111:0:15467:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].6, 120 off9272 00000040:00080000:0.0:1783441646.860177:0:15467:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].7, 168 off9440 00000040:00080000:0.0:1783441646.860209:0:15467:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].8, 224 off9664 00000040:00080000:0.0:1783441646.861153:0:15467:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].9, 224 off9888 00000040:00080000:0.0:1783441646.861224:0:15467:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].10, 120 off10008 00000040:00080000:0.0:1783441646.862361:0:15467:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].11, 224 off10232 00000040:00080000:0.0:1783441646.863110:0:15467:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].12, 224 off10456 00000040:00080000:0.0:1783441646.863157:0:15467:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].13, 88 off10544 00000040:00080000:0.0:1783441646.863189:0:15467:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].14, 128 off10672 00000040:00080000:0.0:1783441646.863241:0:15467:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].15, 144 off10816 00000040:00080000:0.0:1783441646.864404:0:15467:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].16, 160 off10976 00000040:00080000:0.0:1783441646.864641:0:15467:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].17, 224 off11200 00000040:00080000:0.0:1783441646.864734:0:15467:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].18, 224 off11424 00000040:00080000:0.0:1783441646.866815:0:15467:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].19, 80 off11504 00000040:00080000:0.0:1783441646.866862:0:15467:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].20, 224 off11728 00000040:00080000:0.0:1783441646.866936:0:15467:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].21, 224 off11952 00000040:00080000:0.0:1783441646.866987:0:15467:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].22, 88 off12040 00000040:00080000:0.0:1783441646.868883:0:15467:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].23, 128 off12168 00000040:00080000:0.0:1783441646.869191:0:15467:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].24, 144 off12312 00000040:00080000:0.0:1783441646.869239:0:15467:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].25, 128 off12440 00000040:00080000:0.0:1783441646.869357:0:15467:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].26, 224 off12664 00000040:00080000:0.0:1783441646.869417:0:15467:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].27, 224 off12888 00000040:00080000:0.0:1783441646.870227:0:15467:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].28, 80 off12968 00000040:00080000:0.0:1783441646.870882:0:15467:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].29, 224 off13192 00000040:00080000:0.0:1783441646.870965:0:15467:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].30, 224 off13416 00000040:00080000:0.0:1783441646.871000:0:15467:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].31, 88 off13504 00000040:00080000:0.0:1783441646.871383:0:15467:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].32, 128 off13632 00000040:00080000:0.0:1783441646.871911:0:15467:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].33, 144 off13776 00000040:00080000:0.0:1783441646.873181:0:15467:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].34, 128 off13904 00000040:00080000:0.0:1783441646.873237:0:15467:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].35, 224 off14128 00000040:00080000:0.0:1783441646.873300:0:15467:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].36, 224 off14352 00000040:00080000:0.0:1783441646.873336:0:15467:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].37, 80 off14432 00000040:00080000:0.0:1783441646.873373:0:15467:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].38, 224 off14656 00000040:00080000:0.0:1783441646.873418:0:15467:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].39, 224 off14880 00000040:00080000:0.0:1783441646.873452:0:15467:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].40, 120 off15000 00000100:00100000:0.0:1783441646.873509:0:15467:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff91a877fad500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:94394728-4014-4ef0-b525-989290f008aa:15467:1870073693311872:0@lo:502:mount.lustre.0 00000100:00100000:0.0:1783441646.873603:0:15467:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783441646.873652:0:15467:0:(client.c:2702:ptlrpc_set_wait()) set ffff91a844b19000 going to sleep for 11 seconds 00000100:00100000:3.0:1783441646.874178:0:14157:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073693311872 00000100:00100000:3.0:1783441646.874188:0:14157:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073693311872 00000100:00100000:3.0:1783441646.874242:0:14157:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 70 00000100:00100000:3.0:1783441646.874251:0:14157:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a8492a1c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:94394728-4014-4ef0-b525-989290f008aa+19:15467:x1870073693311872:12345-0@lo:502:mount.lustre.0 00000100:00100000:3.0:1783441646.874514:0:14157:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a8492a1c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:94394728-4014-4ef0-b525-989290f008aa+19:15467:x1870073693311872:12345-0@lo:502:mount.lustre.0 Request processed in 262us (910us total) trans 0 rc 0/0 00000100:00100000:3.0:1783441646.874522:0:14157:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 70 00000100:00100000:0.0:1783441646.879097:0:15467:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff91a877fad500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:94394728-4014-4ef0-b525-989290f008aa:15467:1870073693311872:0@lo:502:mount.lustre.0 00000040:00080000:0.0:1783441646.879265:0:15467:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].41, 224 off15224 00000040:00080000:0.0:1783441646.879280:0:15467:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 41 count 42 00000020:01000004:3.0:1783441646.882736:0:15478:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-OST0001 (typ=lwp) 00000020:00000080:3.0:1783441646.882788:0:15478:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-OST0001 (ffff91a877f7b380) 00000020:00000080:3.0:1783441646.883338:0:15478:0:(obd_config.c:720:class_attach_name()) OBD: dev 17 attached type lwp with refcount 2 00000020:01000004:3.0:1783441646.883613:0:15478:0:(tgt_mount.c:153:server_get_mount()) get mount ffff91a843888000 from lustre-OST0001, refs=3 00000020:01000004:3.0:1783441646.883631:0:15478:0:(tgt_mount.c:187:server_put_mount()) put mount ffff91a843888000 from lustre-OST0001, refs=3 00000020:01000004:3.0:1783441646.883634:0:15478:0:(obd_mount.c:710:lustre_put_lsi()) put ffff91a843888000 3 00010000:00080000:3.0:1783441646.883669:0:15478:0:(ldlm_lib.c:102:import_set_conn()) imp ffff91a844f7c800@lustre-MDT0000-lwp-OST0001: add connection 192.168.201.113@tcp at head 00010000:00010000:3.0:1783441646.891683:0:15478:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-OST0001-5 is initialized 00000020:00000080:3.0:1783441646.892418:0:15478:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-OST0001 (uuid lustre-MDT0000-lwp-OST0001_UUID) 00000010:01000000:3.0:1783441646.892912:0:15478:0:(lwp_dev.c:497:lwp_obd_connect()) connect #0 00000020:00000080:3.0:1783441646.893080:0:15478:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-lwp-OST0001, cookie 0xa2426164df2c8a21 00000100:00080000:3.0:1783441646.893513:0:15478:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 0 00000100:00080000:3.0:1783441646.893521:0:15478:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff91a844f7c800 using connection 192.168.201.113@tcp/0@lo 00000100:00100000:3.0:1783441646.893560:0:15478:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff91a874dcc000 x1870073693312000/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1783441646.893624:0:3302:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff91a874dcc000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3302:1870073693312000:0@lo:38:llog_process_th.0 00000100:00100000:1.0:1783441646.893698:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:3.0:1783441646.894564:0:15478:0:(pinger.c:374:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID 00000100:00080000:3.0:1783441646.894620:0:33:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1783441646.894624:0:33:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:3.0:1783441646.894627:0:33:0:(import.c:65:import_set_state_nolock()) ffff91a848696000 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1783441646.894632:0:33:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-MDT0000: connect to NID 0@lo last attempt 482 00000100:00080000:3.0:1783441646.894637:0:33:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-MDT0000: tried all connections, increasing latency to 15s 00000100:00080000:3.0:1783441646.894643:0:33:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff91a848696000 using connection 192.168.201.113@tcp/0@lo 00000100:00100000:3.0:1783441646.894661:0:33:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff91a874dcd880 x1870073693312256/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1783441646.894701:0:3306:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1783441646.894718:0:3306:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff91a874dcc700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3306:1870073693312128:0@lo:400:kworker.0 00000100:00100000:2.0:1783441646.894798:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783441646.895997:0:14821:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073693312000 00000100:00100000:0.0:1783441646.896009:0:14821:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073693312000 00000100:00100000:0.0:1783441646.896049:0:14821:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1783441646.896057:0:14821:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a745551c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:3302:x1870073693312000:12345-0@lo:38:llog_process_th.0 00010000:00080000:0.0:1783441646.896084:0:14821:0:(ldlm_lib.c:1432:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-OST0001_UUID@0@lo t0 exp 0000000000000000 cur 484 last 0 00000020:00000080:0.0:1783441646.896136:0:14821:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-lwp-OST0001_UUID, cookie 0xa2426164df2c8a28 00000004:00100000:0.0:1783441646.896150:0:14821:0:(mdt_handler.c:7286:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:0.0:1783441646.896180:0:14821:0:(import.c:65:import_set_state_nolock()) ffff91a8503da800 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1783441646.896390:0:3302:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff91a874dcd880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3302:1870073693312256:0@lo:8:kworker.0 00000100:00100000:1.0:1783441646.896442:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783441646.897005:0:3304:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1783441646.897010:0:14821:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a745551c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3302:x1870073693312000:12345-0@lo:38:llog_process_th.0 Request processed in 952us (3312us total) trans 0 rc 0/0 00000100:00100000:0.0:1783441646.897019:0:14821:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1783441646.897045:0:3305:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1783441646.897055:0:3305:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff91a874dcc380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3305:1870073693312384:0@lo:400:kworker.0 00000100:00100000:0.0:1783441646.897085:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783441646.897128:0:14163:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073693312384 00000100:00100000:0.0:1783441646.897132:0:14163:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073693312384 00000100:00100000:0.0:1783441646.897165:0:14163:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:0.0:1783441646.897172:0:14163:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a877fad500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3305:x1870073693312384:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1783441646.897211:0:14163:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a877fad500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3305:x1870073693312384:12345-0@lo:400:kworker.0 Request processed in 38us (125us total) trans 0 rc 0/0 00000100:00100000:0.0:1783441646.897217:0:14163:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00010000:00080000:0.0:1783441646.897273:0:3305:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff91a874dcc380 x1870073693312384/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1783441662 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1783441646.897287:0:3305:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff91a874dcc380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3305:1870073693312384:0@lo:400:kworker.0 00010000:00080000:1.0:1783441646.897395:0:3302:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff91a874dcc000 x1870073693312000/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/416 e 0 to 0 dl 1783441656 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1783441646.897469:0:3302:0:(client.c:3112:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0001: committing for last_committed 0 gen 2 00000100:00080000:1.0:1783441646.897478:0:3302:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-OST0001: connect to target with instance 2 00000100:00080000:1.0:1783441646.897487:0:3302:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-OST0001: Resetting ns_connect_flags to server flags: 0x2041401043000020 00000100:00080000:1.0:1783441646.897493:0:3302:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:1.0:1783441646.897495:0:3302:0:(import.c:65:import_set_state_nolock()) ffff91a844f7c800 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:1.0:1783441646.897502:0:3302:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff91a874dcc000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3302:1870073693312000:0@lo:38:llog_process_th.0 00000100:00100000:1.0:1783441646.897543:0:14800:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073693312128 00000100:00100000:1.0:1783441646.897548:0:14800:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073693312128 00000100:00100000:1.0:1783441646.897757:0:14800:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073693312256 00000100:00100000:1.0:1783441646.897762:0:14800:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073693312256 00000100:00100000:1.0:1783441646.897798:0:14800:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1783441646.897805:0:14800:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a859087100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+7:3306:x1870073693312128:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1783441646.898412:0:3304:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff91a874dcdc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3304:1870073693312512:0@lo:400:kworker.0 00000100:00080000:0.0:1783441646.898557:0:14159:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1783441646.898679:0:14800:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a859087100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+7:3306:x1870073693312128:12345-0@lo:400:kworker.0 Request processed in 805us (3811us total) trans 0 rc 0/0 00000100:00100000:1.0:1783441646.898688:0:14800:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1783441646.898710:0:14800:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:1.0:1783441646.898715:0:14800:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a745553b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0+-99:3302:x1870073693312256:12345-0@lo:8:kworker.0 00000100:00100000:1.0:1783441646.898803:0:14800:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a745553b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0+-99:3302:x1870073693312256:12345-0@lo:8:kworker.0 Request processed in 86us (2360us total) trans 0 rc -11/-11 00000100:00100000:1.0:1783441646.898820:0:14800:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:0.0:1783441646.898849:0:3306:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff91a874dcc700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3306:1870073693312128:0@lo:400:kworker.0 00000100:00100000:0.0:1783441646.898898:0:3302:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:0.0:1783441646.898904:0:3302:0:(import.c:65:import_set_state_nolock()) ffff91a848696000 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1783441646.898908:0:3302:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-11) 00000100:00100000:0.0:1783441646.898912:0:3302:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff91a874dcd880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3302:1870073693312256:0@lo:8:kworker.0 00000100:00100000:3.0:1783441646.899003:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783441646.899133:0:14821:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073693312512 00000100:00100000:0.0:1783441646.899139:0:14821:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073693312512 00000100:00080000:1.0:1783441646.899186:0:14159:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1783441646.899193:0:14821:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:0.0:1783441646.899201:0:14821:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a874dcd500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3304:x1870073693312512:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1783441646.899247:0:14821:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a874dcd500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3304:x1870073693312512:12345-0@lo:400:kworker.0 Request processed in 48us (245us total) trans 0 rc 0/0 00000100:00100000:0.0:1783441646.899253:0:14821:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00010000:00080000:1.0:1783441646.899324:0:3304:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff91a874dcdc00 x1870073693312512/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1783441662 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1783441646.899335:0:3304:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff91a874dcdc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3304:1870073693312512:0@lo:400:kworker.0 00000040:00080000:3.0:1783441646.900564:0:15478:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xa:0x0] index 42 count 42 00000020:01000000:0.0:1783441646.900680:0:15467:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-41 (rc=0) 10000000:01000000:0.0:1783441646.900702:0:15467:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.201.113@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:0.0:1783441646.900722:0:15467:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.113@tcp lock: ffff91a87da47800/0xa2426164df2c8a0c lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0xa2426164df2c8a13 expref: -99 pid: 15467 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783441646.900731:0:15467:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.113@tcp lock: ffff91a87da47800/0xa2426164df2c8a0c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0xa2426164df2c8a13 expref: -99 pid: 15467 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:0.0:1783441646.900808:0:15467:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:0.0:1783441646.900810:0:15467:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:0.0:1783441646.900812:0:15467:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1783441646.900813:0:15467:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1783441646.900814:0:15467:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1783441646.900815:0:15467:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1783441646.900816:0:15467:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:0.0:1783441646.900819:0:15467:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1783441646.900820:0:15467:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:0.0:1783441646.900825:0:15467:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0001 0x40020002 00000020:01000004:0.0:1783441646.900827:0:15467:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:0.0:1783441646.900829:0:15467:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:0.0:1783441646.900830:0:15467:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1783441646.900831:0:15467:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1783441646.900832:0:15467:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1783441646.900833:0:15467:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1783441646.900834:0:15467:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:0.0:1783441646.900835:0:15467:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1783441646.900842:0:15467:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:0.0:1783441646.900866:0:15467:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0001 00000100:00100000:0.0:1783441646.900885:0:15467:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff91a877faf800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:94394728-4014-4ef0-b525-989290f008aa:15467:1870073693312640:0@lo:253:mount.lustre.0 00000100:00100000:0.0:1783441646.900967:0:15467:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783441646.901015:0:14156:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073693312640 00000100:00100000:1.0:1783441646.901024:0:14156:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073693312640 00000100:00100000:1.0:1783441646.901069:0:14156:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 71 00000100:00100000:1.0:1783441646.901078:0:14156:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a8492a3050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:94394728-4014-4ef0-b525-989290f008aa+19:15467:x1870073693312640:12345-0@lo:253:mount.lustre.0 20000000:01000000:1.0:1783441646.901109:0:14156:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 1 is ready to reconnect. 20000000:01000000:1.0:1783441646.901129:0:14156:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 00000100:00100000:0.0:1783441646.901507:0:15467:0:(client.c:2702:ptlrpc_set_wait()) set ffff91a843df4cc0 going to sleep for 11 seconds 20000000:01000000:1.0:1783441646.966671:0:14156:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:1.0:1783441646.966701:0:14156:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0001, index=1, rc=0 20000000:01000000:0.0:1783441646.966826:0:14178:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:0.0:1783441646.966832:0:14178:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:0.0:1783441646.966855:0:14178:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff91a85fe59e00/0xa2426164df2c8a2f lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14178 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783441646.966876:0:14178:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff91a841477e00/0xa2426164df2c8909 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xa2426164df2c8902 expref: 19 pid: 14157 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783441646.966884:0:14178:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff91a85fe59e00/0xa2426164df2c8a2f lrc: 4/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 14178 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783441646.966926:0:14178:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff91a841477e00/0xa2426164df2c8909 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xa2426164df2c8902 expref: 19 pid: 14157 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783441646.966940:0:14178:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff91a841477e00/0xa2426164df2c8909 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xa2426164df2c8902 expref: 19 pid: 14157 timeout: 584 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783441646.966957:0:14178:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff91a877fafb80 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:14178:1870073693312768:0@lo:104: 00000100:00100000:0.0:1783441646.967039:0:14178:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783441646.967099:0:14178:0:(client.c:2702:ptlrpc_set_wait()) set ffff91a875345240 going to sleep for 11 seconds 00000100:00100000:1.0:1783441646.967465:0:14147:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073693312768 00000100:00100000:1.0:1783441646.967473:0:14147:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073693312768 00000100:00100000:1.0:1783441646.967524:0:14147:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1783441646.967534:0:14147:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a877fad180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:94394728-4014-4ef0-b525-989290f008aa+3:14178:x1870073693312768:12345-0@lo:104: 00010000:00010000:1.0:1783441646.967548:0:14147:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.113@tcp lock: ffff91a87da46400/0xa2426164df2c8902 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xa2426164df2c8909 expref: -99 pid: 14160 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783441646.967626:0:14147:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:1.0:1783441646.967633:0:14147:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a877fad180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:94394728-4014-4ef0-b525-989290f008aa+3:14178:x1870073693312768:12345-0@lo:104: Request processed in 101us (594us total) trans 0 rc 0/0 00000100:00100000:1.0:1783441646.967640:0:14147:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00010000:00010000:1.0:1783441646.967668:0:14152:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1783441646.967673:0:14152:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.113@tcp lock: ffff91a87da46400/0xa2426164df2c8902 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xa2426164df2c8909 expref: -99 pid: 14160 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783441646.967681:0:14152:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91a87da46400 already unused, calling callback (ffffffffc1b78c20) 10000000:00010000:1.0:1783441646.967685:0:14152:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.113@tcp lock: ffff91a87da46400/0xa2426164df2c8902 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xa2426164df2c8909 expref: -99 pid: 14160 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783441646.967705:0:14152:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.113@tcp lock: ffff91a87da46400/0xa2426164df2c8902 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xa2426164df2c8909 expref: -99 pid: 14160 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1783441646.967712:0:14152:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.113@tcp lock: ffff91a87da46400/0xa2426164df2c8902 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xa2426164df2c8909 expref: -99 pid: 14160 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1783441646.967719:0:14152:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:1.0:1783441646.967793:0:14152:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.113@tcp lock: ffff91a87da46400/0xa2426164df2c8902 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xa2426164df2c8909 expref: -99 pid: 14160 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783441646.967800:0:14152:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1783441646.967821:0:14152:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.113@tcp lock: ffff91a87da46400/0xa2426164df2c8902 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xa2426164df2c8909 expref: -99 pid: 14160 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783441646.967828:0:14152:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.113@tcp lock: ffff91a87da46400/0xa2426164df2c8902 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xa2426164df2c8909 expref: -99 pid: 14160 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783441646.967859:0:14152:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783441646.967861:0:14152:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783441646.967863:0:14152:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1783441646.967884:0:3304:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff91a745551180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:94394728-4014-4ef0-b525-989290f008aa:3304:1870073693312896:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1783441646.967913:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783441646.967951:0:14150:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073693312896 00000100:00100000:1.0:1783441646.967955:0:14150:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073693312896 00010000:00010000:1.0:1783441646.967974:0:14150:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff91a841477e00/0xa2426164df2c8909 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xa2426164df2c8902 expref: 20 pid: 14157 timeout: 584 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783441646.967995:0:14150:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1783441646.968001:0:14150:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a745550700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:94394728-4014-4ef0-b525-989290f008aa+20:3304:x1870073693312896:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1783441646.968012:0:14150:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1783441646.968017:0:14150:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff91a841477e00/0xa2426164df2c8909 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xa2426164df2c8902 expref: 20 pid: 14157 timeout: 584 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783441646.968026:0:14150:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff91a841477e00/0xa2426164df2c8909 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xa2426164df2c8902 expref: 20 pid: 14157 timeout: 584 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783441646.968041:0:14150:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff91a85fe59e00/0xa2426164df2c8a2f lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 14178 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783441646.968049:0:14150:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff91a85fe59e00/0xa2426164df2c8a2f lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 14178 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:1.0:1783441646.968062:0:14150:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.003386120s 00010000:00010000:1.0:1783441646.968066:0:14150:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff91a85fe59e00/0xa2426164df2c8a2f lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14178 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783441646.968084:0:14150:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff91a85fe59e00/0xa2426164df2c8a2f lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 14178 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783441646.968091:0:14150:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff91a85fe59e00/0xa2426164df2c8a2f lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 14178 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783441646.968097:0:14150:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff91a85fe59e00/0xa2426164df2c8a2f lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 14178 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783441646.968102:0:14150:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91a85fe59e00 already unused, calling callback (ffffffffc155ff90) 00010000:00010000:1.0:1783441646.968106:0:14150:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff91a85fe59e00/0xa2426164df2c8a2f lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 14178 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783441646.968113:0:14150:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff91a85fe59e00/0xa2426164df2c8a2f lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 14178 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783441646.968122:0:14150:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff91a85fe59e00/0xa2426164df2c8a2f lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14178 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783441646.968131:0:14150:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1783441646.968161:0:14150:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a745550700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:94394728-4014-4ef0-b525-989290f008aa+20:3304:x1870073693312896:12345-0@lo:103:ldlm_bl.0 Request processed in 159us (246us total) trans 0 rc 0/0 00000100:00100000:1.0:1783441646.968168:0:14150:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1783441646.968205:0:3304:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff91a745551180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:94394728-4014-4ef0-b525-989290f008aa:3304:1870073693312896:0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1783441646.968678:0:14178:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff91a841477e00/0xa2426164df2c8909 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xa2426164df2c8902 expref: 19 pid: 14157 timeout: 584 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783441646.968702:0:14178:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff91a877fafb80 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:14178:1870073693312768:0@lo:104: 00010000:00010000:0.0:1783441646.968717:0:14178:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff91a85fe59e00/0xa2426164df2c8a2f lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14178 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783441646.968781:0:14178:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff91a85fe59e00/0xa2426164df2c8a2f lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14178 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783441646.968789:0:14178:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff91a85fe59e00/0xa2426164df2c8a2f lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14178 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783441646.968794:0:14178:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff91a85fe59e00/0xa2426164df2c8a2f lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14178 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783441646.976847:0:14156:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a8492a3050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:94394728-4014-4ef0-b525-989290f008aa+18:15467:x1870073693312640:12345-0@lo:253:mount.lustre.0 Request processed in 75759us (75869us total) trans 0 rc 0/0 00000100:00100000:1.0:1783441646.976863:0:14156:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 71 00000100:00100000:2.0:1783441646.977091:0:15467:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff91a877faf800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:94394728-4014-4ef0-b525-989290f008aa:15467:1870073693312640:0@lo:253:mount.lustre.0 10000000:01000000:2.0:1783441646.977108:0:15467:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0001 got index = 1 00000020:01000004:2.0:1783441646.977112:0:15467:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:2.0:1783441646.977114:0:15467:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:2.0:1783441646.977115:0:15467:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1783441646.977117:0:15467:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1783441646.977118:0:15467:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1783441646.977120:0:15467:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1783441646.977122:0:15467:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1783441646.977124:0:15467:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1783441646.977125:0:15467:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:2.0:1783441646.977138:0:15467:0:(tgt_mount.c:2690:server_calc_timeout()) lustre-OST0001: Imperative Recovery not enabled, recovery window 60-180 00080000:10000000:3.0:1783441646.984619:0:15467:0:(osd_index.c:2102:osd_index_try()) lustre-OST0001: index object [0x200000003:0x5:0x0] (8/8/4) registered 00080000:10000000:3.0:1783441646.984953:0:15467:0:(osd_index.c:2102:osd_index_try()) lustre-OST0001: index object [0x200000005:0x1:0x0] (8/8/1) registered 00080000:10000000:3.0:1783441646.985186:0:15467:0:(osd_index.c:2102:osd_index_try()) lustre-OST0001: index object [0x200000003:0x6:0x0] (8/8/4) registered 00080000:10000000:3.0:1783441646.985602:0:15467:0:(osd_index.c:2102:osd_index_try()) lustre-OST0001: index object [0x200000005:0x2:0x0] (8/8/1) registered 00080000:10000000:3.0:1783441646.986386:0:15467:0:(osd_index.c:2102:osd_index_try()) lustre-OST0001: index object [0x200000003:0x7:0x0] (8/8/4) registered 00080000:10000000:3.0:1783441646.986888:0:15467:0:(osd_index.c:2102:osd_index_try()) lustre-OST0001: index object [0x200000005:0x3:0x0] (8/8/1) registered 00000001:00000004:3.0:1783441646.987916:0:15467:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 2, last_transno is 8589934592 00002000:00080000:3.0:1783441647.044196:0:15467:0:(ofd_obd.c:539:ofd_postrecov()) lustre-OST0001: recovery is over 00100000:10000000:3.0:1783441647.044206:0:15467:0:(lfsck_lib.c:3085:lfsck_start()) lustre-OST0001-osd: start master thread 00000020:01000004:3.0:1783441647.044238:0:15467:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:3.0:1783441647.044309:0:15467:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.201.113@tcp: cl_mgc_mutex unlock 00000020:01000004:3.0:1783441647.044322:0:15467:0:(tgt_mount.c:2459:server_fill_super_common()) Server sb, dev=49 00000080:00000004:3.0:1783441647.044358:0:15467:0:(super25.c:187:lustre_fill_super()) lustre-ost2/ost2: Mount complete 00010000:00010000:1.0:1783441647.469220:0:14151:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:1.0:1783441648.109450:0:14160:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:1.0:1783441648.109459:0:14160:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-mdtir-ffff91a844b0f000 from 8 10000000:01000000:1.0:1783441648.109464:0:14160:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:1.0:1783441648.109512:0:14160:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.113@tcp lock: ffff91a87da46e00/0xa2426164df2c8a36 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14160 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783441648.109524:0:14160:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.113@tcp lock: ffff91a87da46e00/0xa2426164df2c8a36 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14160 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783441648.109535:0:14160:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.113@tcp lock: ffff91a87da46e00/0xa2426164df2c8a36 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14160 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783441648.109561:0:14160:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff91a745551180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:94394728-4014-4ef0-b525-989290f008aa:14160:1870073693313024:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1783441648.109626:0:14160:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783441648.109679:0:14160:0:(client.c:2702:ptlrpc_set_wait()) set ffff91a746c8d000 going to sleep for 11 seconds 00000100:00100000:0.0:1783441648.109683:0:14155:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073693313024 00000100:00100000:0.0:1783441648.109693:0:14155:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073693313024 00000100:00100000:0.0:1783441648.110637:0:14155:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 72 00000100:00100000:0.0:1783441648.110652:0:14155:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a8492a0050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:94394728-4014-4ef0-b525-989290f008aa+18:14160:x1870073693313024:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1783441648.110669:0:14155:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1783441648.110686:0:14155:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff91a85fe58e00/0xa2426164df2c8a3d lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xa2426164df2c8a36 expref: -99 pid: 14155 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783441648.110711:0:14155:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff91a85fe58e00/0xa2426164df2c8a3d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xa2426164df2c8a36 expref: 19 pid: 14155 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783441648.110722:0:14155:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff91a85fe58e00/0xa2426164df2c8a3d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xa2426164df2c8a36 expref: 19 pid: 14155 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783441648.110732:0:14155:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91a85fe58e00, rc 0) 00000100:00100000:0.0:1783441648.110829:0:14155:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a8492a0050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:94394728-4014-4ef0-b525-989290f008aa+19:14160:x1870073693313024:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 182us (1202us total) trans 0 rc 0/0 00000100:00100000:0.0:1783441648.110836:0:14155:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 72 00000100:00100000:2.0:1783441648.110858:0:14160:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff91a745551180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:94394728-4014-4ef0-b525-989290f008aa:14160:1870073693313024:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1783441648.110880:0:14160:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.113@tcp lock: ffff91a87da46e00/0xa2426164df2c8a36 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xa2426164df2c8a3d expref: -99 pid: 14160 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783441648.110891:0:14160:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.113@tcp lock: ffff91a87da46e00/0xa2426164df2c8a36 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xa2426164df2c8a3d expref: -99 pid: 14160 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783441648.110960:0:14160:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff91a859084e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:94394728-4014-4ef0-b525-989290f008aa:14160:1870073693313152:0@lo:256:ll_cfg_requeue.0 00000100:00100000:2.0:1783441648.111074:0:14160:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783441648.114248:0:14160:0:(client.c:2702:ptlrpc_set_wait()) set ffff91a874cd7600 going to sleep for 11 seconds 00000100:00100000:1.0:1783441648.117529:0:14157:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073693313152 00000100:00100000:1.0:1783441648.117543:0:14157:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073693313152 00000100:00100000:1.0:1783441648.117601:0:14157:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 73 00000100:00100000:1.0:1783441648.117612:0:14157:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a8492a0450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:94394728-4014-4ef0-b525-989290f008aa+19:14160:x1870073693313152:12345-0@lo:256:ll_cfg_requeue.0 20000000:01000000:1.0:1783441648.117639:0:14157:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:1.0:1783441648.117664:0:14157:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:1.0:1783441648.117667:0:14157:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 8 00000100:00100000:1.0:1783441648.117862:0:14157:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a8492a0450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:94394728-4014-4ef0-b525-989290f008aa+19:14160:x1870073693313152:12345-0@lo:256:ll_cfg_requeue.0 Request processed in 251us (6787us total) trans 0 rc 0/0 00000100:00100000:1.0:1783441648.117871:0:14157:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 73 00000100:00100000:3.0:1783441648.118813:0:14160:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff91a859084e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:94394728-4014-4ef0-b525-989290f008aa:14160:1870073693313152:0@lo:256:ll_cfg_requeue.0 10000000:01000000:3.0:1783441648.118895:0:14160:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.201.113@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:3.0:1783441648.118905:0:14160:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.113@tcp lock: ffff91a87da46e00/0xa2426164df2c8a36 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xa2426164df2c8a3d expref: -99 pid: 14160 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783441648.118917:0:14160:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.113@tcp lock: ffff91a87da46e00/0xa2426164df2c8a36 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xa2426164df2c8a3d expref: -99 pid: 14160 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00100000:3.0:1783441648.215093:0:6613:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000001:00080000:3.0:1783441648.215114:0:6613:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 8589934593 is committed 00010000:00010000:1.0:1783441648.492971:0:14152:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783441649.518018:0:14151:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1783441650.034931:0:3305:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff91a859085180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3305:1870073693313280:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1783441650.035031:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783441650.035149:0:14801:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073693313280 00000100:00100000:2.0:1783441650.035160:0:14801:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073693313280 00000100:00100000:2.0:1783441650.035233:0:14801:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1783441650.035243:0:14801:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a859086a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3305:x1870073693313280:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1783441650.035289:0:14801:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1783441650.035341:0:14801:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a859086a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3305:x1870073693313280:12345-0@lo:13:osp-pre-0-0.0 Request processed in 100us (311us total) trans 0 rc 0/0 00000100:00100000:2.0:1783441650.035348:0:14801:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00080000:2.0:1783441650.035371:0:14159:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1783441650.035409:0:3305:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 8589934593 gen 2 00000100:00100000:2.0:1783441650.035437:0:3305:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff91a859085180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3305:1870073693313280:0@lo:13:osp-pre-0-0.0 00010000:00010000:1.0:1783441650.541016:0:14152:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:1.0:1783441651.065263:0:14197:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:0.0:1783441651.565935:0:14151:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:3.0:1783441652.078938:0:33:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1783441652.078947:0:33:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:3.0:1783441652.078951:0:33:0:(import.c:65:import_set_state_nolock()) ffff91a848696000 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1783441652.078967:0:33:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff91a848696000 using connection 192.168.201.113@tcp/0@lo 00000100:00100000:3.0:1783441652.078996:0:33:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff91a874dcea00 x1870073693313664/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1783441652.079079:0:3306:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff91a874dcdf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:94394728-4014-4ef0-b525-989290f008aa:3306:1870073693313408:0@lo:400:kworker.0 00000100:00100000:3.0:1783441652.079199:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783441652.079270:0:3306:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff91a874dcc700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3306:1870073693314048:0@lo:400:kworker.0 00000100:00100000:3.0:1783441652.079308:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783441652.079340:0:3306:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1783441652.079346:0:3306:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff91a874dcd880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3306:1870073693313920:0@lo:400:kworker.0 00000100:00100000:3.0:1783441652.079389:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783441652.079423:0:3303:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff91a874dced80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3303:1870073693313536:0@lo:400:kworker.0 00000100:00100000:3.0:1783441652.079455:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783441652.079478:0:3303:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1783441652.079484:0:3303:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff91a874dcdc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3303:1870073693313792:0@lo:400:kworker.0 00000100:00100000:3.0:1783441652.079506:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783441652.079535:0:3302:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff91a874dcea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3302:1870073693313664:0@lo:8:kworker.0 00000100:00100000:3.0:1783441652.079559:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783441652.079587:0:14157:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073693313408 00000100:00100000:3.0:1783441652.079590:0:14164:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073693314048 00000100:00100000:3.0:1783441652.079597:0:14164:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073693314048 00000100:00100000:1.0:1783441652.079598:0:14157:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073693313408 00000100:00100000:3.0:1783441652.079654:0:14164:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073693313920 00000100:00100000:3.0:1783441652.079657:0:14164:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073693313920 00000100:00100000:1.0:1783441652.079659:0:14157:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 74 00000100:00100000:1.0:1783441652.079668:0:14157:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a8492a1450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:94394728-4014-4ef0-b525-989290f008aa+19:3306:x1870073693313408:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1783441652.079671:0:14164:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073693313792 00000100:00100000:3.0:1783441652.079674:0:14164:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073693313792 00000100:00100000:3.0:1783441652.079699:0:14164:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:3.0:1783441652.079706:0:14164:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a874dcc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3306:x1870073693314048:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1783441652.079942:0:14164:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a874dcc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3306:x1870073693314048:12345-0@lo:400:kworker.0 Request processed in 236us (633us total) trans 0 rc 0/0 00000100:00100000:3.0:1783441652.079951:0:14164:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:3.0:1783441652.079970:0:14164:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:3.0:1783441652.079977:0:14164:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a874dcc380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3306:x1870073693313920:12345-0@lo:400:kworker.0 00000100:00080000:2.0:1783441652.080159:0:14159:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1783441652.081803:0:14157:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a8492a1450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:94394728-4014-4ef0-b525-989290f008aa+19:3306:x1870073693313408:12345-0@lo:400:kworker.0 Request processed in 2124us (2592us total) trans 0 rc 0/0 00000100:00100000:1.0:1783441652.081820:0:14157:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 74 00000100:00100000:0.0:1783441652.083826:0:14800:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073693313536 00000100:00100000:0.0:1783441652.083844:0:14800:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073693313536 00000100:00100000:0.0:1783441652.083910:0:14800:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073693313664 00000100:00100000:0.0:1783441652.083915:0:14800:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073693313664 00000100:00100000:0.0:1783441652.083935:0:14800:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1783441652.083947:0:14800:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a745a78e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3303:x1870073693313536:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1783441652.084075:0:14800:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a745a78e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3303:x1870073693313536:12345-0@lo:400:kworker.0 Request processed in 131us (4619us total) trans 0 rc 0/0 00000100:00100000:0.0:1783441652.084083:0:14800:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1783441652.084100:0:14800:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:0.0:1783441652.084104:0:14800:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a745a7a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0+-99:3302:x1870073693313664:12345-0@lo:8:kworker.0 00010000:00080000:0.0:1783441652.084132:0:14800:0:(ldlm_lib.c:1432:target_handle_connect()) lustre-OST0001: connection from lustre-MDT0000-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 489 last 0 00000100:00080000:2.0:1783441652.084335:0:14159:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1783441652.086510:0:14164:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a874dcc380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3306:x1870073693313920:12345-0@lo:400:kworker.0 Request processed in 6518us (7104us total) trans 0 rc 0/0 00000100:00100000:3.0:1783441652.086528:0:14164:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:3.0:1783441652.086619:0:3303:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff91a874dced80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3303:1870073693313536:0@lo:400:kworker.0 00000100:00100000:3.0:1783441652.086665:0:14821:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:3.0:1783441652.086690:0:14821:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a745a78a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3303:x1870073693313792:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1783441652.086804:0:14821:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a745a78a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3303:x1870073693313792:12345-0@lo:400:kworker.0 Request processed in 129us (7296us total) trans 0 rc 0/0 00000100:00100000:3.0:1783441652.086811:0:14821:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00010000:00080000:3.0:1783441652.086861:0:3306:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff91a874dcd880 x1870073693313920/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1783441668 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1783441652.086874:0:3306:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff91a874dcd880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3306:1870073693313920:0@lo:400:kworker.0 00000100:00100000:3.0:1783441652.086887:0:3306:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff91a874dcdf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:94394728-4014-4ef0-b525-989290f008aa:3306:1870073693313408:0@lo:400:kworker.0 00010000:00080000:3.0:1783441652.086899:0:3306:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff91a874dcc700 x1870073693314048/t0(0) o400->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1783441668 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1783441652.086906:0:3306:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff91a874dcc700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3306:1870073693314048:0@lo:400:kworker.0 00000020:00000080:0.0:1783441652.087277:0:14800:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0xa2426164df2c8a44 00002000:00100000:0.0:1783441652.087301:0:14800:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli lustre-MDT0000-mdtlov_UUID/ffff91a8503de000 ocd_connect_flags: 0xa044401443000026 ocd_version: 2113669 ocd_grant: 0 ocd_index: 1 ocd_group 0 00002000:00080000:0.0:1783441652.087307:0:14800:0:(ofd_obd.c:139:ofd_parse_connect_data()) lustre-OST0001: Received MDS connection for group 0 00002000:00100000:0.0:1783441652.087310:0:14800:0:(ofd_obd.c:227:ofd_parse_connect_data()) lustre-OST0001: cli does not support OBD_CONNECT_CKSUM 00002000:00080000:0.0:1783441652.087804:0:14800:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:0.0:1783441652.087845:0:14800:0:(import.c:65:import_set_state_nolock()) ffff91a8503d8800 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1783441652.087917:0:14800:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a745a7a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:3302:x1870073693313664:12345-0@lo:8:kworker.0 Request processed in 3810us (8355us total) trans 0 rc 0/0 00000100:00100000:0.0:1783441652.087926:0:14800:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00010000:00080000:3.0:1783441652.088405:0:3302:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff91a874dcea00 x1870073693313664/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/416 e 0 to 0 dl 1783441677 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:3.0:1783441652.088425:0:3302:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-OST0001-osc-MDT0000: connect to target with instance 2 00000100:00080000:3.0:1783441652.088437:0:3302:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-OST0001-osc-MDT0000: Resetting ns_connect_flags to server flags: 0xa040401443000026 00000100:00080000:3.0:1783441652.088444:0:3302:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-OST0001_UUID 00000100:00080000:3.0:1783441652.088447:0:3302:0:(import.c:65:import_set_state_nolock()) ffff91a848696000 lustre-OST0001_UUID: changing import state from CONNECTING to FULL 00000004:00080000:3.0:1783441652.088461:0:3302:0:(osp_dev.c:1648:osp_import_event()) got connected 00000100:00100000:3.0:1783441652.088477:0:3302:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff91a874dcea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3302:1870073693313664:0@lo:8:kworker.0 00000004:00080000:3.0:1783441652.088548:0:14187:0:(osp_precreate.c:882:osp_precreate_cleanup_orphans()) lustre-OST0001-osc-MDT0000: going to cleanup orphans since [0x280000400:0x5:0x0] 00000100:00100000:3.0:1783441652.088572:0:14187:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff91a745a7ad80 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:14187:1870073693314304:0@lo:5:osp-pre-1-0.0 00000100:00100000:3.0:1783441652.088622:0:14187:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783441652.088648:0:14187:0:(client.c:2702:ptlrpc_set_wait()) set ffff91a867cff9c0 going to sleep for 11 seconds 00000100:00100000:3.0:1783441652.088671:0:14799:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073693314304 00000100:00100000:3.0:1783441652.088679:0:14799:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073693314304 00000100:00100000:3.0:1783441652.088764:0:14799:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:3.0:1783441652.088775:0:14799:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a745a7b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:14187:x1870073693314304:12345-0@lo:5:osp-pre-1-0.0 00002000:00080000:3.0:1783441652.093651:0:14799:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0001: adding sequence 0x280000400 00002000:00080000:3.0:1783441652.093669:0:14799:0:(ofd_dev.c:1640:ofd_create_hdl()) ofd_last_id() = 33 -> diff = -28 00002000:02000040:3.0:1783441652.093677:0:14799:0:(ofd_dev.c:1491:ofd_orphans_destroy()) lustre-OST0001: new connection from lustre-MDT0000-mdtlov (cleaning up unused objects from 0x280000400:6 to 0x280000400:33) 00000004:00080000:2.0:1783441652.094138:0:14186:0:(osp_sync.c:1045:osp_sync_process_record()) processed all old entries 00000004:00080000:2.0:1783441652.094563:0:14186:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 489968820506ns, next at 0ns, rc = 0 00000100:00100000:2.0:1783441652.094877:0:3303:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff91a745a78380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3303:1870073693314176:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1783441652.095148:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00080000:2.0:1783441652.095218:0:3303:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff91a874dcdc00 x1870073693313792/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1783441668 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1783441652.095236:0:3303:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff91a874dcdc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3303:1870073693313792:0@lo:400:kworker.0 00000100:00100000:2.0:1783441652.095316:0:14801:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073693314176 00000100:00100000:2.0:1783441652.095325:0:14801:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073693314176 00000100:00100000:2.0:1783441652.095383:0:14801:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1783441652.095393:0:14801:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a859085180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3303:x1870073693314176:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1783441652.095439:0:14801:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40960000 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1783441652.095492:0:14801:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a859085180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3303:x1870073693314176:12345-0@lo:13:osp-pre-1-0.0 Request processed in 100us (345us total) trans 0 rc 0/0 00000100:00100000:2.0:1783441652.095510:0:14801:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00080000:2.0:1783441652.095551:0:3303:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff91a745a78380 x1870073693314176/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1783441668 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1783441652.095570:0:3303:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff91a745a78380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3303:1870073693314176:0@lo:13:osp-pre-1-0.0 00000100:00080000:2.0:1783441652.095864:0:14159:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00002000:00010000:3.0:1783441652.134426:0:14799:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x21:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1783441652.134443:0:14799:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000d12f77e9/0xa2426164df2c8a4b lrc: 3/0,1 mode: --/PW res: [0x280000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783441652.134467:0:14799:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x21:0x0].0x0 since=490s v=(0 0) 00010000:00010000:3.0:1783441652.134473:0:14799:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x21:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1783441652.134480:0:14799:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000d12f77e9/0xa2426164df2c8a4b lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783441652.134502:0:14799:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000d12f77e9/0xa2426164df2c8a4b lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783441652.134514:0:14799:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000d12f77e9/0xa2426164df2c8a4b lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783441652.134535:0:14799:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000d12f77e9/0xa2426164df2c8a4b lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783441652.134561:0:14799:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1783441652.134580:0:14152:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1783441652.134588:0:14152:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000d12f77e9/0xa2426164df2c8a4b lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783441652.134597:0:14152:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91a841477800 already unused, calling callback (ffffffffc155ff90) 00010000:00010000:3.0:1783441652.134602:0:14152:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000d12f77e9/0xa2426164df2c8a4b lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783441652.134792:0:14152:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000d12f77e9/0xa2426164df2c8a4b lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783441652.134816:0:14152:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000d12f77e9/0xa2426164df2c8a4b lrc: 1/0,0 mode: --/PW res: [0x280000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783441652.134824:0:14152:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000d12f77e9/0xa2426164df2c8a4b lrc: 0/0,0 mode: --/PW res: [0x280000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783441652.134849:0:14152:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783441652.134851:0:14152:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783441652.134852:0:14152:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1783441652.135451:0:14799:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x20:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1783441652.135466:0:14799:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000f0cc14ae/0xa2426164df2c8a52 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783441652.135478:0:14799:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x20:0x0].0x0 since=490s v=(0 0) 00010000:00010000:3.0:1783441652.135483:0:14799:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x20:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1783441652.135488:0:14799:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000f0cc14ae/0xa2426164df2c8a52 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783441652.135499:0:14799:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000f0cc14ae/0xa2426164df2c8a52 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783441652.135507:0:14799:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000f0cc14ae/0xa2426164df2c8a52 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783441652.135515:0:14799:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000f0cc14ae/0xa2426164df2c8a52 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783441652.135542:0:14799:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1783441652.135724:0:14151:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1783441652.135732:0:14151:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000f0cc14ae/0xa2426164df2c8a52 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783441652.135781:0:14151:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91a841476000 already unused, calling callback (ffffffffc155ff90) 00010000:00010000:0.0:1783441652.135792:0:14151:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000f0cc14ae/0xa2426164df2c8a52 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783441652.135802:0:14151:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000f0cc14ae/0xa2426164df2c8a52 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783441652.135820:0:14151:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000f0cc14ae/0xa2426164df2c8a52 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783441652.135828:0:14151:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000f0cc14ae/0xa2426164df2c8a52 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783441652.135848:0:14151:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783441652.135850:0:14151:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783441652.135852:0:14151:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1783441652.143179:0:14799:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x1f:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1783441652.143196:0:14799:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000fcd45700/0xa2426164df2c8a59 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783441652.143219:0:14799:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1f:0x0].0x0 since=490s v=(0 0) 00010000:00010000:3.0:1783441652.143225:0:14799:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1f:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1783441652.143233:0:14799:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000fcd45700/0xa2426164df2c8a59 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783441652.143252:0:14799:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000fcd45700/0xa2426164df2c8a59 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783441652.143272:0:14799:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000fcd45700/0xa2426164df2c8a59 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783441652.143280:0:14799:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000fcd45700/0xa2426164df2c8a59 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783441652.143303:0:14799:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1783441652.143318:0:14152:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1783441652.143325:0:14152:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000fcd45700/0xa2426164df2c8a59 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783441652.143332:0:14152:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91a841477600 already unused, calling callback (ffffffffc155ff90) 00010000:00010000:3.0:1783441652.143337:0:14152:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000fcd45700/0xa2426164df2c8a59 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783441652.143346:0:14152:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000fcd45700/0xa2426164df2c8a59 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783441652.143366:0:14152:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000fcd45700/0xa2426164df2c8a59 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783441652.143375:0:14152:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000fcd45700/0xa2426164df2c8a59 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783441652.143394:0:14152:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783441652.143401:0:14152:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783441652.143403:0:14152:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1783441652.143957:0:14799:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x1e:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1783441652.143964:0:14799:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000008d60687a/0xa2426164df2c8a60 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783441652.143977:0:14799:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1e:0x0].0x0 since=490s v=(0 0) 00010000:00010000:3.0:1783441652.143981:0:14799:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1e:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1783441652.143985:0:14799:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000008d60687a/0xa2426164df2c8a60 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783441652.143995:0:14799:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000008d60687a/0xa2426164df2c8a60 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783441652.144003:0:14799:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000008d60687a/0xa2426164df2c8a60 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783441652.144010:0:14799:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000008d60687a/0xa2426164df2c8a60 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783441652.144033:0:14799:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1783441652.144044:0:14151:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1783441652.144049:0:14151:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000008d60687a/0xa2426164df2c8a60 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783441652.144055:0:14151:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91a841477400 already unused, calling callback (ffffffffc155ff90) 00010000:00010000:3.0:1783441652.144059:0:14151:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000008d60687a/0xa2426164df2c8a60 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783441652.144079:0:14151:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000008d60687a/0xa2426164df2c8a60 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783441652.144093:0:14151:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000008d60687a/0xa2426164df2c8a60 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783441652.144101:0:14151:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000008d60687a/0xa2426164df2c8a60 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783441652.144114:0:14151:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783441652.144116:0:14151:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783441652.144117:0:14151:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1783441652.144611:0:14799:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x1d:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1783441652.144618:0:14799:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000eee52c45/0xa2426164df2c8a67 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783441652.144628:0:14799:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1d:0x0].0x0 since=490s v=(0 0) 00010000:00010000:3.0:1783441652.144632:0:14799:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1d:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1783441652.144636:0:14799:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000eee52c45/0xa2426164df2c8a67 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783441652.144645:0:14799:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000eee52c45/0xa2426164df2c8a67 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783441652.144655:0:14799:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000eee52c45/0xa2426164df2c8a67 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783441652.144670:0:14799:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000eee52c45/0xa2426164df2c8a67 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783441652.144709:0:14799:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1783441652.144836:0:14152:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1783441652.144843:0:14152:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000eee52c45/0xa2426164df2c8a67 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783441652.144852:0:14152:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91a841477e00 already unused, calling callback (ffffffffc155ff90) 00010000:00010000:2.0:1783441652.144856:0:14152:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000eee52c45/0xa2426164df2c8a67 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783441652.144865:0:14152:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000eee52c45/0xa2426164df2c8a67 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783441652.144881:0:14152:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000eee52c45/0xa2426164df2c8a67 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783441652.144889:0:14152:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000eee52c45/0xa2426164df2c8a67 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783441652.144906:0:14152:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783441652.144907:0:14152:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783441652.144909:0:14152:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1783441652.145146:0:14799:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x1c:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1783441652.145152:0:14799:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000002b893fc3/0xa2426164df2c8a6e lrc: 3/0,1 mode: --/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783441652.145161:0:14799:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1c:0x0].0x0 since=490s v=(0 0) 00010000:00010000:3.0:1783441652.145164:0:14799:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1c:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1783441652.145168:0:14799:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000002b893fc3/0xa2426164df2c8a6e lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783441652.145178:0:14799:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000002b893fc3/0xa2426164df2c8a6e lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783441652.145186:0:14799:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000002b893fc3/0xa2426164df2c8a6e lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783441652.145194:0:14799:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000002b893fc3/0xa2426164df2c8a6e lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783441652.145216:0:14799:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1783441652.145234:0:14151:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1783441652.145245:0:14151:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000002b893fc3/0xa2426164df2c8a6e lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783441652.145253:0:14151:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91a85eb3d400 already unused, calling callback (ffffffffc155ff90) 00010000:00010000:2.0:1783441652.145257:0:14151:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000002b893fc3/0xa2426164df2c8a6e lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783441652.145265:0:14151:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000002b893fc3/0xa2426164df2c8a6e lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783441652.145277:0:14151:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000002b893fc3/0xa2426164df2c8a6e lrc: 1/0,0 mode: --/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783441652.145284:0:14151:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000002b893fc3/0xa2426164df2c8a6e lrc: 0/0,0 mode: --/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783441652.145297:0:14151:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783441652.145299:0:14151:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783441652.145301:0:14151:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1783441652.145616:0:14799:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x1b:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1783441652.145622:0:14799:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000002405f75e/0xa2426164df2c8a75 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783441652.145636:0:14799:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1b:0x0].0x0 since=490s v=(0 0) 00010000:00010000:3.0:1783441652.145640:0:14799:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1b:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1783441652.145644:0:14799:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000002405f75e/0xa2426164df2c8a75 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783441652.145653:0:14799:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000002405f75e/0xa2426164df2c8a75 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783441652.145662:0:14799:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000002405f75e/0xa2426164df2c8a75 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783441652.145670:0:14799:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000002405f75e/0xa2426164df2c8a75 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783441652.148829:0:14799:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1783441652.148870:0:14152:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1783441652.148882:0:14152:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000002405f75e/0xa2426164df2c8a75 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783441652.148900:0:14152:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91a85eb3ca00 already unused, calling callback (ffffffffc155ff90) 00010000:00010000:3.0:1783441652.148908:0:14152:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000002405f75e/0xa2426164df2c8a75 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783441652.148922:0:14152:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000002405f75e/0xa2426164df2c8a75 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783441652.148966:0:14152:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000002405f75e/0xa2426164df2c8a75 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783441652.148976:0:14152:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000002405f75e/0xa2426164df2c8a75 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783441652.149006:0:14152:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783441652.149008:0:14152:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783441652.149011:0:14152:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1783441652.151074:0:14799:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x1a:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1783441652.151475:0:14799:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000c0afc6c2/0xa2426164df2c8a7c lrc: 3/0,1 mode: --/PW res: [0x280000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783441652.151497:0:14799:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1a:0x0].0x0 since=490s v=(0 0) 00010000:00010000:3.0:1783441652.151502:0:14799:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1a:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1783441652.151509:0:14799:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000c0afc6c2/0xa2426164df2c8a7c lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783441652.151526:0:14799:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000c0afc6c2/0xa2426164df2c8a7c lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783441652.151540:0:14799:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000c0afc6c2/0xa2426164df2c8a7c lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783441652.151548:0:14799:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000c0afc6c2/0xa2426164df2c8a7c lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783441652.151603:0:14799:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1783441652.151800:0:14151:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1783441652.151810:0:14151:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000c0afc6c2/0xa2426164df2c8a7c lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783441652.151818:0:14151:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91a85eb3d800 already unused, calling callback (ffffffffc155ff90) 00010000:00010000:3.0:1783441652.151824:0:14151:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000c0afc6c2/0xa2426164df2c8a7c lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783441652.151835:0:14151:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000c0afc6c2/0xa2426164df2c8a7c lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783441652.151855:0:14151:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000c0afc6c2/0xa2426164df2c8a7c lrc: 1/0,0 mode: --/PW res: [0x280000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783441652.151863:0:14151:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000c0afc6c2/0xa2426164df2c8a7c lrc: 0/0,0 mode: --/PW res: [0x280000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783441652.151890:0:14151:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783441652.151892:0:14151:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783441652.151893:0:14151:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1783441652.158166:0:14799:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x19:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1783441652.158186:0:14799:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000000af3527/0xa2426164df2c8a83 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783441652.158210:0:14799:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x19:0x0].0x0 since=490s v=(0 0) 00010000:00010000:3.0:1783441652.158227:0:14799:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x19:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1783441652.158236:0:14799:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000000af3527/0xa2426164df2c8a83 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783441652.158254:0:14799:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000000af3527/0xa2426164df2c8a83 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783441652.158267:0:14799:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000000af3527/0xa2426164df2c8a83 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783441652.158275:0:14799:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000000af3527/0xa2426164df2c8a83 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783441652.158314:0:14799:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1783441652.159506:0:14152:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1783441652.159521:0:14152:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000000af3527/0xa2426164df2c8a83 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783441652.159535:0:14152:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91a85eb3c000 already unused, calling callback (ffffffffc155ff90) 00010000:00010000:2.0:1783441652.159542:0:14152:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000000af3527/0xa2426164df2c8a83 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783441652.159568:0:14152:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000000af3527/0xa2426164df2c8a83 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783441652.159596:0:14152:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000000af3527/0xa2426164df2c8a83 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783441652.159603:0:14152:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000000af3527/0xa2426164df2c8a83 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783441652.159707:0:14152:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783441652.159710:0:14152:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783441652.159712:0:14152:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1783441652.159861:0:14799:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x18:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1783441652.159870:0:14799:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000a72d8b4d/0xa2426164df2c8a8a lrc: 3/0,1 mode: --/PW res: [0x280000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783441652.159885:0:14799:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x18:0x0].0x0 since=490s v=(0 0) 00010000:00010000:3.0:1783441652.159890:0:14799:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x18:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1783441652.159897:0:14799:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000a72d8b4d/0xa2426164df2c8a8a lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783441652.159909:0:14799:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000a72d8b4d/0xa2426164df2c8a8a lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783441652.159919:0:14799:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000a72d8b4d/0xa2426164df2c8a8a lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783441652.159932:0:14799:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000a72d8b4d/0xa2426164df2c8a8a lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783441652.159958:0:14799:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1783441652.160413:0:14151:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1783441652.160420:0:14151:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000a72d8b4d/0xa2426164df2c8a8a lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783441652.160430:0:14151:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91a85eb3c800 already unused, calling callback (ffffffffc155ff90) 00010000:00010000:2.0:1783441652.160434:0:14151:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000a72d8b4d/0xa2426164df2c8a8a lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783441652.160443:0:14151:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000a72d8b4d/0xa2426164df2c8a8a lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783441652.160458:0:14151:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000a72d8b4d/0xa2426164df2c8a8a lrc: 1/0,0 mode: --/PW res: [0x280000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783441652.160478:0:14151:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000a72d8b4d/0xa2426164df2c8a8a lrc: 0/0,0 mode: --/PW res: [0x280000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783441652.160493:0:14151:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783441652.160495:0:14151:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783441652.160497:0:14151:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1783441652.160608:0:14799:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x17:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1783441652.160614:0:14799:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000ac5ced0e/0xa2426164df2c8a91 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783441652.160625:0:14799:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x17:0x0].0x0 since=490s v=(0 0) 00010000:00010000:3.0:1783441652.160629:0:14799:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x17:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1783441652.160633:0:14799:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000ac5ced0e/0xa2426164df2c8a91 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783441652.160642:0:14799:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000ac5ced0e/0xa2426164df2c8a91 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783441652.160649:0:14799:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000ac5ced0e/0xa2426164df2c8a91 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783441652.160656:0:14799:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000ac5ced0e/0xa2426164df2c8a91 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783441652.160671:0:14799:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:3.0:1783441652.163246:0:14799:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x16:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1783441652.163265:0:14799:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000002ec9816f/0xa2426164df2c8a98 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783441652.163304:0:14799:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x16:0x0].0x0 since=490s v=(0 0) 00010000:00010000:3.0:1783441652.163310:0:14799:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x16:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1783441652.163318:0:14799:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000002ec9816f/0xa2426164df2c8a98 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783441652.163334:0:14799:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000002ec9816f/0xa2426164df2c8a98 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783441652.163346:0:14799:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000002ec9816f/0xa2426164df2c8a98 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783441652.163355:0:14799:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000002ec9816f/0xa2426164df2c8a98 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783441652.163463:0:14799:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:3.0:1783441652.163490:0:14151:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1783441652.163498:0:14151:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000ac5ced0e/0xa2426164df2c8a91 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783441652.163508:0:14151:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91a85eb3de00 already unused, calling callback (ffffffffc155ff90) 00010000:00010000:3.0:1783441652.163513:0:14151:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000ac5ced0e/0xa2426164df2c8a91 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783441652.163524:0:14151:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000ac5ced0e/0xa2426164df2c8a91 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783441652.163555:0:14151:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000ac5ced0e/0xa2426164df2c8a91 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783441652.163563:0:14151:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000ac5ced0e/0xa2426164df2c8a91 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783441652.163587:0:14151:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1783441652.163591:0:14151:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000002ec9816f/0xa2426164df2c8a98 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783441652.163598:0:14151:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91a85eb3dc00 already unused, calling callback (ffffffffc155ff90) 00010000:00010000:3.0:1783441652.163601:0:14151:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000002ec9816f/0xa2426164df2c8a98 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783441652.164245:0:14151:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000002ec9816f/0xa2426164df2c8a98 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783441652.164267:0:14151:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000002ec9816f/0xa2426164df2c8a98 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783441652.164274:0:14151:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000002ec9816f/0xa2426164df2c8a98 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783441652.164293:0:14151:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783441652.164295:0:14151:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783441652.164307:0:14151:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783441652.167010:0:14152:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1783441652.167925:0:14799:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x15:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1783441652.167941:0:14799:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000065507aa1/0xa2426164df2c8a9f lrc: 3/0,1 mode: --/PW res: [0x280000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783441652.167964:0:14799:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x15:0x0].0x0 since=490s v=(0 0) 00010000:00010000:3.0:1783441652.167970:0:14799:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x15:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1783441652.167979:0:14799:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000065507aa1/0xa2426164df2c8a9f lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783441652.167995:0:14799:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000065507aa1/0xa2426164df2c8a9f lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783441652.168007:0:14799:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000065507aa1/0xa2426164df2c8a9f lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783441652.168015:0:14799:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000065507aa1/0xa2426164df2c8a9f lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783441652.168043:0:14799:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1783441652.168067:0:14151:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1783441652.168074:0:14151:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000065507aa1/0xa2426164df2c8a9f lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783441652.168229:0:14151:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91a85eb3c600 already unused, calling callback (ffffffffc155ff90) 00010000:00010000:3.0:1783441652.168236:0:14151:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000065507aa1/0xa2426164df2c8a9f lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783441652.168262:0:14151:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000065507aa1/0xa2426164df2c8a9f lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783441652.168283:0:14151:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000065507aa1/0xa2426164df2c8a9f lrc: 1/0,0 mode: --/PW res: [0x280000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783441652.168290:0:14151:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000065507aa1/0xa2426164df2c8a9f lrc: 0/0,0 mode: --/PW res: [0x280000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783441652.168315:0:14151:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783441652.168317:0:14151:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783441652.168319:0:14151:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1783441652.171986:0:14799:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x14:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1783441652.172007:0:14799:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000008550020f/0xa2426164df2c8aa6 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783441652.172031:0:14799:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x14:0x0].0x0 since=490s v=(0 0) 00010000:00010000:3.0:1783441652.172037:0:14799:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x14:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1783441652.172045:0:14799:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000008550020f/0xa2426164df2c8aa6 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783441652.172062:0:14799:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000008550020f/0xa2426164df2c8aa6 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783441652.172073:0:14799:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000008550020f/0xa2426164df2c8aa6 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783441652.173517:0:14799:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000008550020f/0xa2426164df2c8aa6 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783441652.173565:0:14799:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1783441652.175968:0:14152:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1783441652.175986:0:14152:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000008550020f/0xa2426164df2c8aa6 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783441652.176005:0:14152:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91a85eb3c200 already unused, calling callback (ffffffffc155ff90) 00010000:00010000:0.0:1783441652.176012:0:14152:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000008550020f/0xa2426164df2c8aa6 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783441652.176025:0:14152:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000008550020f/0xa2426164df2c8aa6 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783441652.176053:0:14152:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000008550020f/0xa2426164df2c8aa6 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783441652.176074:0:14152:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000008550020f/0xa2426164df2c8aa6 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783441652.176107:0:14152:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783441652.176110:0:14152:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783441652.176112:0:14152:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1783441652.180229:0:14799:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x13:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1783441652.180250:0:14799:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000000689d3d2/0xa2426164df2c8aad lrc: 3/0,1 mode: --/PW res: [0x280000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783441652.180273:0:14799:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x13:0x0].0x0 since=490s v=(0 0) 00010000:00010000:3.0:1783441652.180279:0:14799:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x13:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1783441652.180286:0:14799:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000000689d3d2/0xa2426164df2c8aad lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783441652.180303:0:14799:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000000689d3d2/0xa2426164df2c8aad lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783441652.180316:0:14799:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000000689d3d2/0xa2426164df2c8aad lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783441652.180325:0:14799:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000000689d3d2/0xa2426164df2c8aad lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783441652.180369:0:14799:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:3.0:1783441652.182728:0:14799:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x12:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1783441652.182762:0:14799:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000002447fd4e/0xa2426164df2c8ab4 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783441652.182792:0:14799:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x12:0x0].0x0 since=490s v=(0 0) 00010000:00010000:3.0:1783441652.182798:0:14799:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x12:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1783441652.182805:0:14799:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000002447fd4e/0xa2426164df2c8ab4 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783441652.182822:0:14799:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000002447fd4e/0xa2426164df2c8ab4 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783441652.182834:0:14799:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000002447fd4e/0xa2426164df2c8ab4 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783441652.182842:0:14799:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000002447fd4e/0xa2426164df2c8ab4 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783441652.182867:0:14799:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00002000:00010000:3.0:1783441652.183312:0:14799:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x11:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1783441652.183319:0:14799:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000005a18b047/0xa2426164df2c8abb lrc: 3/0,1 mode: --/PW res: [0x280000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783441652.183329:0:14799:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x11:0x0].0x0 since=490s v=(0 0) 00010000:00010000:3.0:1783441652.183332:0:14799:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x11:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1783441652.183336:0:14799:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000005a18b047/0xa2426164df2c8abb lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783441652.183345:0:14799:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000005a18b047/0xa2426164df2c8abb lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783441652.183364:0:14799:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000005a18b047/0xa2426164df2c8abb lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783441652.183371:0:14799:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000005a18b047/0xa2426164df2c8abb lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783441652.183378:0:14799:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to regular blp list, 3 blwis in pool 00002000:00010000:3.0:1783441652.184110:0:14799:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x10:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1783441652.184118:0:14799:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000002405f75e/0xa2426164df2c8ac2 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783441652.184131:0:14799:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x10:0x0].0x0 since=490s v=(0 0) 00010000:00010000:3.0:1783441652.184134:0:14799:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x10:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1783441652.184139:0:14799:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000002405f75e/0xa2426164df2c8ac2 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783441652.184149:0:14799:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000002405f75e/0xa2426164df2c8ac2 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783441652.184158:0:14799:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000002405f75e/0xa2426164df2c8ac2 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783441652.184168:0:14799:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000002405f75e/0xa2426164df2c8ac2 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783441652.184235:0:14799:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/4 locks to regular blp list, 4 blwis in pool 00010000:00010000:1.0:1783441652.184639:0:14152:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 3 total in blp. (3 blwis in pool) 00010000:00010000:1.0:1783441652.184649:0:14152:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000000689d3d2/0xa2426164df2c8aad lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783441652.184660:0:14152:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91a85eb3d000 already unused, calling callback (ffffffffc155ff90) 00010000:00010000:1.0:1783441652.184666:0:14152:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000000689d3d2/0xa2426164df2c8aad lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783441652.184688:0:14152:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000000689d3d2/0xa2426164df2c8aad lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783441652.184716:0:14152:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000000689d3d2/0xa2426164df2c8aad lrc: 1/0,0 mode: --/PW res: [0x280000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783441652.184723:0:14152:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000000689d3d2/0xa2426164df2c8aad lrc: 0/0,0 mode: --/PW res: [0x280000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783441652.184770:0:14152:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:1.0:1783441652.184776:0:14152:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000002447fd4e/0xa2426164df2c8ab4 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783441652.184783:0:14152:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91a85eb3ce00 already unused, calling callback (ffffffffc155ff90) 00010000:00010000:1.0:1783441652.184795:0:14152:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000002447fd4e/0xa2426164df2c8ab4 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783441652.184804:0:14152:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000002447fd4e/0xa2426164df2c8ab4 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783441652.184815:0:14152:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000002447fd4e/0xa2426164df2c8ab4 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783441652.184821:0:14152:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000002447fd4e/0xa2426164df2c8ab4 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783441652.184835:0:14152:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1783441652.184838:0:14152:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000005a18b047/0xa2426164df2c8abb lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783441652.184844:0:14152:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91a85eb3d600 already unused, calling callback (ffffffffc155ff90) 00010000:00010000:1.0:1783441652.184847:0:14152:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000005a18b047/0xa2426164df2c8abb lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783441652.184853:0:14152:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000005a18b047/0xa2426164df2c8abb lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783441652.184862:0:14152:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000005a18b047/0xa2426164df2c8abb lrc: 1/0,0 mode: --/PW res: [0x280000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783441652.184868:0:14152:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000005a18b047/0xa2426164df2c8abb lrc: 0/0,0 mode: --/PW res: [0x280000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783441652.184887:0:14152:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1783441652.184890:0:14152:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000002405f75e/0xa2426164df2c8ac2 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783441652.184896:0:14152:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91a85eb3ca00 already unused, calling callback (ffffffffc155ff90) 00010000:00010000:1.0:1783441652.184899:0:14152:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000002405f75e/0xa2426164df2c8ac2 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783441652.184906:0:14152:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000002405f75e/0xa2426164df2c8ac2 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783441652.184916:0:14152:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000002405f75e/0xa2426164df2c8ac2 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783441652.184922:0:14152:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000002405f75e/0xa2426164df2c8ac2 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783441652.184934:0:14152:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783441652.184936:0:14152:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783441652.184937:0:14152:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783441652.188071:0:14151:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1783441652.202038:0:14799:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0xf:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1783441652.202060:0:14799:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000c5d6d16a/0xa2426164df2c8ac9 lrc: 3/0,1 mode: --/PW res: [0x280000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783441652.202143:0:14799:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xf:0x0].0x0 since=490s v=(0 0) 00010000:00010000:3.0:1783441652.202150:0:14799:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xf:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1783441652.202157:0:14799:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000c5d6d16a/0xa2426164df2c8ac9 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783441652.202175:0:14799:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000c5d6d16a/0xa2426164df2c8ac9 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783441652.202188:0:14799:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000c5d6d16a/0xa2426164df2c8ac9 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783441652.202196:0:14799:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000c5d6d16a/0xa2426164df2c8ac9 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783441652.202276:0:14799:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:3.0:1783441652.211022:0:14799:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0xe:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1783441652.211044:0:14799:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000ac5ced0e/0xa2426164df2c8ad0 lrc: 3/0,1 mode: --/PW res: [0x280000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783441652.211067:0:14799:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xe:0x0].0x0 since=490s v=(0 0) 00010000:00010000:3.0:1783441652.211082:0:14799:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xe:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1783441652.211090:0:14799:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000ac5ced0e/0xa2426164df2c8ad0 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783441652.211108:0:14799:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000ac5ced0e/0xa2426164df2c8ad0 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783441652.211120:0:14799:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000ac5ced0e/0xa2426164df2c8ad0 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783441652.211129:0:14799:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000ac5ced0e/0xa2426164df2c8ad0 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783441652.211859:0:14152:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1783441652.211871:0:14152:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000c5d6d16a/0xa2426164df2c8ac9 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783441652.211883:0:14152:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91a85eb3d200 already unused, calling callback (ffffffffc155ff90) 00010000:00010000:0.0:1783441652.211889:0:14152:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000c5d6d16a/0xa2426164df2c8ac9 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783441652.211900:0:14152:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000c5d6d16a/0xa2426164df2c8ac9 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783441652.211925:0:14152:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000c5d6d16a/0xa2426164df2c8ac9 lrc: 1/0,0 mode: --/PW res: [0x280000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783441652.211933:0:14152:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000c5d6d16a/0xa2426164df2c8ac9 lrc: 0/0,0 mode: --/PW res: [0x280000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783441652.212070:0:14152:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1783441652.212076:0:14152:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000ac5ced0e/0xa2426164df2c8ad0 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783441652.212083:0:14152:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91a85eb3de00 already unused, calling callback (ffffffffc155ff90) 00010000:00010000:1.0:1783441652.212095:0:14152:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000ac5ced0e/0xa2426164df2c8ad0 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783441652.212103:0:14152:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000ac5ced0e/0xa2426164df2c8ad0 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783441652.212115:0:14152:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000ac5ced0e/0xa2426164df2c8ad0 lrc: 2/0,0 mode: --/PW res: [0x280000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783441652.212123:0:14152:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783441652.212124:0:14152:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783441652.212127:0:14152:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783441652.213536:0:14799:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:3.0:1783441652.213555:0:14799:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000ac5ced0e/0xa2426164df2c8ad0 lrc: 0/0,0 mode: --/PW res: [0x280000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783441652.214842:0:14151:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00080000:2.0:1783441652.230110:0:5807:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1 committed 00002000:00010000:2.0:1783441652.231409:0:14799:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0xd:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1783441652.231426:0:14799:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000f6e86bfc/0xa2426164df2c8ad7 lrc: 3/0,1 mode: --/PW res: [0x280000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783441652.231449:0:14799:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xd:0x0].0x0 since=490s v=(0 0) 00010000:00010000:2.0:1783441652.231455:0:14799:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xd:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1783441652.231463:0:14799:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000f6e86bfc/0xa2426164df2c8ad7 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783441652.231481:0:14799:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000f6e86bfc/0xa2426164df2c8ad7 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783441652.231493:0:14799:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000f6e86bfc/0xa2426164df2c8ad7 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783441652.231501:0:14799:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000f6e86bfc/0xa2426164df2c8ad7 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783441652.231542:0:14799:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:2.0:1783441652.232236:0:14799:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0xc:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1783441652.232243:0:14799:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000006656bc4f/0xa2426164df2c8ade lrc: 3/0,1 mode: --/PW res: [0x280000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783441652.232255:0:14799:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xc:0x0].0x0 since=490s v=(0 0) 00010000:00010000:2.0:1783441652.232259:0:14799:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xc:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1783441652.232264:0:14799:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000006656bc4f/0xa2426164df2c8ade lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783441652.232275:0:14799:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000006656bc4f/0xa2426164df2c8ade lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783441652.232284:0:14799:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000006656bc4f/0xa2426164df2c8ade lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783441652.232292:0:14799:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000006656bc4f/0xa2426164df2c8ade lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783441652.232313:0:14799:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:2.0:1783441652.232332:0:14151:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1783441652.232340:0:14151:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000f6e86bfc/0xa2426164df2c8ad7 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783441652.232349:0:14151:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91a85f83c000 already unused, calling callback (ffffffffc155ff90) 00010000:00010000:2.0:1783441652.232362:0:14151:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000f6e86bfc/0xa2426164df2c8ad7 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783441652.232374:0:14151:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000f6e86bfc/0xa2426164df2c8ad7 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783441652.232397:0:14151:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000f6e86bfc/0xa2426164df2c8ad7 lrc: 1/0,0 mode: --/PW res: [0x280000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783441652.232405:0:14151:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000f6e86bfc/0xa2426164df2c8ad7 lrc: 0/0,0 mode: --/PW res: [0x280000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783441652.232429:0:14151:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1783441652.232433:0:14151:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000006656bc4f/0xa2426164df2c8ade lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783441652.232440:0:14151:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91a85f83da00 already unused, calling callback (ffffffffc155ff90) 00010000:00010000:2.0:1783441652.232443:0:14151:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000006656bc4f/0xa2426164df2c8ade lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783441652.232451:0:14151:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000006656bc4f/0xa2426164df2c8ade lrc: 3/0,0 mode: PW/PW res: [0x280000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783441652.232462:0:14151:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000006656bc4f/0xa2426164df2c8ade lrc: 1/0,0 mode: --/PW res: [0x280000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783441652.232470:0:14151:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000006656bc4f/0xa2426164df2c8ade lrc: 0/0,0 mode: --/PW res: [0x280000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783441652.232491:0:14151:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783441652.232493:0:14151:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783441652.232495:0:14151:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1783441652.232988:0:14799:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0xb:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1783441652.232995:0:14799:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000004f538221/0xa2426164df2c8ae5 lrc: 3/0,1 mode: --/PW res: [0x280000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783441652.233006:0:14799:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xb:0x0].0x0 since=490s v=(0 0) 00010000:00010000:2.0:1783441652.233009:0:14799:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xb:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1783441652.233015:0:14799:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000004f538221/0xa2426164df2c8ae5 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783441652.233025:0:14799:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000004f538221/0xa2426164df2c8ae5 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783441652.233033:0:14799:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000004f538221/0xa2426164df2c8ae5 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783441652.233041:0:14799:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000004f538221/0xa2426164df2c8ae5 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783441652.233059:0:14799:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1783441652.233068:0:14151:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1783441652.233072:0:14151:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000004f538221/0xa2426164df2c8ae5 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783441652.233091:0:14151:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91a85f83c400 already unused, calling callback (ffffffffc155ff90) 00010000:00010000:2.0:1783441652.233095:0:14151:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000004f538221/0xa2426164df2c8ae5 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783441652.233104:0:14151:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000004f538221/0xa2426164df2c8ae5 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783441652.233116:0:14151:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000004f538221/0xa2426164df2c8ae5 lrc: 1/0,0 mode: --/PW res: [0x280000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783441652.233124:0:14151:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000004f538221/0xa2426164df2c8ae5 lrc: 0/0,0 mode: --/PW res: [0x280000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783441652.233137:0:14151:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783441652.233139:0:14151:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783441652.233141:0:14151:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783441652.233827:0:14152:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1783441652.240566:0:14799:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0xa:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1783441652.240586:0:14799:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000bee70992/0xa2426164df2c8aec lrc: 3/0,1 mode: --/PW res: [0x280000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783441652.240610:0:14799:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xa:0x0].0x0 since=490s v=(0 0) 00010000:00010000:2.0:1783441652.240616:0:14799:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xa:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1783441652.240624:0:14799:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000bee70992/0xa2426164df2c8aec lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783441652.240643:0:14799:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000bee70992/0xa2426164df2c8aec lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783441652.240664:0:14799:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000bee70992/0xa2426164df2c8aec lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783441652.240674:0:14799:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000bee70992/0xa2426164df2c8aec lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783441652.240710:0:14799:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1783441652.240732:0:14151:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1783441652.240738:0:14151:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000bee70992/0xa2426164df2c8aec lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783441652.240769:0:14151:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91a85f83d800 already unused, calling callback (ffffffffc155ff90) 00010000:00010000:2.0:1783441652.240775:0:14151:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000bee70992/0xa2426164df2c8aec lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783441652.240784:0:14151:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000bee70992/0xa2426164df2c8aec lrc: 3/0,0 mode: PW/PW res: [0x280000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783441652.240807:0:14151:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000bee70992/0xa2426164df2c8aec lrc: 1/0,0 mode: --/PW res: [0x280000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783441652.240815:0:14151:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000bee70992/0xa2426164df2c8aec lrc: 0/0,0 mode: --/PW res: [0x280000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783441652.240837:0:14151:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783441652.240845:0:14151:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783441652.240847:0:14151:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1783441652.242614:0:14799:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x9:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1783441652.242628:0:14799:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000077cced6c/0xa2426164df2c8af3 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783441652.242649:0:14799:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x9:0x0].0x0 since=490s v=(0 0) 00010000:00010000:2.0:1783441652.242655:0:14799:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x9:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1783441652.242661:0:14799:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000077cced6c/0xa2426164df2c8af3 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783441652.242675:0:14799:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000077cced6c/0xa2426164df2c8af3 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783441652.242697:0:14799:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000077cced6c/0xa2426164df2c8af3 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783441652.242705:0:14799:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000077cced6c/0xa2426164df2c8af3 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783441652.242830:0:14799:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:2.0:1783441652.243864:0:14799:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x8:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1783441652.243877:0:14799:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000000f13d6dc/0xa2426164df2c8afa lrc: 3/0,1 mode: --/PW res: [0x280000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783441652.243894:0:14799:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x8:0x0].0x0 since=490s v=(0 0) 00010000:00010000:2.0:1783441652.243898:0:14799:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x8:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1783441652.243904:0:14799:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000000f13d6dc/0xa2426164df2c8afa lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783441652.243924:0:14799:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000000f13d6dc/0xa2426164df2c8afa lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783441652.243934:0:14799:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000000f13d6dc/0xa2426164df2c8afa lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783441652.243942:0:14799:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000000f13d6dc/0xa2426164df2c8afa lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783441652.244439:0:14152:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1783441652.244451:0:14152:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000077cced6c/0xa2426164df2c8af3 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783441652.244460:0:14152:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91a85f83cc00 already unused, calling callback (ffffffffc155ff90) 00010000:00010000:3.0:1783441652.244466:0:14152:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000077cced6c/0xa2426164df2c8af3 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783441652.244477:0:14152:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000077cced6c/0xa2426164df2c8af3 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783441652.244506:0:14152:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000077cced6c/0xa2426164df2c8af3 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783441652.244513:0:14152:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000077cced6c/0xa2426164df2c8af3 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783441652.244535:0:14152:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1783441652.244539:0:14152:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000000f13d6dc/0xa2426164df2c8afa lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783441652.244545:0:14152:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91a85f83dc00 already unused, calling callback (ffffffffc155ff90) 00010000:00010000:3.0:1783441652.244549:0:14152:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000000f13d6dc/0xa2426164df2c8afa lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783441652.244556:0:14152:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000000f13d6dc/0xa2426164df2c8afa lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783441652.244565:0:14152:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000000f13d6dc/0xa2426164df2c8afa lrc: 2/0,0 mode: --/PW res: [0x280000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783441652.244572:0:14152:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783441652.244574:0:14152:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783441652.244576:0:14152:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783441652.244621:0:14799:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:2.0:1783441652.244627:0:14799:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000000f13d6dc/0xa2426164df2c8afa lrc: 0/0,0 mode: --/PW res: [0x280000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1783441652.245396:0:14799:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x7:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1783441652.245407:0:14799:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000961b26f4/0xa2426164df2c8b01 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783441652.245421:0:14799:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x7:0x0].0x0 since=490s v=(0 0) 00010000:00010000:1.0:1783441652.245426:0:14799:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x7:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1783441652.245433:0:14799:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000961b26f4/0xa2426164df2c8b01 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783441652.245444:0:14799:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000961b26f4/0xa2426164df2c8b01 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783441652.245453:0:14799:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000961b26f4/0xa2426164df2c8b01 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783441652.245460:0:14799:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000961b26f4/0xa2426164df2c8b01 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783441652.245492:0:14799:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:1.0:1783441652.246126:0:14799:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x6:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1783441652.246133:0:14799:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000004c53ebee/0xa2426164df2c8b08 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783441652.246143:0:14799:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x6:0x0].0x0 since=490s v=(0 0) 00010000:00010000:1.0:1783441652.246147:0:14799:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1783441652.246151:0:14799:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000004c53ebee/0xa2426164df2c8b08 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783441652.246160:0:14799:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000004c53ebee/0xa2426164df2c8b08 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783441652.246168:0:14799:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000004c53ebee/0xa2426164df2c8b08 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783441652.246176:0:14799:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000004c53ebee/0xa2426164df2c8b08 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783441652.246184:0:14799:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:3.0:1783441652.246333:0:14151:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1783441652.246342:0:14151:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000961b26f4/0xa2426164df2c8b01 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783441652.246375:0:14151:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91a87da46c00 already unused, calling callback (ffffffffc155ff90) 00002000:00080000:1.0:1783441652.246376:0:14799:0:(ofd_dev.c:1518:ofd_orphans_destroy()) lustre-OST0001: after destroy: set last_id to 0x280000400:5 00010000:00010000:3.0:1783441652.246380:0:14151:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000961b26f4/0xa2426164df2c8b01 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783441652.246391:0:14151:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000961b26f4/0xa2426164df2c8b01 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783441652.246411:0:14151:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000961b26f4/0xa2426164df2c8b01 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783441652.246419:0:14151:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000961b26f4/0xa2426164df2c8b01 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783441652.246444:0:14151:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1783441652.246448:0:14151:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000004c53ebee/0xa2426164df2c8b08 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783441652.246454:0:14151:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91a87da46a00 already unused, calling callback (ffffffffc155ff90) 00010000:00010000:3.0:1783441652.246458:0:14151:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000004c53ebee/0xa2426164df2c8b08 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783441652.246465:0:14151:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000004c53ebee/0xa2426164df2c8b08 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783441652.246475:0:14151:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000004c53ebee/0xa2426164df2c8b08 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783441652.246487:0:14151:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000004c53ebee/0xa2426164df2c8b08 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783441652.246500:0:14151:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783441652.246502:0:14151:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783441652.246504:0:14151:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783441652.246664:0:14152:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1783441652.249866:0:14799:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a745a7b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:14187:x1870073693314304:12345-0@lo:5:osp-pre-1-0.0 Request processed in 161080us (161230us total) trans 0 rc 0/0 00000100:00100000:1.0:1783441652.249882:0:14799:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:2.0:1783441652.252068:0:14187:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff91a745a7ad80 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:14187:1870073693314304:0@lo:5:osp-pre-1-0.0 00000004:00080000:2.0:1783441652.252093:0:14187:0:(osp_precreate.c:960:osp_precreate_cleanup_orphans()) lustre-OST0001-osc-MDT0000: Got last_id [0x280000400:0x21:0x0] from OST, last_created [0x280000400:0x21:0x0]last_used is [0x280000400:0x5:0x0] 00000100:00100000:2.0:1783441652.252174:0:14187:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff91a859084a80 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:14187:1870073693314432:0@lo:5:osp-pre-1-0.0 00000100:00100000:2.0:1783441652.252249:0:14187:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783441652.252320:0:14187:0:(client.c:2702:ptlrpc_set_wait()) set ffff91a874cd76c0 going to sleep for 11 seconds 00000100:00100000:3.0:1783441652.252506:0:14798:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073693314432 00000100:00100000:3.0:1783441652.252515:0:14798:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073693314432 00000100:00100000:3.0:1783441652.252578:0:14798:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:3.0:1783441652.252589:0:14798:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a859084e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:14187:x1870073693314432:12345-0@lo:5:osp-pre-1-0.0 00002000:00080000:3.0:1783441652.252653:0:14798:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0001: reserve 32 objects in group 0x280000400 at 34 00000100:00100000:3.0:1783441652.272964:0:14798:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a859084e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+7:14187:x1870073693314432:12345-0@lo:5:osp-pre-1-0.0 Request processed in 20362us (20699us total) trans 8589934593 rc 0/0 00000100:00100000:3.0:1783441652.272985:0:14798:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:2.0:1783441652.282024:0:14187:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff91a859084a80 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:14187:1870073693314432:0@lo:5:osp-pre-1-0.0 00000004:00080000:2.0:1783441652.282058:0:14187:0:(osp_precreate.c:705:osp_precreate_send()) lustre-OST0001-osc-MDT0000: current precreated pool: [0x280000400:0x21:0x0]-[0x280000400:0x41:0x0] 00010000:00010000:0.0:1783441652.589162:0:14151:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783441653.613862:0:14152:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783441654.640078:0:14151:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1783441655.156842:0:3303:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1783441655.156871:0:3303:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff91a745551880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3303:1870073693314560:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1783441655.156946:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783441655.157040:0:14801:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073693314560 00000100:00100000:2.0:1783441655.157075:0:14801:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073693314560 00000100:00100000:2.0:1783441655.157188:0:14801:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1783441655.157204:0:14801:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a745551180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3303:x1870073693314560:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1783441655.157262:0:14801:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1783441655.157356:0:14801:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a745551180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3303:x1870073693314560:12345-0@lo:13:osp-pre-0-0.0 Request processed in 157us (410us total) trans 0 rc 0/0 00000100:00100000:2.0:1783441655.157365:0:14801:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00080000:2.0:1783441655.157402:0:14159:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1783441655.157435:0:3303:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff91a745551880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3303:1870073693314560:0@lo:13:osp-pre-0-0.0 00000001:02000400:1.0:1783441655.235362:0:15823:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg113-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00010000:00010000:2.0:1783441655.660903:0:14152:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783441656.685256:0:14151:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1783441657.196945:0:3303:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff91a745a7bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3303:1870073693314944:0@lo:400:kworker.0 00000100:00100000:3.0:1783441657.196967:0:3305:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff91a745a79500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:94394728-4014-4ef0-b525-989290f008aa:3305:1870073693314688:0@lo:400:kworker.0 00000100:00100000:0.0:1783441657.197046:0:3306:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff91a745a78000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3306:1870073693314816:0@lo:400:kworker.0 00000100:00100000:3.0:1783441657.199224:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783441657.199298:0:3305:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff91a745a7a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3305:1870073693315200:0@lo:400:kworker.0 00000100:00100000:3.0:1783441657.199337:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783441657.199379:0:3304:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff91a745a79c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3304:1870073693315072:0@lo:400:kworker.0 00000100:00100000:3.0:1783441657.199401:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783441657.199419:0:3304:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1783441657.199426:0:3304:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff91a859085f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3304:1870073693315456:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1783441657.199450:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783441657.199482:0:14821:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073693315200 00000100:00100000:3.0:1783441657.199498:0:14821:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073693315200 00000100:00100000:3.0:1783441657.199550:0:14821:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073693315072 00000100:00100000:3.0:1783441657.199553:0:14821:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073693315072 00000100:00100000:3.0:1783441657.199575:0:14821:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:3.0:1783441657.199584:0:14821:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a745a7aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3305:x1870073693315200:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1783441657.199650:0:14821:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a745a7aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3305:x1870073693315200:12345-0@lo:400:kworker.0 Request processed in 67us (311us total) trans 0 rc 0/0 00000100:00100000:3.0:1783441657.199658:0:14821:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:3.0:1783441657.199677:0:14821:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:3.0:1783441657.199683:0:14821:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a745a7b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3304:x1870073693315072:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1783441657.199711:0:14821:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a745a7b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3304:x1870073693315072:12345-0@lo:400:kworker.0 Request processed in 28us (309us total) trans 0 rc 0/0 00000100:00100000:3.0:1783441657.199717:0:14821:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:3.0:1783441657.199760:0:14801:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073693315456 00000100:00100000:3.0:1783441657.199763:0:14801:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073693315456 00000100:00100000:3.0:1783441657.199795:0:14801:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:3.0:1783441657.199802:0:14801:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a745a79180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3304:x1870073693315456:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1783441657.199831:0:14801:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1783441657.199864:0:14801:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a745a79180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3304:x1870073693315456:12345-0@lo:13:osp-pre-1-0.0 Request processed in 63us (413us total) trans 0 rc 0/0 00000100:00100000:3.0:1783441657.199869:0:14801:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00080000:3.0:1783441657.199886:0:14159:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1783441657.199891:0:14159:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1783441657.199938:0:3304:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff91a859085f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3304:1870073693315456:0@lo:13:osp-pre-1-0.0 00010000:00080000:3.0:1783441657.199950:0:3304:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff91a745a79c00 x1870073693315072/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1783441673 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1783441657.199960:0:3304:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff91a745a79c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3304:1870073693315072:0@lo:400:kworker.0 00010000:00080000:3.0:1783441657.199998:0:3305:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff91a745a7a680 x1870073693315200/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1783441673 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1783441657.200006:0:3305:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff91a745a7a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3305:1870073693315200:0@lo:400:kworker.0 00000100:00100000:1.0:1783441657.200318:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783441657.202401:0:14799:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073693314944 00000100:00100000:3.0:1783441657.202415:0:14799:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073693314944 00000100:00100000:0.0:1783441657.205977:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783441657.212560:0:3306:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff91a745a7b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3306:1870073693315328:0@lo:400:kworker.0 00000100:00100000:0.0:1783441657.212638:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783441657.212687:0:14155:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073693314688 00000100:00100000:0.0:1783441657.212695:0:14155:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073693314688 00000100:00100000:0.0:1783441657.212758:0:14155:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 75 00000100:00100000:0.0:1783441657.212768:0:14155:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a8492a1850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:94394728-4014-4ef0-b525-989290f008aa+19:3305:x1870073693314688:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1783441657.212826:0:14155:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a8492a1850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:94394728-4014-4ef0-b525-989290f008aa+19:3305:x1870073693314688:12345-0@lo:400:kworker.0 Request processed in 58us (13608us total) trans 0 rc 0/0 00000100:00100000:0.0:1783441657.212834:0:14155:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 75 00000100:00100000:0.0:1783441657.212871:0:14162:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073693315328 00000100:00100000:0.0:1783441657.212874:0:14162:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073693315328 00000100:00100000:0.0:1783441657.212908:0:14162:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:0.0:1783441657.212914:0:14162:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a877fae680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3306:x1870073693315328:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1783441657.212949:0:14162:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a877fae680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3306:x1870073693315328:12345-0@lo:400:kworker.0 Request processed in 34us (311us total) trans 0 rc 0/0 00000100:00100000:0.0:1783441657.212955:0:14162:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:3.0:1783441657.217796:0:14799:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073693314816 00000100:00100000:3.0:1783441657.217814:0:14799:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073693314816 00000100:00100000:3.0:1783441657.217887:0:14799:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1783441657.217898:0:14799:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a745551880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+7:3303:x1870073693314944:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1783441657.218001:0:14799:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a745551880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+7:3303:x1870073693314944:12345-0@lo:400:kworker.0 Request processed in 106us (17685us total) trans 0 rc 0/0 00000100:00100000:3.0:1783441657.218009:0:14799:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1783441657.218030:0:14799:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1783441657.218035:0:14799:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a877fafb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3306:x1870073693314816:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1783441657.218061:0:14799:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a877fafb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3306:x1870073693314816:12345-0@lo:400:kworker.0 Request processed in 26us (12091us total) trans 0 rc 0/0 00000100:00100000:3.0:1783441657.218067:0:14799:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00080000:0.0:1783441657.219692:0:14159:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1783441657.219702:0:14159:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1783441657.219774:0:3305:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff91a745a79500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:94394728-4014-4ef0-b525-989290f008aa:3305:1870073693314688:0@lo:400:kworker.0 00000100:00100000:0.0:1783441657.219824:0:3306:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff91a745a78000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3306:1870073693314816:0@lo:400:kworker.0 00010000:00080000:0.0:1783441657.219842:0:3306:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff91a745a7b100 x1870073693315328/t0(0) o400->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1783441673 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1783441657.219853:0:3306:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff91a745a7b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3306:1870073693315328:0@lo:400:kworker.0 00000100:00100000:1.0:1783441657.246132:0:3303:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff91a745a7bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3303:1870073693314944:0@lo:400:kworker.0 00000001:00100000:0.0:1783441657.306287:0:7492:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000001:00080000:0.0:1783441657.306321:0:7492:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 8589934593 is committed 00000100:00100000:0.0:1783441657.542073:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.13@tcp (source: 12345-192.168.201.13@tcp) 00000100:00100000:2.0:1783441657.542207:0:14156:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073673393280 00000100:00100000:2.0:1783441657.542217:0:14156:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073673393280 00000100:00100000:2.0:1783441657.542268:0:14156:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.13@tcp, seq: 76 00000100:00100000:2.0:1783441657.542277:0:14156:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a8492a3850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0+-99:2351:x1870073673393280:12345-192.168.201.13@tcp:250:mount.lustre.0 00010000:00080000:2.0:1783441657.542309:0:14156:0:(ldlm_lib.c:1432:target_handle_connect()) MGS: connection from 6a88b831-6e01-4d2d-a809-7fdb49ecdbbb@192.168.201.13@tcp t0 exp 0000000000000000 cur 495 last 0 00000020:00000080:2.0:1783441657.542342:0:14156:0:(genops.c:1406:class_connect()) connect: client 6a88b831-6e01-4d2d-a809-7fdb49ecdbbb, cookie 0xa2426164df2c8b0f 00000100:00080000:2.0:1783441657.542492:0:14156:0:(import.c:65:import_set_state_nolock()) ffff91a8748e9000 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1783441657.542584:0:14156:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a8492a3850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6a88b831-6e01-4d2d-a809-7fdb49ecdbbb+5:2351:x1870073673393280:12345-192.168.201.13@tcp:250:mount.lustre.0 Request processed in 306us (522us total) trans 0 rc 0/0 00000100:00100000:2.0:1783441657.542601:0:14156:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.13@tcp, seq: 76 00000100:00100000:3.0:1783441657.568489:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.13@tcp (source: 12345-192.168.201.13@tcp) 00000100:00100000:0.0:1783441657.568881:0:14157:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073673393408 00000100:00100000:0.0:1783441657.568892:0:14157:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073673393408 00000100:00100000:0.0:1783441657.568946:0:14157:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.13@tcp, seq: 77 00000100:00100000:0.0:1783441657.568954:0:14157:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a8492a3450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6a88b831-6e01-4d2d-a809-7fdb49ecdbbb+5:13691:x1870073673393408:12345-192.168.201.13@tcp:101:mount.lustre.0 00010000:00010000:0.0:1783441657.568968:0:14157:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1783441657.568983:0:14157:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff91a85fe58000/0xa2426164df2c8b16 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: local remote: 0x633a354aa4df5125 expref: -99 pid: 14157 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783441657.569008:0:14157:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff91a85fe58000/0xa2426164df2c8b16 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50000000000000 nid: 192.168.201.13@tcp remote: 0x633a354aa4df5125 expref: 6 pid: 14157 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783441657.569020:0:14157:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff91a85fe58000/0xa2426164df2c8b16 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: 192.168.201.13@tcp remote: 0x633a354aa4df5125 expref: 6 pid: 14157 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783441657.569029:0:14157:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91a85fe58000, rc 0) 00000100:00100000:0.0:1783441657.569083:0:14157:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a8492a3450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6a88b831-6e01-4d2d-a809-7fdb49ecdbbb+6:13691:x1870073673393408:12345-192.168.201.13@tcp:101:mount.lustre.0 Request processed in 130us (603us total) trans 0 rc 0/0 00000100:00100000:0.0:1783441657.569089:0:14157:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.13@tcp, seq: 77 00000100:00100000:3.0:1783441657.573993:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.13@tcp (source: 12345-192.168.201.13@tcp) 00000100:00100000:0.0:1783441657.574206:0:14155:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073673393536 00000100:00100000:0.0:1783441657.574216:0:14155:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073673393536 00000100:00100000:0.0:1783441657.574330:0:14155:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.13@tcp, seq: 78 00000100:00100000:0.0:1783441657.574342:0:14155:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a85010bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6a88b831-6e01-4d2d-a809-7fdb49ecdbbb+6:13691:x1870073673393536:12345-192.168.201.13@tcp:501:mount.lustre.0 00000100:00100000:0.0:1783441657.574921:0:14155:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a85010bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6a88b831-6e01-4d2d-a809-7fdb49ecdbbb+6:13691:x1870073673393536:12345-192.168.201.13@tcp:501:mount.lustre.0 Request processed in 401us (756us total) trans 0 rc -2/-2 00000100:00100000:0.0:1783441657.574942:0:14155:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.13@tcp, seq: 78 00000100:00100000:1.0:1783441657.589530:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.13@tcp (source: 12345-192.168.201.13@tcp) 00000100:00100000:3.0:1783441657.589941:0:14156:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073673393664 00000100:00100000:3.0:1783441657.589951:0:14156:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073673393664 00000100:00100000:3.0:1783441657.590018:0:14156:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.13@tcp, seq: 79 00000100:00100000:3.0:1783441657.590027:0:14156:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a85010b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6a88b831-6e01-4d2d-a809-7fdb49ecdbbb+6:13691:x1870073673393664:12345-192.168.201.13@tcp:101:mount.lustre.0 00010000:00010000:3.0:1783441657.590045:0:14156:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1783441657.590062:0:14156:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff91a85eb3c600/0xa2426164df2c8b1d lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: local remote: 0x633a354aa4df512c expref: -99 pid: 14156 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783441657.590110:0:14156:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff91a85eb3c600/0xa2426164df2c8b1d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x50000000000000 nid: 192.168.201.13@tcp remote: 0x633a354aa4df512c expref: 7 pid: 14156 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783441657.590122:0:14156:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff91a85eb3c600/0xa2426164df2c8b1d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: 192.168.201.13@tcp remote: 0x633a354aa4df512c expref: 7 pid: 14156 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783441657.590132:0:14156:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91a85eb3c600, rc 0) 00000100:00100000:3.0:1783441657.590203:0:14156:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a85010b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6a88b831-6e01-4d2d-a809-7fdb49ecdbbb+7:13691:x1870073673393664:12345-192.168.201.13@tcp:101:mount.lustre.0 Request processed in 177us (694us total) trans 0 rc 0/0 00000100:00100000:3.0:1783441657.590210:0:14156:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.13@tcp, seq: 79 00000100:00100000:3.0:1783441657.593354:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.13@tcp (source: 12345-192.168.201.13@tcp) 00000100:00100000:0.0:1783441657.594131:0:14155:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073673393792 00000100:00100000:0.0:1783441657.594140:0:14155:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073673393792 00000100:00100000:0.0:1783441657.594207:0:14155:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.13@tcp, seq: 80 00000100:00100000:0.0:1783441657.594218:0:14155:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a844bde050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6a88b831-6e01-4d2d-a809-7fdb49ecdbbb+7:13691:x1870073673393792:12345-192.168.201.13@tcp:501:mount.lustre.0 00000100:00100000:0.0:1783441657.594998:0:14155:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a844bde050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6a88b831-6e01-4d2d-a809-7fdb49ecdbbb+8:13691:x1870073673393792:12345-192.168.201.13@tcp:501:mount.lustre.0 Request processed in 779us (1651us total) trans 0 rc 0/0 00000100:00100000:0.0:1783441657.595016:0:14155:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.13@tcp, seq: 80 00000100:00100000:2.0:1783441657.601866:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.13@tcp (source: 12345-192.168.201.13@tcp) 00000100:00100000:1.0:1783441657.602063:0:14157:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073673393920 00000100:00100000:1.0:1783441657.602075:0:14157:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073673393920 00000100:00100000:1.0:1783441657.602135:0:14157:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.13@tcp, seq: 81 00000100:00100000:1.0:1783441657.602145:0:14157:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a844bdfc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6a88b831-6e01-4d2d-a809-7fdb49ecdbbb+8:13691:x1870073673393920:12345-192.168.201.13@tcp:503:mount.lustre.0 00000100:00100000:1.0:1783441657.602479:0:14157:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a844bdfc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6a88b831-6e01-4d2d-a809-7fdb49ecdbbb+8:13691:x1870073673393920:12345-192.168.201.13@tcp:503:mount.lustre.0 Request processed in 335us (623us total) trans 0 rc 0/0 00000100:00100000:1.0:1783441657.602487:0:14157:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.13@tcp, seq: 81 00000100:00100000:3.0:1783441657.615308:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.13@tcp (source: 12345-192.168.201.13@tcp) 00000100:00100000:0.0:1783441657.615442:0:14155:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073673394048 00000100:00100000:0.0:1783441657.615457:0:14155:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073673394048 00000100:00100000:0.0:1783441657.615548:0:14155:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.13@tcp, seq: 82 00000100:00100000:0.0:1783441657.615559:0:14155:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a844bdc850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6a88b831-6e01-4d2d-a809-7fdb49ecdbbb+8:13710:x1870073673394048:12345-192.168.201.13@tcp:502:llog_process_th.0 00000100:00100000:0.0:1783441657.616323:0:14155:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a844bdc850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6a88b831-6e01-4d2d-a809-7fdb49ecdbbb+8:13710:x1870073673394048:12345-192.168.201.13@tcp:502:llog_process_th.0 Request processed in 759us (1025us total) trans 0 rc 0/0 00000100:00100000:0.0:1783441657.616334:0:14155:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.13@tcp, seq: 82 00000100:00100000:1.0:1783441657.635305:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.13@tcp (source: 12345-192.168.201.13@tcp) 00000100:00100000:0.0:1783441657.635506:0:14157:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073673394176 00000100:00100000:0.0:1783441657.635531:0:14157:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073673394176 00000100:00100000:0.0:1783441657.635584:0:14157:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.13@tcp, seq: 83 00000100:00100000:0.0:1783441657.635602:0:14157:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a875619c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6a88b831-6e01-4d2d-a809-7fdb49ecdbbb+8:13710:x1870073673394176:12345-192.168.201.13@tcp:502:llog_process_th.0 00000100:00100000:0.0:1783441657.636187:0:14157:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a875619c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6a88b831-6e01-4d2d-a809-7fdb49ecdbbb+8:13710:x1870073673394176:12345-192.168.201.13@tcp:502:llog_process_th.0 Request processed in 584us (900us total) trans 0 rc 0/0 00000100:00100000:0.0:1783441657.636196:0:14157:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.13@tcp, seq: 83 00000100:00100000:2.0:1783441657.646068:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.13@tcp (source: 12345-192.168.201.13@tcp) 00000100:00100000:0.0:1783441657.647020:0:14155:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073673394304 00000100:00100000:0.0:1783441657.647032:0:14155:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073673394304 00000100:00100000:0.0:1783441657.647114:0:14155:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.13@tcp, seq: 84 00000100:00100000:0.0:1783441657.647126:0:14155:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a87561b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6a88b831-6e01-4d2d-a809-7fdb49ecdbbb+8:13691:x1870073673394304:12345-192.168.201.13@tcp:101:mount.lustre.0 00010000:00010000:0.0:1783441657.647144:0:14155:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1783441657.647163:0:14155:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff91a85fe59e00/0xa2426164df2c8b24 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x633a354aa4df5156 expref: -99 pid: 14155 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783441657.647195:0:14155:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff91a85fe59e00/0xa2426164df2c8b24 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 192.168.201.13@tcp remote: 0x633a354aa4df5156 expref: 9 pid: 14155 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783441657.647206:0:14155:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff91a85fe59e00/0xa2426164df2c8b24 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 192.168.201.13@tcp remote: 0x633a354aa4df5156 expref: 9 pid: 14155 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783441657.647215:0:14155:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91a85fe59e00, rc 0) 00000100:00100000:0.0:1783441657.647282:0:14155:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a87561b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6a88b831-6e01-4d2d-a809-7fdb49ecdbbb+9:13691:x1870073673394304:12345-192.168.201.13@tcp:101:mount.lustre.0 Request processed in 158us (1224us total) trans 0 rc 0/0 00000100:00100000:0.0:1783441657.647289:0:14155:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.13@tcp, seq: 84 00000100:00100000:2.0:1783441657.660841:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.13@tcp (source: 12345-192.168.201.13@tcp) 00000100:00100000:3.0:1783441657.662259:0:14156:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073673394432 00000100:00100000:3.0:1783441657.662272:0:14156:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073673394432 00000100:00100000:3.0:1783441657.662342:0:14156:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.13@tcp, seq: 85 00000100:00100000:3.0:1783441657.662351:0:14156:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a875619050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6a88b831-6e01-4d2d-a809-7fdb49ecdbbb+9:13691:x1870073673394432:12345-192.168.201.13@tcp:256:mount.lustre.0 20000000:01000000:3.0:1783441657.662375:0:14156:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-cliir bufsize 1048576. 20000000:01000000:3.0:1783441657.662396:0:14156:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/256/255. 20000000:01000000:3.0:1783441657.662400:0:14156:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4008/1/256/255. 20000000:01000000:3.0:1783441657.662403:0:14156:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3964/1/256/255. 20000000:01000000:3.0:1783441657.662405:0:14156:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 132, version 8 00000100:00100000:3.0:1783441657.665951:0:14156:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a875619050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6a88b831-6e01-4d2d-a809-7fdb49ecdbbb+9:13691:x1870073673394432:12345-192.168.201.13@tcp:256:mount.lustre.0 Request processed in 3588us (5107us total) trans 0 rc 0/0 00000100:00100000:3.0:1783441657.665982:0:14156:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.13@tcp, seq: 85 00000100:00100000:2.0:1783441657.673461:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.13@tcp (source: 12345-192.168.201.13@tcp) 00000100:00100000:1.0:1783441657.673544:0:14157:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073673394560 00000100:00100000:1.0:1783441657.673554:0:14157:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073673394560 00000100:00100000:1.0:1783441657.673609:0:14157:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.13@tcp, seq: 86 00000100:00100000:1.0:1783441657.673616:0:14157:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a875618c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6a88b831-6e01-4d2d-a809-7fdb49ecdbbb+9:13691:x1870073673394560:12345-192.168.201.13@tcp:101:mount.lustre.0 00010000:00010000:1.0:1783441657.673638:0:14157:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1783441657.673653:0:14157:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff91a87da46400/0xa2426164df2c8b2b lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x633a354aa4df515d expref: -99 pid: 14157 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783441657.673692:0:14157:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff91a87da46400/0xa2426164df2c8b2b lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 192.168.201.13@tcp remote: 0x633a354aa4df515d expref: 10 pid: 14157 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783441657.673700:0:14157:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff91a87da46400/0xa2426164df2c8b2b lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 192.168.201.13@tcp remote: 0x633a354aa4df515d expref: 10 pid: 14157 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783441657.673707:0:14157:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91a87da46400, rc 0) 00000100:00100000:1.0:1783441657.673798:0:14157:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a875618c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6a88b831-6e01-4d2d-a809-7fdb49ecdbbb+10:13691:x1870073673394560:12345-192.168.201.13@tcp:101:mount.lustre.0 Request processed in 181us (345us total) trans 0 rc 0/0 00000100:00100000:1.0:1783441657.673806:0:14157:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.13@tcp, seq: 86 00000100:00100000:2.0:1783441657.678130:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.13@tcp (source: 12345-192.168.201.13@tcp) 00000100:00100000:3.0:1783441657.678777:0:14156:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073673394688 00000100:00100000:3.0:1783441657.678788:0:14156:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073673394688 00000100:00100000:3.0:1783441657.678930:0:14156:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.13@tcp, seq: 87 00000100:00100000:3.0:1783441657.678941:0:14156:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a875618850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6a88b831-6e01-4d2d-a809-7fdb49ecdbbb+10:13691:x1870073673394688:12345-192.168.201.13@tcp:501:mount.lustre.0 00000100:00100000:3.0:1783441657.679502:0:14156:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a875618850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6a88b831-6e01-4d2d-a809-7fdb49ecdbbb+10:13691:x1870073673394688:12345-192.168.201.13@tcp:501:mount.lustre.0 Request processed in 560us (1380us total) trans 0 rc 0/0 00000100:00100000:3.0:1783441657.679518:0:14156:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.13@tcp, seq: 87 00000100:00100000:2.0:1783441657.682873:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.13@tcp (source: 12345-192.168.201.13@tcp) 00000100:00100000:0.0:1783441657.683075:0:14155:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073673394816 00000100:00100000:0.0:1783441657.683087:0:14155:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073673394816 00000100:00100000:0.0:1783441657.683154:0:14155:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.13@tcp, seq: 88 00000100:00100000:0.0:1783441657.683164:0:14155:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a87561a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6a88b831-6e01-4d2d-a809-7fdb49ecdbbb+10:13691:x1870073673394816:12345-192.168.201.13@tcp:503:mount.lustre.0 00000100:00100000:0.0:1783441657.683984:0:14155:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a87561a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6a88b831-6e01-4d2d-a809-7fdb49ecdbbb+10:13691:x1870073673394816:12345-192.168.201.13@tcp:503:mount.lustre.0 Request processed in 817us (1176us total) trans 0 rc 0/0 00000100:00100000:0.0:1783441657.683994:0:14155:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.13@tcp, seq: 88 00000100:00100000:2.0:1783441657.693519:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.13@tcp (source: 12345-192.168.201.13@tcp) 00000100:00100000:3.0:1783441657.696434:0:14156:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073673394944 00000100:00100000:3.0:1783441657.696450:0:14156:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073673394944 00000100:00100000:2.0:1783441657.696830:0:14156:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.13@tcp, seq: 89 00000100:00100000:2.0:1783441657.696853:0:14156:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a87561ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6a88b831-6e01-4d2d-a809-7fdb49ecdbbb+10:13714:x1870073673394944:12345-192.168.201.13@tcp:502:llog_process_th.0 00000100:00100000:2.0:1783441657.697934:0:14156:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a87561ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6a88b831-6e01-4d2d-a809-7fdb49ecdbbb+10:13714:x1870073673394944:12345-192.168.201.13@tcp:502:llog_process_th.0 Request processed in 1074us (4428us total) trans 0 rc 0/0 00000100:00100000:2.0:1783441657.697946:0:14156:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.13@tcp, seq: 89 00000100:00100000:2.0:1783441657.702855:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.13@tcp (source: 12345-192.168.201.13@tcp) 00000100:00100000:0.0:1783441657.702953:0:14155:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073673395072 00000100:00100000:0.0:1783441657.703151:0:14155:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073673395072 00000100:00100000:0.0:1783441657.703257:0:14155:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.13@tcp, seq: 90 00000100:00100000:0.0:1783441657.703266:0:14155:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a87561bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6a88b831-6e01-4d2d-a809-7fdb49ecdbbb+10:13714:x1870073673395072:12345-192.168.201.13@tcp:502:llog_process_th.0 00000100:00100000:0.0:1783441657.715190:0:14155:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a87561bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6a88b831-6e01-4d2d-a809-7fdb49ecdbbb+10:13714:x1870073673395072:12345-192.168.201.13@tcp:502:llog_process_th.0 Request processed in 11913us (12334us total) trans 0 rc 0/0 00000100:00100000:0.0:1783441657.715206:0:14155:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.13@tcp, seq: 90 00010000:00010000:3.0:1783441657.715785:0:14152:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1783441657.734213:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.13@tcp (source: 12345-192.168.201.13@tcp) 00000100:00100000:3.0:1783441657.734448:0:14164:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073673395200 00000100:00100000:3.0:1783441657.734457:0:14164:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073673395200 00000100:00100000:3.0:1783441657.734552:0:14164:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.13@tcp, seq: 4 00000100:00100000:3.0:1783441657.734561:0:14164:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a745550a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:2351:x1870073673395200:12345-192.168.201.13@tcp:38:mount.lustre.0 00010000:00080000:3.0:1783441657.734807:0:14164:0:(ldlm_lib.c:1432:target_handle_connect()) lustre-MDT0000: connection from 29d872ae-bafc-4783-9a98-d2418cedf182@192.168.201.13@tcp t0 exp 0000000000000000 cur 495 last 0 00000020:00000080:3.0:1783441657.734861:0:14164:0:(genops.c:1406:class_connect()) connect: client 29d872ae-bafc-4783-9a98-d2418cedf182, cookie 0xa2426164df2c8b32 00000004:00100000:3.0:1783441657.734895:0:14164:0:(mdt_handler.c:7282:mdt_connect_internal()) lustre-MDT0000: cli supports cksum type f7, return f7 00000001:00000004:3.0:1783441657.734901:0:14164:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 2, last_transno is 8589934592 00000100:00080000:3.0:1783441657.767148:0:14164:0:(import.c:65:import_set_state_nolock()) ffff91a745207800 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1783441657.767237:0:14164:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a745550a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:29d872ae-bafc-4783-9a98-d2418cedf182+6:2351:x1870073673395200:12345-192.168.201.13@tcp:38:mount.lustre.0 Request processed in 32674us (33031us total) trans 0 rc 0/0 00000100:00100000:3.0:1783441657.767249:0:14164:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.13@tcp, seq: 4 00000100:00100000:3.0:1783441657.771094:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.13@tcp (source: 12345-192.168.201.13@tcp) 00000100:00100000:0.0:1783441657.771197:0:14163:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073673395456 00000100:00100000:0.0:1783441657.771207:0:14163:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073673395456 00000100:00100000:0.0:1783441657.771303:0:14163:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.13@tcp, seq: 5 00000100:00100000:0.0:1783441657.771314:0:14163:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a745a7a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:29d872ae-bafc-4783-9a98-d2418cedf182+6:13691:x1870073673395456:12345-192.168.201.13@tcp:41:mount.lustre.0 00000004:00000024:0.0:1783441657.771368:0:14163:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 3407872 pending 0 free 2261647360 avail 2259550208 00000100:00100000:0.0:1783441657.771463:0:14163:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a745a7a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:29d872ae-bafc-4783-9a98-d2418cedf182+6:13691:x1870073673395456:12345-192.168.201.13@tcp:41:mount.lustre.0 Request processed in 150us (377us total) trans 0 rc 0/0 00000100:00100000:0.0:1783441657.771470:0:14163:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.13@tcp, seq: 5 00000100:00080000:3.0:1783441657.771927:0:14159:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1783441657.774984:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.13@tcp (source: 12345-192.168.201.13@tcp) 00000100:00100000:0.0:1783441657.775446:0:14162:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073673395328 00000100:00100000:0.0:1783441657.775456:0:14162:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073673395328 00000100:00100000:0.0:1783441657.775519:0:14162:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.13@tcp, seq: 6 00000100:00100000:0.0:1783441657.775530:0:14162:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a859084700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:29d872ae-bafc-4783-9a98-d2418cedf182+6:0:x1870073673395328:12345-192.168.201.13@tcp:41:mount.lustre.0 00000004:00000024:0.0:1783441657.775561:0:14162:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 3407872 pending 0 free 2261647360 avail 2259550208 00000100:00100000:0.0:1783441657.775647:0:14162:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a859084700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:29d872ae-bafc-4783-9a98-d2418cedf182+6:0:x1870073673395328:12345-192.168.201.13@tcp:41:mount.lustre.0 Request processed in 118us (671us total) trans 0 rc 0/0 00000100:00100000:0.0:1783441657.775655:0:14162:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.13@tcp, seq: 6 00000100:00100000:1.0:1783441657.776081:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.13@tcp (source: 12345-192.168.201.13@tcp) 00000100:00100000:0.0:1783441657.777544:0:14163:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073673395584 00000100:00100000:0.0:1783441657.777556:0:14163:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073673395584 00000100:00100000:0.0:1783441657.777637:0:14163:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.13@tcp, seq: 7 00000100:00100000:0.0:1783441657.777647:0:14163:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a745552a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:29d872ae-bafc-4783-9a98-d2418cedf182+6:13691:x1870073673395584:12345-192.168.201.13@tcp:40:mount.lustre.0 00000100:00100000:0.0:1783441657.777731:0:14163:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a745552a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:29d872ae-bafc-4783-9a98-d2418cedf182+6:13691:x1870073673395584:12345-192.168.201.13@tcp:40:mount.lustre.0 Request processed in 86us (1650us total) trans 0 rc 0/0 00000100:00100000:0.0:1783441657.777788:0:14163:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.13@tcp, seq: 7 00000100:00100000:1.0:1783441657.787777:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.13@tcp (source: 12345-192.168.201.13@tcp) 00000100:00100000:1.0:1783441657.787821:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.13@tcp (source: 12345-192.168.201.13@tcp) 00000100:00100000:3.0:1783441657.787848:0:14799:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073673395712 00000100:00100000:1.0:1783441657.787856:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.13@tcp (source: 12345-192.168.201.13@tcp) 00000100:00100000:3.0:1783441657.787862:0:14799:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073673395712 00000100:00100000:3.0:1783441657.787908:0:14799:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073673395840 00000100:00100000:3.0:1783441657.787912:0:14799:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073673395840 00000100:00100000:3.0:1783441657.787928:0:14799:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.13@tcp, seq: 8 00000100:00100000:3.0:1783441657.787949:0:14799:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a745551500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:2351:x1870073673395712:12345-192.168.201.13@tcp:8:mount.lustre.0 00010000:00080000:3.0:1783441657.788721:0:14799:0:(ldlm_lib.c:1432:target_handle_connect()) lustre-OST0000: connection from 29d872ae-bafc-4783-9a98-d2418cedf182@192.168.201.13@tcp t0 exp 0000000000000000 cur 495 last 0 00000020:00000080:3.0:1783441657.789158:0:14799:0:(genops.c:1406:class_connect()) connect: client 29d872ae-bafc-4783-9a98-d2418cedf182, cookie 0xa2426164df2c8b39 00002000:00100000:3.0:1783441657.789172:0:14799:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli 29d872ae-bafc-4783-9a98-d2418cedf182/ffff91a745204000 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113669 ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:3.0:1783441657.789197:0:14799:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0000: cli supports cksum type f7, return f7 00002000:00080000:3.0:1783441657.789538:0:14799:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:3.0:1783441657.790729:0:14799:0:(import.c:65:import_set_state_nolock()) ffff91a745205800 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1783441657.790893:0:14799:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a745551500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:29d872ae-bafc-4783-9a98-d2418cedf182+6:2351:x1870073673395712:12345-192.168.201.13@tcp:8:mount.lustre.0 Request processed in 2941us (3159us total) trans 0 rc 0/0 00000100:00100000:3.0:1783441657.790904:0:14799:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.13@tcp, seq: 8 00000100:00100000:3.0:1783441657.790943:0:14799:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.13@tcp, seq: 9 00000100:00100000:3.0:1783441657.790950:0:14799:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a745553800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:2351:x1870073673395840:12345-192.168.201.13@tcp:8:mount.lustre.0 00010000:00080000:3.0:1783441657.790976:0:14799:0:(ldlm_lib.c:1432:target_handle_connect()) lustre-OST0001: connection from 29d872ae-bafc-4783-9a98-d2418cedf182@192.168.201.13@tcp t0 exp 0000000000000000 cur 495 last 0 00000020:00000080:3.0:1783441657.791015:0:14799:0:(genops.c:1406:class_connect()) connect: client 29d872ae-bafc-4783-9a98-d2418cedf182, cookie 0xa2426164df2c8b40 00002000:00100000:3.0:1783441657.791026:0:14799:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli 29d872ae-bafc-4783-9a98-d2418cedf182/ffff91a745203800 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113669 ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:3.0:1783441657.791034:0:14799:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0001: cli supports cksum type f7, return f7 00002000:00080000:3.0:1783441657.791309:0:14799:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:3.0:1783441657.791328:0:14799:0:(import.c:65:import_set_state_nolock()) ffff91a745206000 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1783441657.791352:0:14799:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a745553800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:29d872ae-bafc-4783-9a98-d2418cedf182+6:2351:x1870073673395840:12345-192.168.201.13@tcp:8:mount.lustre.0 Request processed in 401us (3531us total) trans 0 rc 0/0 00000100:00100000:3.0:1783441657.791359:0:14799:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.13@tcp, seq: 9 00000100:00100000:2.0:1783441657.792875:0:14165:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073673395968 00000100:00100000:2.0:1783441657.792888:0:14165:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073673395968 00000100:00100000:2.0:1783441657.792932:0:14165:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.13@tcp, seq: 0 00000100:00100000:2.0:1783441657.792941:0:14165:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a745552680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:29d872ae-bafc-4783-9a98-d2418cedf182+6:13691:x1870073673395968:12345-192.168.201.13@tcp:33:mount.lustre.0 00000004:00080000:3.0:1783441657.797319:0:14165:0:(mdt_identity.c:119:mdt_identity_do_upcall()) lustre-MDT0000: invoked upcall /home/green/git/lustre-release/lustre/utils/l_getidentity lustre-MDT0000 0, time 4299us 00000004:00200000:3.0:1783441657.817804:0:14165:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 7680 00000100:00100000:3.0:1783441657.818298:0:14165:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a745552680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:29d872ae-bafc-4783-9a98-d2418cedf182+6:13691:x1870073673395968:12345-192.168.201.13@tcp:33:mount.lustre.0 Request processed in 25351us (30436us total) trans 0 rc 0/0 00000100:00100000:3.0:1783441657.818323:0:14165:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.13@tcp, seq: 0 00000100:00100000:1.0:1783441658.132337:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.13@tcp (source: 12345-192.168.201.13@tcp) 00000100:00100000:0.0:1783441658.132428:0:14162:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073673396096 00000100:00100000:0.0:1783441658.132439:0:14162:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073673396096 00000100:00100000:0.0:1783441658.132509:0:14162:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.13@tcp, seq: 8 00000100:00100000:0.0:1783441658.132527:0:14162:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a745553480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:29d872ae-bafc-4783-9a98-d2418cedf182+6:13735:x1870073673396096:12345-192.168.201.13@tcp:101:mkdir.0 00010000:00010000:0.0:1783441658.132549:0:14162:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1783441658.132574:0:14162:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91a85fe59c00/0xa2426164df2c8b47 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x633a354aa4df5187 expref: -99 pid: 14162 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783441658.132663:0:14162:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff91a85fe58c00/0xa2426164df2c8b4e lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14162 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783441658.132679:0:14162:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91a85fe58c00/0xa2426164df2c8b4e lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14162 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783441658.132693:0:14162:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91a85fe58c00/0xa2426164df2c8b4e lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14162 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1783441658.132983:0:14162:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 7680 00000004:00200000:0.0:1783441658.132988:0:14162:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 3 stripe count 1 MDT count 1 00000004:00010000:0.0:1783441658.133084:0:14162:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff91a85fe58c00/0xa2426164df2c8b4e lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14162 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783441658.133114:0:14162:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91a85fe59c00/0xa2426164df2c8b47 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.13@tcp remote: 0x633a354aa4df5187 expref: 8 pid: 14162 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783441658.133130:0:14162:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff91a85fe58c00/0xa2426164df2c8b4e lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.13@tcp remote: 0x633a354aa4df5187 expref: 7 pid: 14162 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783441658.133152:0:14162:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff91a8439b0600) 00010000:00010000:0.0:1783441658.133155:0:14162:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1783441658.133159:0:14162:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91a85fe58c00, rc 0) 00000100:00100000:0.0:1783441658.133217:0:14162:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a745553480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:29d872ae-bafc-4783-9a98-d2418cedf182+7:13735:x1870073673396096:12345-192.168.201.13@tcp:101:mkdir.0 Request processed in 699us (891us total) trans 0 rc 0/0 00000100:00100000:0.0:1783441658.133230:0:14162:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.13@tcp, seq: 8 00000001:00100000:0.0:1783441658.302279:0:6613:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of 29d872ae-bafc-4783-9a98-d2418cedf182 00010000:00010000:0.0:1783441658.733093:0:14151:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783441659.756983:0:14152:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1783441660.269304:0:3304:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff91a745551f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3304:1870073693315584:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1783441660.269381:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783441660.269623:0:14801:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073693315584 00000100:00100000:1.0:1783441660.269632:0:14801:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073693315584 00000100:00100000:1.0:1783441660.269705:0:14801:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:1.0:1783441660.269726:0:14801:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a745a79c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3304:x1870073693315584:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1783441660.269783:0:14801:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1783441660.269833:0:14801:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a745a79c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3304:x1870073693315584:12345-0@lo:13:osp-pre-0-0.0 Request processed in 119us (451us total) trans 0 rc 0/0 00000100:00100000:1.0:1783441660.269840:0:14801:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00080000:3.0:1783441660.270117:0:14159:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1783441660.270158:0:3304:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff91a745551f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3304:1870073693315584:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1783441660.422921:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.13@tcp (source: 12345-192.168.201.13@tcp) 00000100:00100000:0.0:1783441660.423076:0:14163:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073673396224 00000100:00100000:0.0:1783441660.423086:0:14163:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073673396224 00000100:00100000:0.0:1783441660.423162:0:14163:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.13@tcp, seq: 9 00000100:00100000:0.0:1783441660.423172:0:14163:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a859087b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:29d872ae-bafc-4783-9a98-d2418cedf182+7:13787:x1870073673396224:12345-192.168.201.13@tcp:41:lfs.0 00000004:00000024:0.0:1783441660.423227:0:14163:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 3407872 pending 0 free 2261647360 avail 2259550208 00000100:00100000:0.0:1783441660.423321:0:14163:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a859087b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:29d872ae-bafc-4783-9a98-d2418cedf182+7:13787:x1870073673396224:12345-192.168.201.13@tcp:41:lfs.0 Request processed in 150us (409us total) trans 0 rc 0/0 00000100:00100000:0.0:1783441660.423329:0:14163:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.13@tcp, seq: 9 00000100:00080000:3.0:1783441660.423698:0:14159:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1783441660.426891:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.13@tcp (source: 12345-192.168.201.13@tcp) 00000100:00100000:0.0:1783441660.427484:0:14802:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073673396352 00000100:00100000:0.0:1783441660.427494:0:14802:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073673396352 00000100:00100000:0.0:1783441660.427577:0:14802:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.13@tcp, seq: 6 00000100:00100000:0.0:1783441660.427588:0:14802:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a745550000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:29d872ae-bafc-4783-9a98-d2418cedf182+5:13787:x1870073673396352:12345-192.168.201.13@tcp:13:lfs.0 00000100:00080000:3.0:1783441660.427602:0:14159:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00002000:00000024:0.0:1783441660.427616:0:14802:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1783441660.427902:0:14802:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a745550000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:29d872ae-bafc-4783-9a98-d2418cedf182+5:13787:x1870073673396352:12345-192.168.201.13@tcp:13:lfs.0 Request processed in 315us (1020us total) trans 0 rc 0/0 00000100:00100000:0.0:1783441660.427911:0:14802:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.13@tcp, seq: 6 00000100:00100000:2.0:1783441660.437183:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.13@tcp (source: 12345-192.168.201.13@tcp) 00000100:00100000:3.0:1783441660.437525:0:14801:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073673396480 00000100:00100000:3.0:1783441660.437553:0:14801:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073673396480 00000100:00100000:3.0:1783441660.437677:0:14801:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.13@tcp, seq: 7 00000100:00100000:3.0:1783441660.437690:0:14801:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a859085c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:29d872ae-bafc-4783-9a98-d2418cedf182+6:13787:x1870073673396480:12345-192.168.201.13@tcp:13:lfs.0 00002000:00000024:3.0:1783441660.437778:0:14801:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1783441660.437907:0:14801:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a859085c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:29d872ae-bafc-4783-9a98-d2418cedf182+6:13787:x1870073673396480:12345-192.168.201.13@tcp:13:lfs.0 Request processed in 219us (733us total) trans 0 rc 0/0 00000100:00100000:3.0:1783441660.437915:0:14801:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.13@tcp, seq: 7 00000100:00080000:0.0:1783441660.438159:0:14159:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1783441660.643240:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.13@tcp (source: 12345-192.168.201.13@tcp) 00000100:00100000:0.0:1783441660.643456:0:14156:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073673396608 00000100:00100000:0.0:1783441660.643481:0:14156:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073673396608 00000100:00100000:0.0:1783441660.643781:0:14156:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.13@tcp, seq: 91 00000100:00100000:0.0:1783441660.643794:0:14156:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a87561a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6a88b831-6e01-4d2d-a809-7fdb49ecdbbb+10:13820:x1870073673396608:12345-192.168.201.13@tcp:101:mount.lustre.0 00010000:00010000:0.0:1783441660.643821:0:14156:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1783441660.643846:0:14156:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff91a85fe59c00/0xa2426164df2c8b55 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: local remote: 0x633a354aa4df518e expref: -99 pid: 14156 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783441660.643885:0:14156:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff91a85fe59c00/0xa2426164df2c8b55 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000000 nid: 192.168.201.13@tcp remote: 0x633a354aa4df518e expref: 11 pid: 14156 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783441660.643899:0:14156:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff91a85fe59c00/0xa2426164df2c8b55 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 192.168.201.13@tcp remote: 0x633a354aa4df518e expref: 11 pid: 14156 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783441660.643910:0:14156:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91a85fe59c00, rc 0) 00000100:00100000:0.0:1783441660.643990:0:14156:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a87561a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6a88b831-6e01-4d2d-a809-7fdb49ecdbbb+11:13820:x1870073673396608:12345-192.168.201.13@tcp:101:mount.lustre.0 Request processed in 199us (768us total) trans 0 rc 0/0 00000100:00100000:0.0:1783441660.643999:0:14156:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.13@tcp, seq: 91 00000100:00100000:2.0:1783441660.652968:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.13@tcp (source: 12345-192.168.201.13@tcp) 00000100:00100000:1.0:1783441660.660397:0:14157:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073673396736 00000100:00100000:1.0:1783441660.660448:0:14157:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073673396736 00000100:00100000:0.0:1783441660.660764:0:14157:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.13@tcp, seq: 92 00000100:00100000:0.0:1783441660.660779:0:14157:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a87561b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6a88b831-6e01-4d2d-a809-7fdb49ecdbbb+11:13820:x1870073673396736:12345-192.168.201.13@tcp:501:mount.lustre.0 00000100:00100000:2.0:1783441660.670883:0:14157:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a87561b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6a88b831-6e01-4d2d-a809-7fdb49ecdbbb+11:13820:x1870073673396736:12345-192.168.201.13@tcp:501:mount.lustre.0 Request processed in 10088us (17912us total) trans 0 rc 0/0 00000100:00100000:2.0:1783441660.670902:0:14157:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.13@tcp, seq: 92 00000100:00100000:2.0:1783441660.680096:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.13@tcp (source: 12345-192.168.201.13@tcp) 00000100:00100000:0.0:1783441660.680224:0:14156:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073673396864 00000100:00100000:0.0:1783441660.680239:0:14156:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073673396864 00000100:00100000:0.0:1783441660.680325:0:14156:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.13@tcp, seq: 93 00000100:00100000:0.0:1783441660.680337:0:14156:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a87561a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6a88b831-6e01-4d2d-a809-7fdb49ecdbbb+11:13820:x1870073673396864:12345-192.168.201.13@tcp:503:mount.lustre.0 00000100:00100000:0.0:1783441660.680658:0:14156:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a87561a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6a88b831-6e01-4d2d-a809-7fdb49ecdbbb+11:13820:x1870073673396864:12345-192.168.201.13@tcp:503:mount.lustre.0 Request processed in 321us (576us total) trans 0 rc 0/0 00000100:00100000:0.0:1783441660.680677:0:14156:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.13@tcp, seq: 93 00000100:00100000:3.0:1783441660.684901:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.13@tcp (source: 12345-192.168.201.13@tcp) 00000100:00100000:2.0:1783441660.685165:0:14157:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073673396992 00000100:00100000:2.0:1783441660.685179:0:14157:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073673396992 00000100:00100000:2.0:1783441660.685266:0:14157:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.13@tcp, seq: 94 00000100:00100000:2.0:1783441660.685279:0:14157:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a875619450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6a88b831-6e01-4d2d-a809-7fdb49ecdbbb+11:13826:x1870073673396992:12345-192.168.201.13@tcp:502:llog_process_th.0 00000100:00100000:2.0:1783441660.685675:0:14157:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a875619450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6a88b831-6e01-4d2d-a809-7fdb49ecdbbb+11:13826:x1870073673396992:12345-192.168.201.13@tcp:502:llog_process_th.0 Request processed in 398us (791us total) trans 0 rc 0/0 00000100:00100000:2.0:1783441660.685685:0:14157:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.13@tcp, seq: 94 00000100:00100000:2.0:1783441660.696592:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.13@tcp (source: 12345-192.168.201.13@tcp) 00000100:00100000:3.0:1783441660.696696:0:14155:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073673397120 00000100:00100000:3.0:1783441660.696710:0:14155:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073673397120 00000100:00100000:3.0:1783441660.696818:0:14155:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.13@tcp, seq: 95 00000100:00100000:3.0:1783441660.696831:0:14155:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a875619850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6a88b831-6e01-4d2d-a809-7fdb49ecdbbb+11:13826:x1870073673397120:12345-192.168.201.13@tcp:502:llog_process_th.0 00000100:00100000:3.0:1783441660.697243:0:14155:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a875619850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6a88b831-6e01-4d2d-a809-7fdb49ecdbbb+11:13826:x1870073673397120:12345-192.168.201.13@tcp:502:llog_process_th.0 Request processed in 412us (663us total) trans 0 rc 0/0 00000100:00100000:3.0:1783441660.697253:0:14155:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.13@tcp, seq: 95 00000100:00100000:1.0:1783441660.704880:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.13@tcp (source: 12345-192.168.201.13@tcp) 00000100:00100000:0.0:1783441660.705008:0:14156:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073673397248 00000100:00100000:0.0:1783441660.705021:0:14156:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073673397248 00000100:00100000:0.0:1783441660.705099:0:14156:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.13@tcp, seq: 96 00000100:00100000:0.0:1783441660.705110:0:14156:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a87561b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6a88b831-6e01-4d2d-a809-7fdb49ecdbbb+11:13820:x1870073673397248:12345-192.168.201.13@tcp:101:mount.lustre.0 00010000:00010000:0.0:1783441660.705133:0:14156:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1783441660.705156:0:14156:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff91a85fe59200/0xa2426164df2c8b5c lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x633a354aa4df51b8 expref: -99 pid: 14156 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783441660.705201:0:14156:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff91a85fe59200/0xa2426164df2c8b5c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 192.168.201.13@tcp remote: 0x633a354aa4df51b8 expref: 12 pid: 14156 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783441660.705215:0:14156:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff91a85fe59200/0xa2426164df2c8b5c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 192.168.201.13@tcp remote: 0x633a354aa4df51b8 expref: 12 pid: 14156 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783441660.705227:0:14156:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91a85fe59200, rc 0) 00000100:00100000:0.0:1783441660.705313:0:14156:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a87561b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6a88b831-6e01-4d2d-a809-7fdb49ecdbbb+12:13820:x1870073673397248:12345-192.168.201.13@tcp:101:mount.lustre.0 Request processed in 205us (456us total) trans 0 rc 0/0 00000100:00100000:0.0:1783441660.705322:0:14156:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.13@tcp, seq: 96 00000100:00100000:0.0:1783441660.713883:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.13@tcp (source: 12345-192.168.201.13@tcp) 00000100:00100000:2.0:1783441660.715165:0:14157:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073673397376 00000100:00100000:2.0:1783441660.715186:0:14157:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073673397376 00000100:00100000:2.0:1783441660.715335:0:14157:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.13@tcp, seq: 97 00000100:00100000:2.0:1783441660.715348:0:14157:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a875618050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6a88b831-6e01-4d2d-a809-7fdb49ecdbbb+12:13820:x1870073673397376:12345-192.168.201.13@tcp:256:mount.lustre.0 20000000:01000000:2.0:1783441660.715388:0:14157:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-cliir bufsize 1048576. 20000000:01000000:2.0:1783441660.715424:0:14157:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/256/255. 20000000:01000000:2.0:1783441660.715429:0:14157:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4008/1/256/255. 20000000:01000000:2.0:1783441660.715433:0:14157:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3964/1/256/255. 20000000:01000000:2.0:1783441660.715435:0:14157:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 132, version 8 00000100:00100000:0.0:1783441660.718652:0:14157:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a875618050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6a88b831-6e01-4d2d-a809-7fdb49ecdbbb+12:13820:x1870073673397376:12345-192.168.201.13@tcp:256:mount.lustre.0 Request processed in 3289us (4766us total) trans 0 rc 0/0 00000100:00100000:0.0:1783441660.718672:0:14157:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.13@tcp, seq: 97 00000100:00100000:1.0:1783441660.725063:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.13@tcp (source: 12345-192.168.201.13@tcp) 00000100:00100000:3.0:1783441660.725177:0:14155:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073673397504 00000100:00100000:3.0:1783441660.725190:0:14155:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073673397504 00000100:00100000:3.0:1783441660.725313:0:14155:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.13@tcp, seq: 98 00000100:00100000:3.0:1783441660.725324:0:14155:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a875618450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6a88b831-6e01-4d2d-a809-7fdb49ecdbbb+12:13820:x1870073673397504:12345-192.168.201.13@tcp:101:mount.lustre.0 00010000:00010000:3.0:1783441660.725346:0:14155:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1783441660.725367:0:14155:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff91a85eb3de00/0xa2426164df2c8b63 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0x633a354aa4df51bf expref: -99 pid: 14155 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783441660.725401:0:14155:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff91a85eb3de00/0xa2426164df2c8b63 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 192.168.201.13@tcp remote: 0x633a354aa4df51bf expref: 13 pid: 14155 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783441660.725414:0:14155:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff91a85eb3de00/0xa2426164df2c8b63 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 192.168.201.13@tcp remote: 0x633a354aa4df51bf expref: 13 pid: 14155 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783441660.725425:0:14155:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91a85eb3de00, rc 0) 00000100:00100000:3.0:1783441660.725500:0:14155:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a875618450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6a88b831-6e01-4d2d-a809-7fdb49ecdbbb+13:13820:x1870073673397504:12345-192.168.201.13@tcp:101:mount.lustre.0 Request processed in 177us (454us total) trans 0 rc 0/0 00000100:00100000:3.0:1783441660.725508:0:14155:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.13@tcp, seq: 98 00000100:00100000:0.0:1783441660.727252:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.13@tcp (source: 12345-192.168.201.13@tcp) 00000100:00100000:2.0:1783441660.727343:0:14157:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073673397632 00000100:00100000:2.0:1783441660.727352:0:14157:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073673397632 00000100:00100000:2.0:1783441660.727401:0:14157:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.13@tcp, seq: 99 00000100:00100000:2.0:1783441660.727408:0:14157:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a87563f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6a88b831-6e01-4d2d-a809-7fdb49ecdbbb+13:13820:x1870073673397632:12345-192.168.201.13@tcp:501:mount.lustre.0 00000100:00100000:2.0:1783441660.727827:0:14157:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a87563f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6a88b831-6e01-4d2d-a809-7fdb49ecdbbb+13:13820:x1870073673397632:12345-192.168.201.13@tcp:501:mount.lustre.0 Request processed in 416us (584us total) trans 0 rc 0/0 00000100:00100000:2.0:1783441660.727836:0:14157:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.13@tcp, seq: 99 00000100:00100000:2.0:1783441660.730138:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.13@tcp (source: 12345-192.168.201.13@tcp) 00000100:00100000:3.0:1783441660.730276:0:14155:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073673397760 00000100:00100000:3.0:1783441660.730289:0:14155:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073673397760 00000100:00100000:3.0:1783441660.730390:0:14155:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.13@tcp, seq: 100 00000100:00100000:3.0:1783441660.730399:0:14155:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a87563e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6a88b831-6e01-4d2d-a809-7fdb49ecdbbb+13:13820:x1870073673397760:12345-192.168.201.13@tcp:503:mount.lustre.0 00000100:00100000:3.0:1783441660.730727:0:14155:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a87563e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6a88b831-6e01-4d2d-a809-7fdb49ecdbbb+13:13820:x1870073673397760:12345-192.168.201.13@tcp:503:mount.lustre.0 Request processed in 328us (603us total) trans 0 rc 0/0 00000100:00100000:3.0:1783441660.730734:0:14155:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.13@tcp, seq: 100 00000100:00100000:1.0:1783441660.734291:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.13@tcp (source: 12345-192.168.201.13@tcp) 00000100:00100000:0.0:1783441660.734447:0:14156:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073673397888 00000100:00100000:0.0:1783441660.734461:0:14156:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073673397888 00000100:00100000:0.0:1783441660.734606:0:14156:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.13@tcp, seq: 101 00000100:00100000:0.0:1783441660.734639:0:14156:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a87563fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6a88b831-6e01-4d2d-a809-7fdb49ecdbbb+13:13828:x1870073673397888:12345-192.168.201.13@tcp:502:llog_process_th.0 00000100:00100000:0.0:1783441660.735045:0:14156:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a87563fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6a88b831-6e01-4d2d-a809-7fdb49ecdbbb+13:13828:x1870073673397888:12345-192.168.201.13@tcp:502:llog_process_th.0 Request processed in 408us (768us total) trans 0 rc 0/0 00000100:00100000:0.0:1783441660.735055:0:14156:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.13@tcp, seq: 101 00000100:00100000:3.0:1783441660.737846:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.13@tcp (source: 12345-192.168.201.13@tcp) 00000100:00100000:2.0:1783441660.745701:0:14157:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073673398016 00000100:00100000:2.0:1783441660.745726:0:14157:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073673398016 00000100:00100000:2.0:1783441660.745830:0:14157:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.13@tcp, seq: 102 00000100:00100000:2.0:1783441660.745843:0:14157:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a87563ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6a88b831-6e01-4d2d-a809-7fdb49ecdbbb+13:13828:x1870073673398016:12345-192.168.201.13@tcp:502:llog_process_th.0 00000100:00100000:2.0:1783441660.746695:0:14157:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a87563ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6a88b831-6e01-4d2d-a809-7fdb49ecdbbb+13:13828:x1870073673398016:12345-192.168.201.13@tcp:502:llog_process_th.0 Request processed in 848us (8856us total) trans 0 rc 0/0 00000100:00100000:2.0:1783441660.746707:0:14157:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.13@tcp, seq: 102 00000100:00100000:1.0:1783441660.766857:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.13@tcp (source: 12345-192.168.201.13@tcp) 00000100:00100000:1.0:1783441660.766907:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.13@tcp (source: 12345-192.168.201.13@tcp) 00000100:00100000:1.0:1783441660.766947:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.13@tcp (source: 12345-192.168.201.13@tcp) 00000100:00100000:1.0:1783441660.766980:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.13@tcp (source: 12345-192.168.201.13@tcp) 00000100:00100000:0.0:1783441660.767063:0:14798:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073673398656 00000100:00100000:0.0:1783441660.767075:0:14798:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073673398656 00000100:00100000:0.0:1783441660.767134:0:14798:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073673398784 00000100:00100000:0.0:1783441660.767136:0:14798:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073673398784 00000100:00100000:0.0:1783441660.767150:0:14798:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.13@tcp, seq: 4 00000100:00100000:0.0:1783441660.767158:0:14798:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a745551f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:29d872ae-bafc-4783-9a98-d2418cedf182+5:2354:x1870073673398656:12345-192.168.201.13@tcp:400:kworker.0 00000100:00100000:0.0:1783441660.767247:0:14798:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a745551f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:29d872ae-bafc-4783-9a98-d2418cedf182+5:2354:x1870073673398656:12345-192.168.201.13@tcp:400:kworker.0 Request processed in 88us (403us total) trans 0 rc 0/0 00000100:00100000:0.0:1783441660.767255:0:14798:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.13@tcp, seq: 4 00000100:00100000:0.0:1783441660.767276:0:14798:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.13@tcp, seq: 5 00000100:00100000:0.0:1783441660.767283:0:14798:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a867cd4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:29d872ae-bafc-4783-9a98-d2418cedf182+6:2354:x1870073673398784:12345-192.168.201.13@tcp:400:kworker.0 00000100:00100000:0.0:1783441660.767310:0:14798:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a867cd4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:29d872ae-bafc-4783-9a98-d2418cedf182+6:2354:x1870073673398784:12345-192.168.201.13@tcp:400:kworker.0 Request processed in 28us (363us total) trans 0 rc 0/0 00000100:00100000:0.0:1783441660.767316:0:14798:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.13@tcp, seq: 5 00000100:00100000:2.0:1783441660.767398:0:14162:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073673398528 00000100:00100000:2.0:1783441660.767419:0:14162:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073673398528 00000100:00100000:2.0:1783441660.767460:0:14162:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073673398144 00000100:00100000:2.0:1783441660.767471:0:14162:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073673398144 00000100:00100000:2.0:1783441660.767491:0:14162:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.13@tcp, seq: 16 00000100:00100000:2.0:1783441660.767499:0:14162:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a867cd7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:29d872ae-bafc-4783-9a98-d2418cedf182+7:2354:x1870073673398528:12345-192.168.201.13@tcp:400:kworker.0 00000100:00100000:2.0:1783441660.767534:0:14162:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a867cd7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:29d872ae-bafc-4783-9a98-d2418cedf182+7:2354:x1870073673398528:12345-192.168.201.13@tcp:400:kworker.0 Request processed in 36us (627us total) trans 0 rc 0/0 00000100:00100000:2.0:1783441660.767551:0:14162:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.13@tcp, seq: 16 00000100:00100000:2.0:1783441660.767576:0:14162:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.13@tcp, seq: 10 00000100:00100000:2.0:1783441660.767581:0:14162:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a867cd4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:2351:x1870073673398144:12345-192.168.201.13@tcp:38:mount.lustre.0 00010000:00080000:2.0:1783441660.767609:0:14162:0:(ldlm_lib.c:1432:target_handle_connect()) lustre-MDT0000: connection from bba70d1d-69c0-42ad-a2ea-85acf70f57f0@192.168.201.13@tcp t0 exp 0000000000000000 cur 498 last 0 00000020:00000080:2.0:1783441660.767657:0:14162:0:(genops.c:1406:class_connect()) connect: client bba70d1d-69c0-42ad-a2ea-85acf70f57f0, cookie 0xa2426164df2c8b6a 00000004:00100000:2.0:1783441660.767699:0:14162:0:(mdt_handler.c:7282:mdt_connect_internal()) lustre-MDT0000: cli supports cksum type f7, return f7 00000100:00080000:2.0:1783441660.767874:0:14162:0:(import.c:65:import_set_state_nolock()) ffff91a8748ed000 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1783441660.767912:0:14162:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a867cd4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:bba70d1d-69c0-42ad-a2ea-85acf70f57f0+6:2351:x1870073673398144:12345-192.168.201.13@tcp:38:mount.lustre.0 Request processed in 328us (929us total) trans 0 rc 0/0 00000100:00100000:2.0:1783441660.767920:0:14162:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.13@tcp, seq: 10 00000100:00100000:3.0:1783441660.770570:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.13@tcp (source: 12345-192.168.201.13@tcp) 00000100:00100000:2.0:1783441660.770804:0:14162:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073673398272 00000100:00100000:2.0:1783441660.770817:0:14162:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073673398272 00000100:00100000:2.0:1783441660.770914:0:14162:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.13@tcp, seq: 11 00000100:00100000:2.0:1783441660.770924:0:14162:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a745a79880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:bba70d1d-69c0-42ad-a2ea-85acf70f57f0+6:0:x1870073673398272:12345-192.168.201.13@tcp:41:mount.lustre.0 00000004:00000024:2.0:1783441660.770968:0:14162:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 6815744 pending 0 free 2261647360 avail 2259550208 00000100:00100000:2.0:1783441660.771072:0:14162:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a745a79880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:bba70d1d-69c0-42ad-a2ea-85acf70f57f0+6:0:x1870073673398272:12345-192.168.201.13@tcp:41:mount.lustre.0 Request processed in 148us (522us total) trans 0 rc 0/0 00000100:00100000:2.0:1783441660.771080:0:14162:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.13@tcp, seq: 11 00000100:00080000:0.0:1783441660.771218:0:14159:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1783441660.783948:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.13@tcp (source: 12345-192.168.201.13@tcp) 00000100:00100000:1.0:1783441660.784097:0:14163:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073673398400 00000100:00100000:1.0:1783441660.784112:0:14163:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073673398400 00000100:00100000:1.0:1783441660.784192:0:14163:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.13@tcp, seq: 12 00000100:00100000:1.0:1783441660.784204:0:14163:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a745a78700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:bba70d1d-69c0-42ad-a2ea-85acf70f57f0+6:13820:x1870073673398400:12345-192.168.201.13@tcp:41:mount.lustre.0 00000004:00000024:1.0:1783441660.784249:0:14163:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 6815744 pending 0 free 2261647360 avail 2259550208 00000100:00100000:1.0:1783441660.784346:0:14163:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a745a78700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:bba70d1d-69c0-42ad-a2ea-85acf70f57f0+6:13820:x1870073673398400:12345-192.168.201.13@tcp:41:mount.lustre.0 Request processed in 143us (413us total) trans 0 rc 0/0 00000100:00100000:1.0:1783441660.784354:0:14163:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.13@tcp, seq: 12 00010000:00010000:0.0:1783441660.787757:0:14151:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1783441660.790030:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.13@tcp (source: 12345-192.168.201.13@tcp) 00000100:00100000:2.0:1783441660.790306:0:14162:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073673398912 00000100:00100000:2.0:1783441660.790341:0:14162:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073673398912 00000100:00100000:2.0:1783441660.790421:0:14162:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.13@tcp, seq: 13 00000100:00100000:2.0:1783441660.790433:0:14162:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a745a79f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:bba70d1d-69c0-42ad-a2ea-85acf70f57f0+6:13820:x1870073673398912:12345-192.168.201.13@tcp:40:mount.lustre.0 00000100:00100000:2.0:1783441660.790581:0:14162:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a745a79f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:bba70d1d-69c0-42ad-a2ea-85acf70f57f0+6:13820:x1870073673398912:12345-192.168.201.13@tcp:40:mount.lustre.0 Request processed in 149us (564us total) trans 0 rc 0/0 00000100:00100000:2.0:1783441660.790590:0:14162:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.13@tcp, seq: 13 00000100:00100000:2.0:1783441660.795632:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.13@tcp (source: 12345-192.168.201.13@tcp) 00000100:00100000:2.0:1783441660.795691:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.13@tcp (source: 12345-192.168.201.13@tcp) 00000100:00100000:0.0:1783441660.795918:0:14798:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073673399040 00000100:00100000:0.0:1783441660.795933:0:14798:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073673399040 00000100:00100000:0.0:1783441660.796003:0:14798:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073673399168 00000100:00100000:0.0:1783441660.796007:0:14798:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073673399168 00000100:00100000:0.0:1783441660.796025:0:14798:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.13@tcp, seq: 10 00000100:00100000:0.0:1783441660.796036:0:14798:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a859086d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:2351:x1870073673399040:12345-192.168.201.13@tcp:8:mount.lustre.0 00010000:00080000:0.0:1783441660.796098:0:14798:0:(ldlm_lib.c:1432:target_handle_connect()) lustre-OST0000: connection from bba70d1d-69c0-42ad-a2ea-85acf70f57f0@192.168.201.13@tcp t0 exp 0000000000000000 cur 498 last 0 00000020:00000080:0.0:1783441660.796145:0:14798:0:(genops.c:1406:class_connect()) connect: client bba70d1d-69c0-42ad-a2ea-85acf70f57f0, cookie 0xa2426164df2c8b71 00002000:00100000:0.0:1783441660.796160:0:14798:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli bba70d1d-69c0-42ad-a2ea-85acf70f57f0/ffff91a8503da000 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113669 ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:0.0:1783441660.796175:0:14798:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0000: cli supports cksum type f7, return f7 00002000:00080000:0.0:1783441660.796532:0:14798:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:0.0:1783441660.796601:0:14798:0:(import.c:65:import_set_state_nolock()) ffff91a8503d8000 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1783441660.796716:0:14798:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a859086d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:bba70d1d-69c0-42ad-a2ea-85acf70f57f0+6:2351:x1870073673399040:12345-192.168.201.13@tcp:8:mount.lustre.0 Request processed in 679us (1097us total) trans 0 rc 0/0 00000100:00100000:0.0:1783441660.796725:0:14798:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.13@tcp, seq: 10 00000100:00100000:0.0:1783441660.796798:0:14798:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.13@tcp, seq: 11 00000100:00100000:0.0:1783441660.796803:0:14798:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a859087800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:2351:x1870073673399168:12345-192.168.201.13@tcp:8:mount.lustre.0 00010000:00080000:0.0:1783441660.796826:0:14798:0:(ldlm_lib.c:1432:target_handle_connect()) lustre-OST0001: connection from bba70d1d-69c0-42ad-a2ea-85acf70f57f0@192.168.201.13@tcp t0 exp 0000000000000000 cur 498 last 0 00000020:00000080:0.0:1783441660.796848:0:14798:0:(genops.c:1406:class_connect()) connect: client bba70d1d-69c0-42ad-a2ea-85acf70f57f0, cookie 0xa2426164df2c8b78 00002000:00100000:0.0:1783441660.796855:0:14798:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli bba70d1d-69c0-42ad-a2ea-85acf70f57f0/ffff91a8503d9000 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113669 ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:0.0:1783441660.796863:0:14798:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0001: cli supports cksum type f7, return f7 00002000:00080000:0.0:1783441660.796931:0:14798:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:0.0:1783441660.796947:0:14798:0:(import.c:65:import_set_state_nolock()) ffff91a8503df000 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1783441660.796975:0:14798:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a859087800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:bba70d1d-69c0-42ad-a2ea-85acf70f57f0+6:2351:x1870073673399168:12345-192.168.201.13@tcp:8:mount.lustre.0 Request processed in 170us (1284us total) trans 0 rc 0/0 00000100:00100000:0.0:1783441660.796982:0:14798:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.13@tcp, seq: 11 00000100:00100000:3.0:1783441660.802732:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.13@tcp (source: 12345-192.168.201.13@tcp) 00000100:00100000:0.0:1783441660.803826:0:14166:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073673399296 00000100:00100000:0.0:1783441660.803847:0:14166:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073673399296 00000100:00100000:0.0:1783441660.803928:0:14166:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.13@tcp, seq: 1 00000100:00100000:0.0:1783441660.803941:0:14166:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a745a7bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:bba70d1d-69c0-42ad-a2ea-85acf70f57f0+6:13820:x1870073673399296:12345-192.168.201.13@tcp:33:mount.lustre.0 00000004:00200000:0.0:1783441660.804311:0:14166:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 7680 00000100:00100000:0.0:1783441660.804515:0:14166:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a745a7bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:bba70d1d-69c0-42ad-a2ea-85acf70f57f0+6:13820:x1870073673399296:12345-192.168.201.13@tcp:33:mount.lustre.0 Request processed in 575us (1799us total) trans 0 rc 0/0 00000100:00100000:0.0:1783441660.804525:0:14166:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.13@tcp, seq: 1 00000100:00100000:2.0:1783441660.968329:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.13@tcp (source: 12345-192.168.201.13@tcp) 00000100:00100000:1.0:1783441660.968441:0:14163:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073673399424 00000100:00100000:1.0:1783441660.968454:0:14163:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073673399424 00000100:00100000:1.0:1783441660.968547:0:14163:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.13@tcp, seq: 14 00000100:00100000:1.0:1783441660.968567:0:14163:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a859085500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:bba70d1d-69c0-42ad-a2ea-85acf70f57f0+6:13850:x1870073673399424:12345-192.168.201.13@tcp:101:mkdir.0 00010000:00010000:1.0:1783441660.968597:0:14163:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1783441660.968626:0:14163:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91a87da47600/0xa2426164df2c8b7f lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x633a354aa4df51e9 expref: -99 pid: 14163 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783441660.968714:0:14163:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff91a87da46800/0xa2426164df2c8b86 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 14163 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783441660.968730:0:14163:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91a87da46800/0xa2426164df2c8b86 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14163 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783441660.968818:0:14163:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91a87da46800/0xa2426164df2c8b86 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14163 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1783441660.969107:0:14163:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 7680 00000004:00200000:1.0:1783441660.969112:0:14163:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 3 stripe count 1 MDT count 1 00000004:00010000:1.0:1783441660.969201:0:14163:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff91a87da46800/0xa2426164df2c8b86 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14163 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783441660.969236:0:14163:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91a87da47600/0xa2426164df2c8b7f lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.13@tcp remote: 0x633a354aa4df51e9 expref: 8 pid: 14163 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783441660.969261:0:14163:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff91a87da46800/0xa2426164df2c8b86 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.13@tcp remote: 0x633a354aa4df51e9 expref: 7 pid: 14163 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783441660.969271:0:14163:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff91a8439b0600) 00010000:00010000:1.0:1783441660.969274:0:14163:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1783441660.969279:0:14163:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91a87da46800, rc 0) 00000100:00100000:1.0:1783441660.969365:0:14163:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a859085500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:bba70d1d-69c0-42ad-a2ea-85acf70f57f0+7:13850:x1870073673399424:12345-192.168.201.13@tcp:101:mkdir.0 Request processed in 801us (1049us total) trans 0 rc 0/0 00000100:00100000:1.0:1783441660.969374:0:14163:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.13@tcp, seq: 14 00000040:00080000:2.0:1783441661.293725:0:14197:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:0.0:1783441661.805351:0:14152:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1783441662.325175:0:3305:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff91a745a7b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:94394728-4014-4ef0-b525-989290f008aa:3305:1870073693315712:0@lo:400:kworker.0 00000100:00100000:3.0:1783441662.325288:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783441662.325348:0:3305:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff91a745a78380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3305:1870073693316224:0@lo:400:kworker.0 00000100:00100000:3.0:1783441662.325380:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783441662.325410:0:3305:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:3.0:1783441662.325417:0:3305:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff91a745a78000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3305:1870073693315840:0@lo:400:kworker.0 00000100:00100000:3.0:1783441662.325448:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783441662.325467:0:3305:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff91a874dcdc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3305:1870073693316352:0@lo:400:kworker.0 00000100:00100000:3.0:1783441662.325492:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783441662.328758:0:3303:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff91a745a79500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3303:1870073693315968:0@lo:400:kworker.0 00000100:00100000:3.0:1783441662.328868:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783441662.328921:0:3303:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1783441662.328929:0:3303:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff91a745a7ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3303:1870073693316096:0@lo:400:kworker.0 00000100:00100000:3.0:1783441662.328959:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783441662.329010:0:14156:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073693315712 00000100:00100000:3.0:1783441662.329021:0:14156:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073693315712 00000100:00100000:3.0:1783441662.329093:0:14156:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 103 00000100:00100000:3.0:1783441662.329103:0:14156:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a87563e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:94394728-4014-4ef0-b525-989290f008aa+19:3305:x1870073693315712:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1783441662.329176:0:14156:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a87563e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:94394728-4014-4ef0-b525-989290f008aa+19:3305:x1870073693315712:12345-0@lo:400:kworker.0 Request processed in 72us (3888us total) trans 0 rc 0/0 00000100:00100000:3.0:1783441662.329185:0:14156:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 103 00000100:00100000:3.0:1783441662.334384:0:14798:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073693315840 00000100:00100000:3.0:1783441662.334407:0:14798:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073693315840 00000100:00100000:3.0:1783441662.334506:0:14798:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073693315968 00000100:00100000:3.0:1783441662.336114:0:14798:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073693315968 00000100:00100000:3.0:1783441662.336208:0:14798:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:3.0:1783441662.336222:0:14798:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a874dcc700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3305:x1870073693315840:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1783441662.336353:0:14798:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a874dcc700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3305:x1870073693315840:12345-0@lo:400:kworker.0 Request processed in 135us (10903us total) trans 0 rc 0/0 00000100:00100000:3.0:1783441662.336361:0:14798:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:3.0:1783441662.336391:0:14798:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:3.0:1783441662.336397:0:14798:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a874dcd880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3303:x1870073693315968:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1783441662.336447:0:14798:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a874dcd880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3303:x1870073693315968:12345-0@lo:400:kworker.0 Request processed in 50us (7579us total) trans 0 rc 0/0 00000100:00100000:3.0:1783441662.336453:0:14798:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:3.0:1783441662.336490:0:14821:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073693316224 00000100:00100000:3.0:1783441662.336495:0:14821:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073693316224 00000100:00100000:2.0:1783441662.337991:0:14162:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073693316352 00000100:00100000:2.0:1783441662.338002:0:14162:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073693316352 00000100:00100000:0.0:1783441662.338053:0:3304:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1783441662.338057:0:14162:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073693316096 00000100:00100000:2.0:1783441662.338060:0:14162:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073693316096 00000100:00100000:2.0:1783441662.338078:0:14162:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:0.0:1783441662.338079:0:3304:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff91a859086680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3304:1870073693316480:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1783441662.338086:0:14162:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a874dcdf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3305:x1870073693316352:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1783441662.338184:0:14821:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:3.0:1783441662.338193:0:14821:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a874dced80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3303:x1870073693316096:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1783441662.340334:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:0.0:1783441662.340835:0:14159:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1783441662.340844:0:14159:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1783441662.340849:0:14159:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1783441662.341286:0:3305:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff91a745a78000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3305:1870073693315840:0@lo:400:kworker.0 00000100:00100000:0.0:1783441662.341314:0:3305:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff91a745a7b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:94394728-4014-4ef0-b525-989290f008aa:3305:1870073693315712:0@lo:400:kworker.0 00000100:00100000:0.0:1783441662.341370:0:14163:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 4 min 3 max 116 00000100:00100000:0.0:1783441662.341384:0:14163:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt00_004' 00000100:00100000:0.0:1783441662.342057:0:14163:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:0.0:1783441662.342077:0:14163:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a874dcea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3305:x1870073693316224:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1783441662.342294:0:14163:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a874dcea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3305:x1870073693316224:12345-0@lo:400:kworker.0 Request processed in 225us (16912us total) trans 0 rc 0/0 00000100:00100000:0.0:1783441662.342303:0:14163:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00100000:0.0:1783441662.342372:0:3305:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff91a745a78380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3305:1870073693316224:0@lo:400:kworker.0 00000100:00100000:0.0:1783441662.345328:0:14801:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073693316480 00000100:00100000:0.0:1783441662.345350:0:14801:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073693316480 00000100:00100000:0.0:1783441662.345426:0:14801:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:0.0:1783441662.345565:0:14801:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a877face00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3304:x1870073693316480:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1783441662.345644:0:14801:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1783441662.345780:0:14801:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a877face00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3304:x1870073693316480:12345-0@lo:13:osp-pre-1-0.0 Request processed in 343us (5457us total) trans 0 rc 0/0 00000100:00100000:0.0:1783441662.345788:0:14801:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:0.0:1783441662.345858:0:3303:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 8589934593 gen 2 00000100:00100000:0.0:1783441662.345885:0:3303:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff91a745a79500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3303:1870073693315968:0@lo:400:kworker.0 00000100:00100000:0.0:1783441662.345947:0:3304:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff91a859086680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3304:1870073693316480:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1783441662.347222:0:14821:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a874dced80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3303:x1870073693316096:12345-0@lo:400:kworker.0 Request processed in 9022us (18254us total) trans 0 rc 0/0 00000100:00100000:3.0:1783441662.347236:0:14821:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:3.0:1783441662.347299:0:3303:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff91a745a7ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3303:1870073693316096:0@lo:400:kworker.0 00000100:00100000:2.0:1783441662.357782:0:14162:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a874dcdf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3305:x1870073693316352:12345-0@lo:400:kworker.0 Request processed in 19679us (32271us total) trans 0 rc 0/0 00000100:00100000:2.0:1783441662.357803:0:14162:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:0.0:1783441662.357832:0:3305:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff91a874dcdc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3305:1870073693316352:0@lo:400:kworker.0 00000001:00100000:0.0:1783441662.397852:0:7492:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of bba70d1d-69c0-42ad-a2ea-85acf70f57f0 00000001:00100000:0.0:1783441662.397875:0:7492:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of 29d872ae-bafc-4783-9a98-d2418cedf182 00010000:00010000:0.0:1783441662.831992:0:14151:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:2.0:1783441662.980416:0:5807:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of bba70d1d-69c0-42ad-a2ea-85acf70f57f0 00000001:00100000:2.0:1783441662.980461:0:5807:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of 29d872ae-bafc-4783-9a98-d2418cedf182 00000001:00100000:0.0:1783441663.456820:0:6613:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of bba70d1d-69c0-42ad-a2ea-85acf70f57f0 00010000:00010000:1.0:1783441663.855625:0:14152:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:1.0:1783441663.932136:0:16028:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: Using TIMEOUT=20 00010000:00010000:0.0:1783441664.877174:0:14151:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1783441665.392645:0:3304:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff91a867cd6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3304:1870073693316608:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1783441665.392783:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783441665.392890:0:14801:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073693316608 00000100:00100000:2.0:1783441665.392902:0:14801:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073693316608 00000100:00100000:2.0:1783441665.393010:0:14801:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:2.0:1783441665.393022:0:14801:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a859085880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3304:x1870073693316608:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1783441665.393088:0:14801:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1783441665.393154:0:14801:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a859085880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3304:x1870073693316608:12345-0@lo:13:osp-pre-0-0.0 Request processed in 135us (371us total) trans 0 rc 0/0 00000100:00100000:2.0:1783441665.393162:0:14801:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:2.0:1783441665.393233:0:3304:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff91a867cd6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3304:1870073693316608:0@lo:13:osp-pre-0-0.0 00000100:00080000:1.0:1783441665.393301:0:14159:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:1.0:1783441665.906222:0:14152:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1783441665.916109:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.13@tcp (source: 12345-192.168.201.13@tcp) 00000100:00100000:2.0:1783441665.916182:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.13@tcp (source: 12345-192.168.201.13@tcp) 00000100:00100000:2.0:1783441665.916216:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.13@tcp (source: 12345-192.168.201.13@tcp) 00000100:00100000:2.0:1783441665.916241:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.13@tcp (source: 12345-192.168.201.13@tcp) 00000100:00100000:2.0:1783441665.916263:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.13@tcp (source: 12345-192.168.201.13@tcp) 00000100:00100000:2.0:1783441665.916282:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.13@tcp (source: 12345-192.168.201.13@tcp) 00000100:00100000:2.0:1783441665.916306:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.13@tcp (source: 12345-192.168.201.13@tcp) 00000100:00100000:2.0:1783441665.918119:0:14798:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073673399808 00000100:00100000:2.0:1783441665.918140:0:14798:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073673399808 00000100:00100000:2.0:1783441665.918290:0:14798:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073673400320 00000100:00100000:2.0:1783441665.918296:0:14798:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073673400320 00000100:00100000:2.0:1783441665.918324:0:14798:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073673399936 00000100:00100000:2.0:1783441665.918328:0:14798:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073673399936 00000100:00100000:2.0:1783441665.918343:0:14798:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073673400192 00000100:00100000:2.0:1783441665.918346:0:14798:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073673400192 00000100:00100000:2.0:1783441665.918386:0:14798:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.13@tcp, seq: 8 00000100:00100000:2.0:1783441665.918399:0:14798:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a859084000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:29d872ae-bafc-4783-9a98-d2418cedf182+5:2354:x1870073673399808:12345-192.168.201.13@tcp:400:kworker.0 00000100:00100000:2.0:1783441665.918820:0:14798:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a859084000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:29d872ae-bafc-4783-9a98-d2418cedf182+5:2354:x1870073673399808:12345-192.168.201.13@tcp:400:kworker.0 Request processed in 129us (2341us total) trans 0 rc 0/0 00000100:00100000:2.0:1783441665.918831:0:14798:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.13@tcp, seq: 8 00000100:00100000:2.0:1783441665.918872:0:14798:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.13@tcp, seq: 9 00000100:00100000:2.0:1783441665.918880:0:14798:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a859086300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:bba70d1d-69c0-42ad-a2ea-85acf70f57f0+5:2354:x1870073673400320:12345-192.168.201.13@tcp:400:kworker.0 00000100:00100000:2.0:1783441665.918946:0:14798:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a859086300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:bba70d1d-69c0-42ad-a2ea-85acf70f57f0+5:2354:x1870073673400320:12345-192.168.201.13@tcp:400:kworker.0 Request processed in 67us (2703us total) trans 0 rc 0/0 00000100:00100000:2.0:1783441665.918953:0:14798:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.13@tcp, seq: 9 00000100:00100000:2.0:1783441665.918969:0:14798:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.13@tcp, seq: 10 00000100:00100000:2.0:1783441665.918975:0:14798:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a859084a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:29d872ae-bafc-4783-9a98-d2418cedf182+5:2354:x1870073673399936:12345-192.168.201.13@tcp:400:kworker.0 00000100:00100000:2.0:1783441665.919000:0:14798:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a859084a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:29d872ae-bafc-4783-9a98-d2418cedf182+5:2354:x1870073673399936:12345-192.168.201.13@tcp:400:kworker.0 Request processed in 26us (2717us total) trans 0 rc 0/0 00000100:00100000:2.0:1783441665.919007:0:14798:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.13@tcp, seq: 10 00000100:00100000:2.0:1783441665.919020:0:14798:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.13@tcp, seq: 11 00000100:00100000:2.0:1783441665.919027:0:14798:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a859085f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:bba70d1d-69c0-42ad-a2ea-85acf70f57f0+5:2354:x1870073673400192:12345-192.168.201.13@tcp:400:kworker.0 00000100:00100000:2.0:1783441665.919052:0:14798:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a859085f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:bba70d1d-69c0-42ad-a2ea-85acf70f57f0+5:2354:x1870073673400192:12345-192.168.201.13@tcp:400:kworker.0 Request processed in 26us (2746us total) trans 0 rc 0/0 00000100:00100000:2.0:1783441665.919058:0:14798:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.13@tcp, seq: 11 00000100:00100000:2.0:1783441665.919082:0:14163:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073673400064 00000100:00100000:2.0:1783441665.919086:0:14163:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073673400064 00000100:00100000:2.0:1783441665.919122:0:14163:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073673399680 00000100:00100000:2.0:1783441665.919126:0:14163:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073673399680 00000100:00100000:2.0:1783441665.919229:0:14163:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.13@tcp, seq: 20 00000100:00100000:2.0:1783441665.919238:0:14163:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a859087480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:bba70d1d-69c0-42ad-a2ea-85acf70f57f0+6:2354:x1870073673400064:12345-192.168.201.13@tcp:400:kworker.0 00000100:00100000:2.0:1783441665.919271:0:14163:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a859087480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:bba70d1d-69c0-42ad-a2ea-85acf70f57f0+6:2354:x1870073673400064:12345-192.168.201.13@tcp:400:kworker.0 Request processed in 34us (3054us total) trans 0 rc 0/0 00000100:00100000:2.0:1783441665.919279:0:14163:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.13@tcp, seq: 20 00000100:00100000:2.0:1783441665.919291:0:14163:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.13@tcp, seq: 21 00000100:00100000:2.0:1783441665.919297:0:14163:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a859086680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:29d872ae-bafc-4783-9a98-d2418cedf182+6:2354:x1870073673399680:12345-192.168.201.13@tcp:400:kworker.0 00000100:00100000:2.0:1783441665.919575:0:14163:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a859086680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:29d872ae-bafc-4783-9a98-d2418cedf182+6:2354:x1870073673399680:12345-192.168.201.13@tcp:400:kworker.0 Request processed in 277us (3310us total) trans 0 rc 0/0 00000100:00100000:2.0:1783441665.919582:0:14163:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.13@tcp, seq: 21 00000100:00080000:2.0:1783441665.919609:0:14159:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1783441665.919615:0:14159:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1783441665.919618:0:14159:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1783441665.920084:0:14155:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073673399552 00000100:00100000:0.0:1783441665.920091:0:14155:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073673399552 00000100:00100000:0.0:1783441665.920140:0:14155:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.13@tcp, seq: 104 00000100:00100000:0.0:1783441665.920149:0:14155:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a87563c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6a88b831-6e01-4d2d-a809-7fdb49ecdbbb+13:2354:x1870073673399552:12345-192.168.201.13@tcp:400:kworker.0 00000100:00100000:0.0:1783441665.920197:0:14155:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a87563c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6a88b831-6e01-4d2d-a809-7fdb49ecdbbb+13:2354:x1870073673399552:12345-192.168.201.13@tcp:400:kworker.0 Request processed in 50us (4106us total) trans 0 rc 0/0 00000100:00100000:0.0:1783441665.920204:0:14155:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.13@tcp, seq: 104 00010000:00010000:0.0:1783441666.925799:0:14151:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:2.0:1783441667.353041:0:16177:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007fffd024e930 20000000:00000080:2.0:1783441667.353066:0:16177:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff91a745c23000 uarg=0000000000000000 20000000:01000000:2.0:1783441667.353191:0:16177:0:(mgs_llog.c:6188:mgs_set_param2()) set_param2 fs='' device='general' param='lod.*.mdt_hash=crush' 20000000:01000000:2.0:1783441667.353199:0:16177:0:(mgs_llog.c:4643:mgs_write_log_param2()) next param 'lod.*.mdt_hash=crush' 20000000:01000000:2.0:1783441667.353205:0:16177:0:(mgs_llog.c:1379:mgs_modify_param()) modify params/general/lod.*.mdt_hash=crush del=0 00000040:00080000:1.0:1783441667.354625:0:16178:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 5 count 10 20000000:00000400:2.0:1783441667.355009:0:16177:0:(mgs_llog.c:1450:mgs_modify_param()) MGS: modify general/lod.*.mdt_hash=crush (mode = 0) failed: rc = -17 10000000:01000000:2.0:1783441667.362527:0:16177:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 00010000:00010000:2.0:1783441667.362997:0:16177:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff91a85f83d200/0xa2426164df2c8b8d lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 16177 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783441667.363026:0:16177:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff91a85f83d600/0xa2426164df2c8884 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xa2426164df2c887d expref: 18 pid: 14156 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783441667.363035:0:16177:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff91a85fe59a00/0xa2426164df2c88d1 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xa2426164df2c88ca expref: 18 pid: 14155 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783441667.363042:0:16177:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff91a87da47e00/0xa2426164df2c8a05 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xa2426164df2c89fe expref: 18 pid: 14156 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783441667.363053:0:16177:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff91a87da46400/0xa2426164df2c8b2b lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 192.168.201.13@tcp remote: 0x633a354aa4df515d expref: 12 pid: 14157 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783441667.363060:0:16177:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff91a85eb3de00/0xa2426164df2c8b63 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 192.168.201.13@tcp remote: 0x633a354aa4df51bf expref: 12 pid: 14155 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783441667.363087:0:16177:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff91a85f83d200/0xa2426164df2c8b8d lrc: 8/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 16177 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783441667.363149:0:16177:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff91a85eb3de00/0xa2426164df2c8b63 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 192.168.201.13@tcp remote: 0x633a354aa4df51bf expref: 12 pid: 14155 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783441667.363170:0:16177:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff91a85eb3de00/0xa2426164df2c8b63 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 192.168.201.13@tcp remote: 0x633a354aa4df51bf expref: 12 pid: 14155 timeout: 605 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783441667.363190:0:16177:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff91a87d793480 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:16177:1870073693316736:192.168.201.13@tcp:104: 00010000:00010000:2.0:1783441667.363387:0:16177:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff91a87da46400/0xa2426164df2c8b2b lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 192.168.201.13@tcp remote: 0x633a354aa4df515d expref: 12 pid: 14157 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783441667.363396:0:16177:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff91a87da46400/0xa2426164df2c8b2b lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 192.168.201.13@tcp remote: 0x633a354aa4df515d expref: 12 pid: 14157 timeout: 605 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783441667.363406:0:16177:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff91a87d792a00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:16177:1870073693316864:192.168.201.13@tcp:104: 00010000:00010000:2.0:1783441667.363454:0:16177:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff91a87da47e00/0xa2426164df2c8a05 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xa2426164df2c89fe expref: 18 pid: 14156 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783441667.363462:0:16177:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff91a87da47e00/0xa2426164df2c8a05 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xa2426164df2c89fe expref: 18 pid: 14156 timeout: 605 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783441667.363472:0:16177:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff91a87d791f80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:16177:1870073693316992:0@lo:104: 00000100:00100000:2.0:1783441667.363519:0:16177:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783441667.363561:0:14146:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073693316992 00000100:00100000:1.0:1783441667.363571:0:14146:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073693316992 00010000:00010000:2.0:1783441667.363573:0:16177:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff91a85fe59a00/0xa2426164df2c88d1 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xa2426164df2c88ca expref: 18 pid: 14155 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783441667.363592:0:16177:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff91a85fe59a00/0xa2426164df2c88d1 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xa2426164df2c88ca expref: 18 pid: 14155 timeout: 605 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783441667.363601:0:16177:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff91a87d790e00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:16177:1870073693317120:0@lo:104: 00000100:00100000:1.0:1783441667.363635:0:14146:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:2.0:1783441667.363640:0:16177:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783441667.363647:0:14146:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a87d791180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:94394728-4014-4ef0-b525-989290f008aa+3:16177:x1870073693316992:12345-0@lo:104: 00010000:00010000:2.0:1783441667.363657:0:16177:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff91a85f83d600/0xa2426164df2c8884 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xa2426164df2c887d expref: 18 pid: 14156 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783441667.363665:0:16177:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff91a85f83d600/0xa2426164df2c8884 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xa2426164df2c887d expref: 18 pid: 14156 timeout: 605 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783441667.363668:0:14146:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.113@tcp lock: ffff91a85fe59400/0xa2426164df2c89fe lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xa2426164df2c8a05 expref: -99 pid: 15467 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783441667.363672:0:16177:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff91a87d790000 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:16177:1870073693317248:0@lo:104: 00000100:00100000:2.0:1783441667.363705:0:16177:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783441667.363715:0:16177:0:(client.c:2702:ptlrpc_set_wait()) set ffff91a8504500c0 going to sleep for 11 seconds 00010000:00010000:1.0:1783441667.363726:0:14146:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:1.0:1783441667.363732:0:14146:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a87d791180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:94394728-4014-4ef0-b525-989290f008aa+3:16177:x1870073693316992:12345-0@lo:104: Request processed in 87us (213us total) trans 0 rc 0/0 00000100:00100000:1.0:1783441667.363753:0:14146:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:2.0:1783441667.363756:0:16177:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff91a87d791f80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:16177:1870073693316992:0@lo:104: 00000100:00100000:1.0:1783441667.363783:0:14146:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/2 left), rc = 0 00000100:00100000:1.0:1783441667.364382:0:14146:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073693317120 00000100:00100000:1.0:1783441667.364388:0:14146:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073693317120 00000100:00100000:1.0:1783441667.364411:0:14146:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073693317248 00000100:00100000:1.0:1783441667.364414:0:14146:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073693317248 00000100:00100000:1.0:1783441667.364439:0:14146:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:1.0:1783441667.364446:0:14146:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a87d791500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:94394728-4014-4ef0-b525-989290f008aa+4:16177:x1870073693317120:12345-0@lo:104: 00010000:00010000:1.0:1783441667.364458:0:14146:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.113@tcp lock: ffff91a85f83c600/0xa2426164df2c88ca lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xa2426164df2c88d1 expref: -99 pid: 14796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783441667.364514:0:14146:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:1.0:1783441667.364520:0:14146:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a87d791500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:94394728-4014-4ef0-b525-989290f008aa+4:16177:x1870073693317120:12345-0@lo:104: Request processed in 75us (879us total) trans 0 rc 0/0 00000100:00100000:1.0:1783441667.364526:0:14146:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:1.0:1783441667.364538:0:14146:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:1.0:1783441667.364544:0:14146:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a877f68850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:94394728-4014-4ef0-b525-989290f008aa+3:16177:x1870073693317248:12345-0@lo:104: 00010000:00010000:1.0:1783441667.364552:0:14146:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.113@tcp lock: ffff91a85fe58a00/0xa2426164df2c887d lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xa2426164df2c8884 expref: -99 pid: 14160 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783441667.364580:0:14146:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to priority blp list, 3 blwis in pool 00000100:00100000:1.0:1783441667.364584:0:14146:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a877f68850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:94394728-4014-4ef0-b525-989290f008aa+3:16177:x1870073693317248:12345-0@lo:104: Request processed in 42us (879us total) trans 0 rc 0/0 00000100:00100000:1.0:1783441667.364601:0:14146:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00010000:00010000:1.0:1783441667.364654:0:14152:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:1.0:1783441667.364662:0:14152:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.113@tcp lock: ffff91a85fe59400/0xa2426164df2c89fe lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xa2426164df2c8a05 expref: -99 pid: 15467 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783441667.364671:0:14152:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91a85fe59400 already unused, calling callback (ffffffffc1b78c20) 10000000:00010000:1.0:1783441667.364676:0:14152:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.113@tcp lock: ffff91a85fe59400/0xa2426164df2c89fe lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0xa2426164df2c8a05 expref: -99 pid: 15467 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783441667.364686:0:14152:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.113@tcp lock: ffff91a85fe59400/0xa2426164df2c89fe lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0xa2426164df2c8a05 expref: -99 pid: 15467 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1783441667.364694:0:14152:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.113@tcp lock: ffff91a85fe59400/0xa2426164df2c89fe lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0xa2426164df2c8a05 expref: -99 pid: 15467 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1783441667.364701:0:14152:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:1.0:1783441667.364755:0:14152:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.113@tcp lock: ffff91a85fe59400/0xa2426164df2c89fe lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xa2426164df2c8a05 expref: -99 pid: 15467 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783441667.364763:0:14152:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1783441667.364785:0:14152:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.113@tcp lock: ffff91a85fe59400/0xa2426164df2c89fe lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xa2426164df2c8a05 expref: -99 pid: 15467 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783441667.364792:0:14152:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.113@tcp lock: ffff91a85fe59400/0xa2426164df2c89fe lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xa2426164df2c8a05 expref: -99 pid: 15467 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783441667.364808:0:14152:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1783441667.364811:0:14152:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.113@tcp lock: ffff91a85f83c600/0xa2426164df2c88ca lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xa2426164df2c88d1 expref: -99 pid: 14796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783441667.364828:0:14152:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91a85f83c600 already unused, calling callback (ffffffffc1b78c20) 10000000:00010000:1.0:1783441667.364831:0:14152:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.113@tcp lock: ffff91a85f83c600/0xa2426164df2c88ca lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0xa2426164df2c88d1 expref: -99 pid: 14796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783441667.364838:0:14152:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.113@tcp lock: ffff91a85f83c600/0xa2426164df2c88ca lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0xa2426164df2c88d1 expref: -99 pid: 14796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1783441667.364844:0:14152:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.113@tcp lock: ffff91a85f83c600/0xa2426164df2c88ca lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0xa2426164df2c88d1 expref: -99 pid: 14796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1783441667.364849:0:14152:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:1.0:1783441667.364875:0:14152:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.113@tcp lock: ffff91a85f83c600/0xa2426164df2c88ca lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xa2426164df2c88d1 expref: -99 pid: 14796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783441667.364881:0:14152:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1783441667.364887:0:14152:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.113@tcp lock: ffff91a85f83c600/0xa2426164df2c88ca lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xa2426164df2c88d1 expref: -99 pid: 14796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783441667.364894:0:14152:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.113@tcp lock: ffff91a85f83c600/0xa2426164df2c88ca lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xa2426164df2c88d1 expref: -99 pid: 14796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783441667.364903:0:14152:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1783441667.364905:0:14152:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.113@tcp lock: ffff91a85fe58a00/0xa2426164df2c887d lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xa2426164df2c8884 expref: -99 pid: 14160 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783441667.365006:0:14152:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91a85fe58a00 already unused, calling callback (ffffffffc1b78c20) 10000000:00010000:1.0:1783441667.365009:0:14152:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.113@tcp lock: ffff91a85fe58a00/0xa2426164df2c887d lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xa2426164df2c8884 expref: -99 pid: 14160 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783441667.365026:0:14152:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.113@tcp lock: ffff91a85fe58a00/0xa2426164df2c887d lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xa2426164df2c8884 expref: -99 pid: 14160 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1783441667.365033:0:14152:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.113@tcp lock: ffff91a85fe58a00/0xa2426164df2c887d lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xa2426164df2c8884 expref: -99 pid: 14160 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1783441667.365038:0:14152:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:1.0:1783441667.365051:0:14152:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.113@tcp lock: ffff91a85fe58a00/0xa2426164df2c887d lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xa2426164df2c8884 expref: -99 pid: 14160 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783441667.365057:0:14152:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1783441667.365074:0:14152:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.113@tcp lock: ffff91a85fe58a00/0xa2426164df2c887d lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xa2426164df2c8884 expref: -99 pid: 14160 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783441667.365081:0:14152:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.113@tcp lock: ffff91a85fe58a00/0xa2426164df2c887d lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xa2426164df2c8884 expref: -99 pid: 14160 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783441667.365098:0:14152:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783441667.365099:0:14152:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783441667.365101:0:14152:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783441667.365486:0:14151:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1783441667.365507:0:3305:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff91a867cd7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:94394728-4014-4ef0-b525-989290f008aa:3305:1870073693317376:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1783441667.365820:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783441667.365883:0:3305:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1783441667.365891:0:3305:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff91a867cd5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:94394728-4014-4ef0-b525-989290f008aa:3305:1870073693317504:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1783441667.365917:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783441667.365974:0:16177:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff91a87d790e00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:16177:1870073693317120:0@lo:104: 00000100:00100000:0.0:1783441667.365984:0:16177:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff91a87d790000 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:16177:1870073693317248:0@lo:104: 00000100:00100000:1.0:1783441667.366067:0:14150:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073693317376 00000100:00100000:1.0:1783441667.366074:0:14150:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073693317376 00010000:00010000:1.0:1783441667.366109:0:14150:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff91a87da47e00/0xa2426164df2c8a05 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xa2426164df2c89fe expref: 19 pid: 14156 timeout: 605 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783441667.366135:0:14150:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073693317504 00000100:00100000:1.0:1783441667.366138:0:14150:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073693317504 00010000:00010000:1.0:1783441667.366150:0:14150:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff91a85fe59a00/0xa2426164df2c88d1 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xa2426164df2c88ca expref: 20 pid: 14155 timeout: 605 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783441667.366163:0:14150:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:1.0:1783441667.366178:0:14150:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a877fad180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:94394728-4014-4ef0-b525-989290f008aa+20:3305:x1870073693317376:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1783441667.366193:0:14150:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1783441667.366199:0:14150:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff91a87da47e00/0xa2426164df2c8a05 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xa2426164df2c89fe expref: 20 pid: 14156 timeout: 605 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783441667.366211:0:14150:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff91a87da47e00/0xa2426164df2c8a05 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xa2426164df2c89fe expref: 20 pid: 14156 timeout: 605 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783441667.366229:0:14150:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff91a87da47e00/0xa2426164df2c8a05 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xa2426164df2c89fe expref: 20 pid: 14156 timeout: 605 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783441667.366250:0:14150:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1783441667.366289:0:14150:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a877fad180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:94394728-4014-4ef0-b525-989290f008aa+19:3305:x1870073693317376:12345-0@lo:103:ldlm_bl.0 Request processed in 111us (469us total) trans 0 rc 0/0 00000100:00100000:1.0:1783441667.366297:0:14150:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:1.0:1783441667.366312:0:14150:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:1.0:1783441667.366319:0:14150:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a877faf800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:94394728-4014-4ef0-b525-989290f008aa+18:3305:x1870073693317504:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1783441667.366326:0:14150:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1783441667.366331:0:14150:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff91a85fe59a00/0xa2426164df2c88d1 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xa2426164df2c88ca expref: 18 pid: 14155 timeout: 605 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783441667.366339:0:14150:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff91a85fe59a00/0xa2426164df2c88d1 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xa2426164df2c88ca expref: 18 pid: 14155 timeout: 605 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783441667.366349:0:14150:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff91a85fe59a00/0xa2426164df2c88d1 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xa2426164df2c88ca expref: 18 pid: 14155 timeout: 605 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783441667.366901:0:3303:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff91a867cd6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:94394728-4014-4ef0-b525-989290f008aa:3303:1870073693317632:0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1783441667.369709:0:14150:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1783441667.371120:0:3305:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff91a867cd7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:94394728-4014-4ef0-b525-989290f008aa:3305:1870073693317376:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1783441667.372424:0:14150:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a877faf800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:94394728-4014-4ef0-b525-989290f008aa+17:3305:x1870073693317504:12345-0@lo:103:ldlm_bl.0 Request processed in 6094us (6496us total) trans 0 rc 0/0 00000100:00100000:1.0:1783441667.372477:0:14150:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:2.0:1783441667.372507:0:3305:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff91a867cd5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:94394728-4014-4ef0-b525-989290f008aa:3305:1870073693317504:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1783441667.372622:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783441667.372978:0:14149:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073693317632 00000100:00100000:1.0:1783441667.372989:0:14149:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073693317632 00010000:00010000:1.0:1783441667.373031:0:14149:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff91a85f83d600/0xa2426164df2c8884 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xa2426164df2c887d expref: 17 pid: 14156 timeout: 605 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783441667.373075:0:14149:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:1.0:1783441667.373085:0:14149:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a7448fc850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:94394728-4014-4ef0-b525-989290f008aa+17:3303:x1870073693317632:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1783441667.373102:0:14149:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1783441667.373109:0:14149:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff91a85f83d600/0xa2426164df2c8884 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xa2426164df2c887d expref: 17 pid: 14156 timeout: 605 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783441667.373121:0:14149:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff91a85f83d600/0xa2426164df2c8884 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xa2426164df2c887d expref: 17 pid: 14156 timeout: 605 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783441667.373143:0:14149:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff91a85f83d600/0xa2426164df2c8884 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xa2426164df2c887d expref: 17 pid: 14156 timeout: 605 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783441667.373163:0:14149:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1783441667.373218:0:14149:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a7448fc850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:94394728-4014-4ef0-b525-989290f008aa+16:3303:x1870073693317632:12345-0@lo:103:ldlm_bl.0 Request processed in 135us (597us total) trans 0 rc 0/0 00000100:00100000:1.0:1783441667.373225:0:14149:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:2.0:1783441667.373472:0:3303:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff91a867cd6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:94394728-4014-4ef0-b525-989290f008aa:3303:1870073693317632:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1783441667.373864:0:16177:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff91a87d792a00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:16177:1870073693316864:192.168.201.13@tcp:104: 00000100:00100000:2.0:1783441667.383180:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.13@tcp (source: 12345-192.168.201.13@tcp) 00000100:00100000:2.0:1783441667.383293:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.13@tcp (source: 12345-192.168.201.13@tcp) 00000100:00100000:2.0:1783441667.383367:0:14148:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073673400448 00000100:00100000:2.0:1783441667.383379:0:14148:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073673400448 00010000:00010000:2.0:1783441667.383439:0:14148:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff91a87da46400/0xa2426164df2c8b2b lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.201.13@tcp remote: 0x633a354aa4df515d expref: 13 pid: 14157 timeout: 605 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783441667.383481:0:14148:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073673400576 00000100:00100000:2.0:1783441667.383501:0:14148:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073673400576 00010000:00010000:2.0:1783441667.383519:0:14148:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff91a85eb3de00/0xa2426164df2c8b63 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.201.13@tcp remote: 0x633a354aa4df51bf expref: 14 pid: 14155 timeout: 605 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783441667.383538:0:14148:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.13@tcp, seq: 7 00000100:00100000:2.0:1783441667.383550:0:14148:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a87d792300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:6a88b831-6e01-4d2d-a809-7fdb49ecdbbb+14:2355:x1870073673400448:12345-192.168.201.13@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1783441667.383568:0:14148:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1783441667.383575:0:14148:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff91a87da46400/0xa2426164df2c8b2b lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 192.168.201.13@tcp remote: 0x633a354aa4df515d expref: 14 pid: 14157 timeout: 605 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783441667.383588:0:14148:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff91a87da46400/0xa2426164df2c8b2b lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 192.168.201.13@tcp remote: 0x633a354aa4df515d expref: 14 pid: 14157 timeout: 605 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783441667.383610:0:14148:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff91a87da46400/0xa2426164df2c8b2b lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 192.168.201.13@tcp remote: 0x633a354aa4df515d expref: 14 pid: 14157 timeout: 605 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783441667.383635:0:14148:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1783441667.383705:0:14148:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a87d792300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:6a88b831-6e01-4d2d-a809-7fdb49ecdbbb+13:2355:x1870073673400448:12345-192.168.201.13@tcp:103:ldlm_bl.0 Request processed in 156us (541us total) trans 0 rc 0/0 00000100:00100000:2.0:1783441667.383715:0:14148:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.13@tcp, seq: 7 00000100:00100000:2.0:1783441667.383737:0:14148:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.13@tcp, seq: 8 00000100:00100000:2.0:1783441667.383764:0:14148:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a87d792d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:6a88b831-6e01-4d2d-a809-7fdb49ecdbbb+12:2355:x1870073673400576:12345-192.168.201.13@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1783441667.383773:0:14148:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1783441667.383778:0:14148:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff91a85eb3de00/0xa2426164df2c8b63 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.201.13@tcp remote: 0x633a354aa4df51bf expref: 12 pid: 14155 timeout: 605 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783441667.383788:0:14148:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff91a85eb3de00/0xa2426164df2c8b63 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 192.168.201.13@tcp remote: 0x633a354aa4df51bf expref: 12 pid: 14155 timeout: 605 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783441667.383811:0:14148:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff91a85f83d200/0xa2426164df2c8b8d lrc: 3/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 16177 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783441667.383820:0:14148:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff91a85f83d200/0xa2426164df2c8b8d lrc: 4/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 16177 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783441667.383838:0:14148:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff91a85f83d200/0xa2426164df2c8b8d lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 16177 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783441667.383845:0:14148:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff91a85f83d200/0xa2426164df2c8b8d lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 16177 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783441667.383853:0:14148:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff91a85f83d200/0xa2426164df2c8b8d lrc: 4/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 16177 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783441667.383860:0:14148:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff91a85f83d200/0xa2426164df2c8b8d lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 16177 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783441667.383868:0:14148:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91a85f83d200 already unused, calling callback (ffffffffc155ff90) 00010000:00010000:2.0:1783441667.383873:0:14148:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff91a85f83d200/0xa2426164df2c8b8d lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 16177 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783441667.383883:0:14148:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff91a85f83d200/0xa2426164df2c8b8d lrc: 6/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 16177 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783441667.383894:0:14148:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff91a85f83d200/0xa2426164df2c8b8d lrc: 4/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 16177 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783441667.383906:0:14148:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1783441667.383928:0:14148:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a87d792d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:6a88b831-6e01-4d2d-a809-7fdb49ecdbbb+12:2355:x1870073673400576:12345-192.168.201.13@tcp:103:ldlm_bl.0 Request processed in 164us (634us total) trans 0 rc 0/0 00000100:00100000:2.0:1783441667.383943:0:14148:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.13@tcp, seq: 8 00010000:00010000:3.0:1783441667.384347:0:16177:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff91a85eb3de00/0xa2426164df2c8b63 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44801400000020 nid: 192.168.201.13@tcp remote: 0x633a354aa4df51bf expref: 11 pid: 14155 timeout: 605 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783441667.384374:0:16177:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff91a87d793480 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:16177:1870073693316736:192.168.201.13@tcp:104: 00010000:00010000:3.0:1783441667.384454:0:16177:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff91a85f83d200/0xa2426164df2c8b8d lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 16177 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783441667.384466:0:16177:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff91a85f83d200/0xa2426164df2c8b8d lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 16177 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783441667.384473:0:16177:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff91a85f83d200/0xa2426164df2c8b8d lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 16177 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783441667.384479:0:16177:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff91a85f83d200/0xa2426164df2c8b8d lrc: 0/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 16177 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783441667.439591:0:3304:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff91a874dcdc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3304:1870073693317760:0@lo:400:kworker.0 00000100:00100000:3.0:1783441667.439690:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783441667.439882:0:3304:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff91a87d7c7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3304:1870073693318272:0@lo:400:kworker.0 00000100:00100000:3.0:1783441667.439916:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783441667.439950:0:3304:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1783441667.439957:0:3304:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff91a87d7c6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3304:1870073693318144:0@lo:400:kworker.0 00000100:00100000:3.0:1783441667.439981:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783441667.440022:0:3306:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff91a87d7c6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3306:1870073693318016:0@lo:400:kworker.0 00000100:00100000:3.0:1783441667.440049:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783441667.440070:0:3306:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1783441667.440075:0:3306:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff91a87d7c7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3306:1870073693317888:0@lo:400:kworker.0 00000100:00100000:3.0:1783441667.440094:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783441667.440125:0:14798:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073693317760 00000100:00100000:3.0:1783441667.440134:0:14798:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073693317760 00000100:00100000:3.0:1783441667.440188:0:14798:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073693317888 00000100:00100000:3.0:1783441667.440191:0:14798:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073693317888 00000100:00100000:3.0:1783441667.440224:0:14798:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:3.0:1783441667.440233:0:14798:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a87d7c4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3304:x1870073693317760:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1783441667.440290:0:14798:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a87d7c4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3304:x1870073693317760:12345-0@lo:400:kworker.0 Request processed in 58us (601us total) trans 0 rc 0/0 00000100:00100000:3.0:1783441667.440297:0:14798:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:3.0:1783441667.440335:0:14798:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:3.0:1783441667.440341:0:14798:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a87d7c5f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3306:x1870073693317888:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1783441667.440372:0:14798:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a87d7c5f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3306:x1870073693317888:12345-0@lo:400:kworker.0 Request processed in 31us (276us total) trans 0 rc 0/0 00000100:00100000:3.0:1783441667.440378:0:14798:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:3.0:1783441667.440399:0:15981:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073693318272 00000100:00100000:3.0:1783441667.440403:0:15981:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073693318272 00000100:00100000:3.0:1783441667.440441:0:15981:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073693318144 00000100:00100000:3.0:1783441667.440444:0:15981:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073693318144 00000100:00100000:1.0:1783441667.440450:0:14163:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073693318016 00000100:00100000:1.0:1783441667.440454:0:14163:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073693318016 00000100:00100000:3.0:1783441667.440466:0:15981:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:3.0:1783441667.440472:0:15981:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a87d7c5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3304:x1870073693318272:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1783441667.440475:0:14163:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:1.0:1783441667.440480:0:14163:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a87d7c4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3304:x1870073693318144:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1783441667.440505:0:15981:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a87d7c5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3304:x1870073693318272:12345-0@lo:400:kworker.0 Request processed in 33us (588us total) trans 0 rc 0/0 00000100:00100000:1.0:1783441667.440508:0:14163:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a87d7c4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3304:x1870073693318144:12345-0@lo:400:kworker.0 Request processed in 28us (527us total) trans 0 rc 0/0 00000100:00100000:3.0:1783441667.440512:0:15981:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:1.0:1783441667.440523:0:14163:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00100000:3.0:1783441667.440526:0:15981:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:3.0:1783441667.440531:0:15981:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a87d7c6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3306:x1870073693318016:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1783441667.440559:0:15981:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a87d7c6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3306:x1870073693318016:12345-0@lo:400:kworker.0 Request processed in 27us (508us total) trans 0 rc 0/0 00000100:00100000:3.0:1783441667.440565:0:15981:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00080000:3.0:1783441667.440583:0:14159:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1783441667.440588:0:14159:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1783441667.440590:0:14159:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1783441667.440658:0:3306:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff91a87d7c7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3306:1870073693317888:0@lo:400:kworker.0 00000100:00100000:3.0:1783441667.440668:0:3306:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff91a87d7c6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3306:1870073693318016:0@lo:400:kworker.0 00000100:00100000:3.0:1783441667.440698:0:3304:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff91a87d7c6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3304:1870073693318144:0@lo:400:kworker.0 00000100:00100000:3.0:1783441667.440708:0:3304:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff91a874dcdc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3304:1870073693317760:0@lo:400:kworker.0 00000100:00100000:3.0:1783441667.440717:0:3304:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff91a87d7c7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3304:1870073693318272:0@lo:400:kworker.0 00000100:00100000:1.0:1783441667.443021:0:3306:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1783441667.443050:0:3306:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff91a877faf100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3306:1870073693318400:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1783441667.443132:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783441667.443236:0:14801:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073693318400 00000100:00100000:0.0:1783441667.443247:0:14801:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073693318400 00000100:00100000:0.0:1783441667.443310:0:14801:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:0.0:1783441667.443320:0:14801:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a867cd5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3306:x1870073693318400:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1783441667.443369:0:14801:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1783441667.443421:0:14801:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a867cd5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3306:x1870073693318400:12345-0@lo:13:osp-pre-1-0.0 Request processed in 101us (288us total) trans 0 rc 0/0 00000100:00100000:0.0:1783441667.443438:0:14801:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:1.0:1783441667.443550:0:3306:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff91a877faf100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3306:1870073693318400:0@lo:13:osp-pre-1-0.0 00010000:00010000:1.0:1783441667.955669:0:14152:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783441668.976178:0:14151:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:0.0:1783441669.173234:0:14160:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:0.0:1783441669.173244:0:14160:0:(mgc_request.c:1801:mgc_process_log()) Process log params-ffff91a843888000 from 10 10000000:01000000:0.0:1783441669.173249:0:14160:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:0.0:1783441669.173307:0:14160:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.113@tcp lock: ffff91a85fe58800/0xa2426164df2c8b94 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14160 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783441669.173320:0:14160:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.113@tcp lock: ffff91a85fe58800/0xa2426164df2c8b94 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14160 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783441669.173332:0:14160:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.113@tcp lock: ffff91a85fe58800/0xa2426164df2c8b94 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14160 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783441669.173359:0:14160:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff91a877fac380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:94394728-4014-4ef0-b525-989290f008aa:14160:1870073693318528:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1783441669.173451:0:14160:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783441669.173502:0:14157:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073693318528 00000100:00100000:0.0:1783441669.173505:0:14160:0:(client.c:2702:ptlrpc_set_wait()) set ffff91a8504a3180 going to sleep for 11 seconds 00000100:00100000:2.0:1783441669.173511:0:14157:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073693318528 00000100:00100000:2.0:1783441669.173570:0:14157:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 105 00000100:00100000:2.0:1783441669.173581:0:14157:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a87563cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:94394728-4014-4ef0-b525-989290f008aa+16:14160:x1870073693318528:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1783441669.173595:0:14157:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1783441669.173621:0:14157:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff91a85f83ce00/0xa2426164df2c8b9b lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xa2426164df2c8b94 expref: -99 pid: 14157 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783441669.173647:0:14157:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff91a85f83ce00/0xa2426164df2c8b9b lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xa2426164df2c8b94 expref: 17 pid: 14157 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783441669.173657:0:14157:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff91a85f83ce00/0xa2426164df2c8b9b lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xa2426164df2c8b94 expref: 17 pid: 14157 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783441669.173666:0:14157:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91a85f83ce00, rc 0) 00000100:00100000:2.0:1783441669.173780:0:14157:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a87563cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:94394728-4014-4ef0-b525-989290f008aa+17:14160:x1870073693318528:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 199us (328us total) trans 0 rc 0/0 00000100:00100000:2.0:1783441669.173787:0:14157:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 105 00000100:00100000:0.0:1783441669.173935:0:14160:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff91a877fac380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:94394728-4014-4ef0-b525-989290f008aa:14160:1870073693318528:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1783441669.173951:0:14160:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.113@tcp lock: ffff91a85fe58800/0xa2426164df2c8b94 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xa2426164df2c8b9b expref: -99 pid: 14160 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783441669.173960:0:14160:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.113@tcp lock: ffff91a85fe58800/0xa2426164df2c8b94 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xa2426164df2c8b9b expref: -99 pid: 14160 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783441669.174014:0:14160:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff91a877fac380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:94394728-4014-4ef0-b525-989290f008aa:14160:1870073693318656:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1783441669.174038:0:14160:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783441669.174094:0:14160:0:(client.c:2702:ptlrpc_set_wait()) set ffff91a8504a3180 going to sleep for 11 seconds 00000100:00100000:2.0:1783441669.174129:0:14156:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073693318656 00000100:00100000:2.0:1783441669.174134:0:14156:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073693318656 00000100:00100000:2.0:1783441669.174160:0:14156:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 106 00000100:00100000:2.0:1783441669.174170:0:14156:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a87563d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:94394728-4014-4ef0-b525-989290f008aa+17:14160:x1870073693318656:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1783441669.174446:0:14156:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a87563d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:94394728-4014-4ef0-b525-989290f008aa+17:14160:x1870073693318656:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 278us (406us total) trans 0 rc 0/0 00000100:00100000:2.0:1783441669.174454:0:14156:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 106 00000100:00100000:0.0:1783441669.174552:0:14160:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff91a877fac380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:94394728-4014-4ef0-b525-989290f008aa:14160:1870073693318656:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1783441669.174578:0:14160:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff91a877fac380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:94394728-4014-4ef0-b525-989290f008aa:14160:1870073693318784:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1783441669.174676:0:14160:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783441669.174703:0:14160:0:(client.c:2702:ptlrpc_set_wait()) set ffff91a8504a3180 going to sleep for 11 seconds 00000100:00100000:3.0:1783441669.175001:0:14155:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073693318784 00000100:00100000:3.0:1783441669.175006:0:14155:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073693318784 00000100:00100000:3.0:1783441669.175034:0:14155:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 107 00000100:00100000:3.0:1783441669.175041:0:14155:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a87563dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:94394728-4014-4ef0-b525-989290f008aa+17:14160:x1870073693318784:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1783441669.175244:0:14155:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a87563dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:94394728-4014-4ef0-b525-989290f008aa+17:14160:x1870073693318784:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 202us (567us total) trans 0 rc 0/0 00000100:00100000:3.0:1783441669.175252:0:14155:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 107 00000100:00100000:0.0:1783441669.175414:0:14160:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff91a877fac380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:94394728-4014-4ef0-b525-989290f008aa:14160:1870073693318784:0@lo:503:ll_cfg_requeue.0 00000040:00080000:0.0:1783441669.175990:0:16250:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 10 00000020:01000000:0.0:1783441669.176046:0:14160:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 10-9 (rc=0) 10000000:01000000:0.0:1783441669.176064:0:14160:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.201.113@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:0.0:1783441669.176078:0:14160:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.113@tcp lock: ffff91a85fe58800/0xa2426164df2c8b94 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xa2426164df2c8b9b expref: -99 pid: 14160 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783441669.176168:0:14160:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.113@tcp lock: ffff91a85fe58800/0xa2426164df2c8b94 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xa2426164df2c8b9b expref: -99 pid: 14160 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1783441669.176187:0:14160:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:0.0:1783441669.176190:0:14160:0:(mgc_request.c:1801:mgc_process_log()) Process log params-ffff91a745264800 from 10 10000000:01000000:0.0:1783441669.176192:0:14160:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:0.0:1783441669.176214:0:14160:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.113@tcp lock: ffff91a85fe59600/0xa2426164df2c8ba2 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14160 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783441669.176220:0:14160:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.113@tcp lock: ffff91a85fe59600/0xa2426164df2c8ba2 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14160 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783441669.176228:0:14160:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.113@tcp lock: ffff91a85fe59600/0xa2426164df2c8ba2 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14160 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783441669.176245:0:14160:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff91a877fac380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:94394728-4014-4ef0-b525-989290f008aa:14160:1870073693318912:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1783441669.176275:0:14160:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783441669.176302:0:14160:0:(client.c:2702:ptlrpc_set_wait()) set ffff91a8504a36c0 going to sleep for 11 seconds 00000100:00100000:2.0:1783441669.176551:0:14156:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073693318912 00000100:00100000:2.0:1783441669.176562:0:14156:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073693318912 00000100:00100000:2.0:1783441669.176664:0:14156:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 108 00000100:00100000:2.0:1783441669.176673:0:14156:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a87563f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:94394728-4014-4ef0-b525-989290f008aa+17:14160:x1870073693318912:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1783441669.176684:0:14156:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1783441669.176695:0:14156:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff91a85f83de00/0xa2426164df2c8ba9 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xa2426164df2c8ba2 expref: -99 pid: 14156 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783441669.176715:0:14156:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff91a85f83de00/0xa2426164df2c8ba9 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xa2426164df2c8ba2 expref: 18 pid: 14156 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783441669.176725:0:14156:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff91a85f83de00/0xa2426164df2c8ba9 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xa2426164df2c8ba2 expref: 18 pid: 14156 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783441669.176735:0:14156:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91a85f83de00, rc 0) 00000100:00100000:2.0:1783441669.176789:0:14156:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a87563f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:94394728-4014-4ef0-b525-989290f008aa+18:14160:x1870073693318912:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 117us (512us total) trans 0 rc 0/0 00000100:00100000:2.0:1783441669.176796:0:14156:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 108 00000100:00100000:2.0:1783441669.176834:0:14160:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff91a877fac380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:94394728-4014-4ef0-b525-989290f008aa:14160:1870073693318912:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1783441669.176849:0:14160:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.113@tcp lock: ffff91a85fe59600/0xa2426164df2c8ba2 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xa2426164df2c8ba9 expref: -99 pid: 14160 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783441669.176857:0:14160:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.113@tcp lock: ffff91a85fe59600/0xa2426164df2c8ba2 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xa2426164df2c8ba9 expref: -99 pid: 14160 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783441669.176901:0:14160:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff91a87d790a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:94394728-4014-4ef0-b525-989290f008aa:14160:1870073693319040:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1783441669.176927:0:14160:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783441669.176942:0:14160:0:(client.c:2702:ptlrpc_set_wait()) set ffff91a84540b000 going to sleep for 11 seconds 00000100:00100000:0.0:1783441669.177005:0:14157:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073693319040 00000100:00100000:0.0:1783441669.177009:0:14157:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073693319040 00000100:00100000:0.0:1783441669.177031:0:14157:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 109 00000100:00100000:0.0:1783441669.177036:0:14157:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a87563f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:94394728-4014-4ef0-b525-989290f008aa+18:14160:x1870073693319040:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1783441669.177257:0:14157:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a87563f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:94394728-4014-4ef0-b525-989290f008aa+18:14160:x1870073693319040:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 219us (329us total) trans 0 rc 0/0 00000100:00100000:0.0:1783441669.177265:0:14157:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 109 00000100:00100000:0.0:1783441669.177296:0:14160:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff91a87d790a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:94394728-4014-4ef0-b525-989290f008aa:14160:1870073693319040:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1783441669.177325:0:14160:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff91a877fadf80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:94394728-4014-4ef0-b525-989290f008aa:14160:1870073693319168:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1783441669.177359:0:14160:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783441669.177371:0:14160:0:(client.c:2702:ptlrpc_set_wait()) set ffff91a8504a3b40 going to sleep for 11 seconds 00000100:00100000:0.0:1783441669.177814:0:14156:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073693319168 00000100:00100000:0.0:1783441669.177818:0:14156:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073693319168 00000100:00100000:0.0:1783441669.177837:0:14156:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 110 00000100:00100000:0.0:1783441669.177843:0:14156:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a87563d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:94394728-4014-4ef0-b525-989290f008aa+18:14160:x1870073693319168:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1783441669.177993:0:14156:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a87563d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:94394728-4014-4ef0-b525-989290f008aa+18:14160:x1870073693319168:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 148us (632us total) trans 0 rc 0/0 00000100:00100000:0.0:1783441669.178000:0:14156:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 110 00000100:00100000:2.0:1783441669.178485:0:14160:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff91a877fadf80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:94394728-4014-4ef0-b525-989290f008aa:14160:1870073693319168:0@lo:503:ll_cfg_requeue.0 00000040:00080000:2.0:1783441669.184444:0:16251:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 10 00000020:01000000:1.0:1783441669.184791:0:14160:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 10-9 (rc=0) 10000000:01000000:1.0:1783441669.184816:0:14160:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.201.113@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:1.0:1783441669.184829:0:14160:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.113@tcp lock: ffff91a85fe59600/0xa2426164df2c8ba2 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xa2426164df2c8ba9 expref: -99 pid: 14160 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783441669.184843:0:14160:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.113@tcp lock: ffff91a85fe59600/0xa2426164df2c8ba2 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xa2426164df2c8ba9 expref: -99 pid: 14160 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1783441669.184854:0:14160:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:1.0:1783441669.184857:0:14160:0:(mgc_request.c:1801:mgc_process_log()) Process log params-ffff91a844b0f000 from 10 10000000:01000000:1.0:1783441669.184860:0:14160:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:1.0:1783441669.184899:0:14160:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.113@tcp lock: ffff91a87da47600/0xa2426164df2c8bb0 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14160 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783441669.184907:0:14160:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.113@tcp lock: ffff91a87da47600/0xa2426164df2c8bb0 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14160 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783441669.184917:0:14160:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.113@tcp lock: ffff91a87da47600/0xa2426164df2c8bb0 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14160 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783441669.184943:0:14160:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff91a867cd5c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:94394728-4014-4ef0-b525-989290f008aa:14160:1870073693319296:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1783441669.185012:0:14160:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783441669.185077:0:14160:0:(client.c:2702:ptlrpc_set_wait()) set ffff91a8428ac300 going to sleep for 11 seconds 00000100:00100000:3.0:1783441669.185704:0:14156:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073693319296 00000100:00100000:3.0:1783441669.185713:0:14156:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073693319296 00000100:00100000:3.0:1783441669.185780:0:14156:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 111 00000100:00100000:3.0:1783441669.185789:0:14156:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a87563e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:94394728-4014-4ef0-b525-989290f008aa+18:14160:x1870073693319296:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1783441669.185804:0:14156:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1783441669.185820:0:14156:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff91a85eb3de00/0xa2426164df2c8bb7 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0xa2426164df2c8bb0 expref: -99 pid: 14156 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783441669.185845:0:14156:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff91a85eb3de00/0xa2426164df2c8bb7 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xa2426164df2c8bb0 expref: 19 pid: 14156 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783441669.185856:0:14156:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff91a85eb3de00/0xa2426164df2c8bb7 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xa2426164df2c8bb0 expref: 19 pid: 14156 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783441669.185876:0:14156:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91a85eb3de00, rc 0) 00000100:00100000:3.0:1783441669.185919:0:14156:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a87563e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:94394728-4014-4ef0-b525-989290f008aa+19:14160:x1870073693319296:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 131us (907us total) trans 0 rc 0/0 00000100:00100000:3.0:1783441669.185926:0:14156:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 111 00000100:00100000:1.0:1783441669.188967:0:14160:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff91a867cd5c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:94394728-4014-4ef0-b525-989290f008aa:14160:1870073693319296:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1783441669.188997:0:14160:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.113@tcp lock: ffff91a87da47600/0xa2426164df2c8bb0 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xa2426164df2c8bb7 expref: -99 pid: 14160 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783441669.189011:0:14160:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.113@tcp lock: ffff91a87da47600/0xa2426164df2c8bb0 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0xa2426164df2c8bb7 expref: -99 pid: 14160 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783441669.189087:0:14160:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff91a867cd5c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:94394728-4014-4ef0-b525-989290f008aa:14160:1870073693319424:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1783441669.189152:0:14160:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783441669.189193:0:14160:0:(client.c:2702:ptlrpc_set_wait()) set ffff91a8428ac300 going to sleep for 11 seconds 00000100:00100000:1.0:1783441669.189227:0:14155:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073693319424 00000100:00100000:1.0:1783441669.189233:0:14155:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073693319424 00000100:00100000:1.0:1783441669.189273:0:14155:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 112 00000100:00100000:1.0:1783441669.189283:0:14155:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a87563d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:94394728-4014-4ef0-b525-989290f008aa+19:14160:x1870073693319424:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1783441669.189552:0:14155:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a87563d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:94394728-4014-4ef0-b525-989290f008aa+19:14160:x1870073693319424:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 270us (399us total) trans 0 rc 0/0 00000100:00100000:1.0:1783441669.189561:0:14155:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 112 00000100:00100000:1.0:1783441669.189602:0:14160:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff91a867cd5c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:94394728-4014-4ef0-b525-989290f008aa:14160:1870073693319424:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1783441669.189631:0:14160:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff91a867cd5c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:94394728-4014-4ef0-b525-989290f008aa:14160:1870073693319552:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1783441669.189670:0:14160:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783441669.189684:0:14160:0:(client.c:2702:ptlrpc_set_wait()) set ffff91a8428ac300 going to sleep for 11 seconds 00000100:00100000:1.0:1783441669.189698:0:14155:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073693319552 00000100:00100000:1.0:1783441669.189702:0:14155:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073693319552 00000100:00100000:1.0:1783441669.189737:0:14155:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 113 00000100:00100000:1.0:1783441669.189767:0:14155:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a87563c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:94394728-4014-4ef0-b525-989290f008aa+19:14160:x1870073693319552:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1783441669.190147:0:14155:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a87563c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:94394728-4014-4ef0-b525-989290f008aa+19:14160:x1870073693319552:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 379us (474us total) trans 0 rc 0/0 00000100:00100000:1.0:1783441669.190155:0:14155:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 113 00000100:00100000:1.0:1783441669.190243:0:14160:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff91a867cd5c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:94394728-4014-4ef0-b525-989290f008aa:14160:1870073693319552:0@lo:503:ll_cfg_requeue.0 00000040:00080000:1.0:1783441669.194867:0:16252:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 10 00000020:01000000:1.0:1783441669.194967:0:14160:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 10-9 (rc=0) 10000000:01000000:1.0:1783441669.194989:0:14160:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.201.113@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:1.0:1783441669.195003:0:14160:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.113@tcp lock: ffff91a87da47600/0xa2426164df2c8bb0 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xa2426164df2c8bb7 expref: -99 pid: 14160 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783441669.195016:0:14160:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.113@tcp lock: ffff91a87da47600/0xa2426164df2c8bb0 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xa2426164df2c8bb7 expref: -99 pid: 14160 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783441669.302575:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.13@tcp (source: 12345-192.168.201.13@tcp) 00000100:00100000:1.0:1783441669.302720:0:14155:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073673400704 00000100:00100000:1.0:1783441669.302730:0:14155:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073673400704 00000100:00100000:1.0:1783441669.302810:0:14155:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.13@tcp, seq: 114 00000100:00100000:1.0:1783441669.302820:0:14155:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a87563c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6a88b831-6e01-4d2d-a809-7fdb49ecdbbb+11:13705:x1870073673400704:12345-192.168.201.13@tcp:101:ll_cfg_requeue.0 00010000:00010000:1.0:1783441669.302837:0:14155:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1783441669.302854:0:14155:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff91a87da46c00/0xa2426164df2c8bbe lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x633a354aa4df51f0 expref: -99 pid: 14155 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783441669.302882:0:14155:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff91a87da46c00/0xa2426164df2c8bbe lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 192.168.201.13@tcp remote: 0x633a354aa4df51f0 expref: 12 pid: 14155 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783441669.302893:0:14155:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff91a87da46c00/0xa2426164df2c8bbe lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 192.168.201.13@tcp remote: 0x633a354aa4df51f0 expref: 12 pid: 14155 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783441669.302902:0:14155:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91a87da46c00, rc 0) 00000100:00100000:1.0:1783441669.302971:0:14155:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a87563c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6a88b831-6e01-4d2d-a809-7fdb49ecdbbb+12:13705:x1870073673400704:12345-192.168.201.13@tcp:101:ll_cfg_requeue.0 Request processed in 152us (405us total) trans 0 rc 0/0 00000100:00100000:1.0:1783441669.302978:0:14155:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.13@tcp, seq: 114 00000100:00100000:3.0:1783441669.307858:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.13@tcp (source: 12345-192.168.201.13@tcp) 00000100:00100000:1.0:1783441669.307937:0:14156:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073673400832 00000100:00100000:1.0:1783441669.307947:0:14156:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073673400832 00000100:00100000:1.0:1783441669.308003:0:14156:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.13@tcp, seq: 115 00000100:00100000:1.0:1783441669.308013:0:14156:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a874be9050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6a88b831-6e01-4d2d-a809-7fdb49ecdbbb+12:13705:x1870073673400832:12345-192.168.201.13@tcp:501:ll_cfg_requeue.0 00000100:00100000:1.0:1783441669.308292:0:14156:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a874be9050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6a88b831-6e01-4d2d-a809-7fdb49ecdbbb+12:13705:x1870073673400832:12345-192.168.201.13@tcp:501:ll_cfg_requeue.0 Request processed in 280us (443us total) trans 0 rc 0/0 00000100:00100000:1.0:1783441669.308300:0:14156:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.13@tcp, seq: 115 00000100:00100000:3.0:1783441669.310948:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.13@tcp (source: 12345-192.168.201.13@tcp) 00000100:00100000:0.0:1783441669.311034:0:14157:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073673400960 00000100:00100000:0.0:1783441669.311043:0:14157:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073673400960 00000100:00100000:0.0:1783441669.311089:0:14157:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.13@tcp, seq: 116 00000100:00100000:0.0:1783441669.311097:0:14157:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a874bea850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6a88b831-6e01-4d2d-a809-7fdb49ecdbbb+12:13705:x1870073673400960:12345-192.168.201.13@tcp:503:ll_cfg_requeue.0 00000100:00100000:0.0:1783441669.311292:0:14157:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a874bea850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6a88b831-6e01-4d2d-a809-7fdb49ecdbbb+12:13705:x1870073673400960:12345-192.168.201.13@tcp:503:ll_cfg_requeue.0 Request processed in 195us (353us total) trans 0 rc 0/0 00000100:00100000:0.0:1783441669.311300:0:14157:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.13@tcp, seq: 116 00000100:00100000:0.0:1783441669.319885:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.13@tcp (source: 12345-192.168.201.13@tcp) 00000100:00100000:1.0:1783441669.320041:0:14155:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073673401088 00000100:00100000:1.0:1783441669.320053:0:14155:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073673401088 00000100:00100000:1.0:1783441669.320109:0:14155:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.13@tcp, seq: 117 00000100:00100000:1.0:1783441669.320118:0:14155:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a874be9c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6a88b831-6e01-4d2d-a809-7fdb49ecdbbb+12:13705:x1870073673401088:12345-192.168.201.13@tcp:101:ll_cfg_requeue.0 00010000:00010000:1.0:1783441669.320135:0:14155:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1783441669.320154:0:14155:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff91a87da46a00/0xa2426164df2c8bc5 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0x633a354aa4df51f7 expref: -99 pid: 14155 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783441669.320184:0:14155:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff91a87da46a00/0xa2426164df2c8bc5 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 192.168.201.13@tcp remote: 0x633a354aa4df51f7 expref: 13 pid: 14155 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783441669.320196:0:14155:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff91a87da46a00/0xa2426164df2c8bc5 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 192.168.201.13@tcp remote: 0x633a354aa4df51f7 expref: 13 pid: 14155 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783441669.320204:0:14155:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91a87da46a00, rc 0) 00000100:00100000:1.0:1783441669.320268:0:14155:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a874be9c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6a88b831-6e01-4d2d-a809-7fdb49ecdbbb+13:13705:x1870073673401088:12345-192.168.201.13@tcp:101:ll_cfg_requeue.0 Request processed in 150us (392us total) trans 0 rc 0/0 00000100:00100000:1.0:1783441669.320288:0:14155:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.13@tcp, seq: 117 00000100:00100000:2.0:1783441669.336243:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.13@tcp (source: 12345-192.168.201.13@tcp) 00000100:00100000:0.0:1783441669.336313:0:14156:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073673401216 00000100:00100000:0.0:1783441669.336332:0:14156:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073673401216 00000100:00100000:0.0:1783441669.336406:0:14156:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.13@tcp, seq: 118 00000100:00100000:0.0:1783441669.336621:0:14156:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a874be8050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6a88b831-6e01-4d2d-a809-7fdb49ecdbbb+13:13705:x1870073673401216:12345-192.168.201.13@tcp:501:ll_cfg_requeue.0 00000100:00100000:0.0:1783441669.336931:0:14156:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a874be8050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6a88b831-6e01-4d2d-a809-7fdb49ecdbbb+13:13705:x1870073673401216:12345-192.168.201.13@tcp:501:ll_cfg_requeue.0 Request processed in 314us (695us total) trans 0 rc 0/0 00000100:00100000:0.0:1783441669.336939:0:14156:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.13@tcp, seq: 118 00000100:00100000:3.0:1783441669.352003:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.13@tcp (source: 12345-192.168.201.13@tcp) 00000100:00100000:0.0:1783441669.353169:0:14157:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073673401344 00000100:00100000:0.0:1783441669.353180:0:14157:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073673401344 00000100:00100000:0.0:1783441669.353241:0:14157:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.13@tcp, seq: 119 00000100:00100000:0.0:1783441669.353259:0:14157:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a874beb850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6a88b831-6e01-4d2d-a809-7fdb49ecdbbb+13:13705:x1870073673401344:12345-192.168.201.13@tcp:503:ll_cfg_requeue.0 00000100:00100000:0.0:1783441669.354080:0:14157:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a874beb850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6a88b831-6e01-4d2d-a809-7fdb49ecdbbb+13:13705:x1870073673401344:12345-192.168.201.13@tcp:503:ll_cfg_requeue.0 Request processed in 819us (2088us total) trans 0 rc 0/0 00000100:00100000:0.0:1783441669.354090:0:14157:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.13@tcp, seq: 119 00010000:00010000:1.0:1783441670.001434:0:14152:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1783441670.508979:0:3306:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff91a867cd5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3306:1870073693319680:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1783441670.509049:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783441670.509358:0:14802:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073693319680 00000100:00100000:1.0:1783441670.509366:0:14802:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073693319680 00000100:00100000:1.0:1783441670.509428:0:14802:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:1.0:1783441670.509436:0:14802:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a87d790700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3306:x1870073693319680:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1783441670.509468:0:14802:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1783441670.509516:0:14802:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a87d790700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3306:x1870073693319680:12345-0@lo:13:osp-pre-0-0.0 Request processed in 81us (468us total) trans 0 rc 0/0 00000100:00100000:1.0:1783441670.509523:0:14802:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:2.0:1783441670.509632:0:3306:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff91a867cd5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3306:1870073693319680:0@lo:13:osp-pre-0-0.0 00000100:00080000:3.0:1783441670.509873:0:14159:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1783441670.581712:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.13@tcp (source: 12345-192.168.201.13@tcp) 00000100:00100000:1.0:1783441670.581901:0:14163:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073673401472 00000100:00100000:1.0:1783441670.581911:0:14163:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073673401472 00000100:00100000:1.0:1783441670.581992:0:14163:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.13@tcp, seq: 15 00000100:00100000:1.0:1783441670.582003:0:14163:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a87d793100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:29d872ae-bafc-4783-9a98-d2418cedf182+6:14360:x1870073673401472:12345-192.168.201.13@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1783441670.582026:0:14163:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1783441670.582057:0:14163:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91a87da47000/0xa2426164df2c8bcc lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x633a354aa4df51fe expref: -99 pid: 14163 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783441670.582127:0:14163:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff91a87da46400/0xa2426164df2c8bd3 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 14163 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783441670.582141:0:14163:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91a87da46400/0xa2426164df2c8bd3 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14163 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783441670.582155:0:14163:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91a87da46400/0xa2426164df2c8bd3 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14163 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783441670.582169:0:14163:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff91a87da47e00/0xa2426164df2c8bda lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14163 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783441670.582192:0:14163:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91a87da47e00/0xa2426164df2c8bda lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14163 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783441670.582200:0:14163:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91a87da47e00/0xa2426164df2c8bda lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14163 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783441670.582712:0:14163:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff91a87da47200/0xa2426164df2c8be1 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14163 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783441670.582723:0:14163:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91a87da47200/0xa2426164df2c8be1 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14163 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783441670.582731:0:14163:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91a87da47200/0xa2426164df2c8be1 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14163 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1783441670.583534:0:14163:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000002:0x1:0x0]: returning size 6656 00000004:00200000:1.0:1783441670.583541:0:14163:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 2 stripe count 1 MDT count 1 00000004:00010000:1.0:1783441670.583638:0:14163:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff91a87da47200/0xa2426164df2c8be1 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14163 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783441670.583652:0:14163:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff91a87da46400/0xa2426164df2c8bd3 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14163 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783441670.583659:0:14163:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff91a87da46400/0xa2426164df2c8bd3 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 14163 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783441670.583666:0:14163:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff91a87da46400/0xa2426164df2c8bd3 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14163 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783441670.583671:0:14163:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91a87da46400 already unused, calling callback (ffffffffc1f9b4f0) 00010000:00010000:1.0:1783441670.583675:0:14163:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91a87da46400/0xa2426164df2c8bd3 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14163 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783441670.583691:0:14163:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91a87da46400/0xa2426164df2c8bd3 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 14163 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783441670.583705:0:14163:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff91a8439b0600) 00010000:00010000:1.0:1783441670.583708:0:14163:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1783441670.583712:0:14163:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff91a87da46400/0xa2426164df2c8bd3 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14163 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783441670.583718:0:14163:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91a87da46400/0xa2426164df2c8bd3 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14163 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783441670.583733:0:14163:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff91a87da47e00/0xa2426164df2c8bda lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14163 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00080000:3.0:1783441670.584214:0:14159:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:1.0:1783441670.585226:0:14163:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff91a87da47e00/0xa2426164df2c8bda lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14163 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783441670.585244:0:14163:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff91a87da47e00/0xa2426164df2c8bda lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14163 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783441670.585250:0:14163:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91a87da47e00 already unused, calling callback (ffffffffc1f9b4f0) 00010000:00010000:1.0:1783441670.585254:0:14163:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91a87da47e00/0xa2426164df2c8bda lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14163 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783441670.585261:0:14163:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91a87da47e00/0xa2426164df2c8bda lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14163 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783441670.585274:0:14163:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x3b979c7a (ffff91a858b90d00) 00010000:00010000:1.0:1783441670.585277:0:14163:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1783441670.585281:0:14163:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff91a87da47e00/0xa2426164df2c8bda lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14163 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783441670.585864:0:14163:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91a87da47e00/0xa2426164df2c8bda lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14163 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783441670.585923:0:14163:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91a87da47000/0xa2426164df2c8bcc lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.13@tcp remote: 0x633a354aa4df51fe expref: 8 pid: 14163 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783441670.585937:0:14163:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff91a87da47200/0xa2426164df2c8be1 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.13@tcp remote: 0x633a354aa4df51fe expref: 7 pid: 14163 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783441670.585946:0:14163:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x0 (ffff91a858b90600) 00010000:00010000:1.0:1783441670.585948:0:14163:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1783441670.585951:0:14163:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91a87da47200, rc 0) 00000100:00100000:1.0:1783441670.586023:0:14163:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a87d793100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:29d872ae-bafc-4783-9a98-d2418cedf182+7:14360:x1870073673401472:12345-192.168.201.13@tcp:101:lhsmtool_posix.0 Request processed in 4022us (4318us total) trans 0 rc 0/0 00000100:00100000:1.0:1783441670.586031:0:14163:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.13@tcp, seq: 15 00000100:00100000:0.0:1783441670.592991:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.13@tcp (source: 12345-192.168.201.13@tcp) 00000100:00100000:3.0:1783441670.593068:0:14164:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073673401728 00000100:00100000:3.0:1783441670.593077:0:14164:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073673401728 00000100:00100000:3.0:1783441670.593143:0:14164:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.13@tcp, seq: 16 00000100:00100000:3.0:1783441670.593154:0:14164:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a877faea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:29d872ae-bafc-4783-9a98-d2418cedf182+7:14360:x1870073673401728:12345-192.168.201.13@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1783441670.593175:0:14164:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1783441670.593197:0:14164:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91a85eb3dc00/0xa2426164df2c8be8 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x633a354aa4df5205 expref: -99 pid: 14164 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783441670.593705:0:14164:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff91a85eb3d800/0xa2426164df2c8bef lrc: 3/1,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 14164 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783441670.593720:0:14164:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91a85eb3d800/0xa2426164df2c8bef lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14164 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783441670.593733:0:14164:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91a85eb3d800/0xa2426164df2c8bef lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14164 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783441670.598465:0:14164:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff91a85f83c800/0xa2426164df2c8bf6 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14164 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783441670.598488:0:14164:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91a85f83c800/0xa2426164df2c8bf6 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14164 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783441670.598668:0:14164:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91a85f83c800/0xa2426164df2c8bf6 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14164 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783441670.599262:0:14164:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff91a85f83d400/0xa2426164df2c8bfd lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14164 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783441670.599274:0:14164:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91a85f83d400/0xa2426164df2c8bfd lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14164 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783441670.599283:0:14164:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91a85f83d400/0xa2426164df2c8bfd lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14164 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1783441670.599294:0:14164:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000002:0x2:0x0]: returning size 6656 00010000:00010000:2.0:1783441670.599986:0:14164:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff91a85eb3d800/0xa2426164df2c8bef lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14164 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783441670.599997:0:14164:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff91a85eb3d800/0xa2426164df2c8bef lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 14164 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783441670.600013:0:14164:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff91a85eb3d800/0xa2426164df2c8bef lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 14164 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783441670.600020:0:14164:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91a85eb3d800 already unused, calling callback (ffffffffc1f9b4f0) 00010000:00010000:2.0:1783441670.600024:0:14164:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91a85eb3d800/0xa2426164df2c8bef lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 14164 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783441670.600032:0:14164:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91a85eb3d800/0xa2426164df2c8bef lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 14164 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783441670.600045:0:14164:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x0 (ffff91a858b90600) 00010000:00010000:2.0:1783441670.600048:0:14164:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1783441670.600051:0:14164:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff91a85eb3d800/0xa2426164df2c8bef lrc: 2/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 14164 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783441670.600058:0:14164:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91a85eb3d800/0xa2426164df2c8bef lrc: 0/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 14164 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783441670.600070:0:14164:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff91a85f83c800/0xa2426164df2c8bf6 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14164 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783441670.600076:0:14164:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff91a85f83c800/0xa2426164df2c8bf6 lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14164 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783441670.600083:0:14164:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff91a85f83c800/0xa2426164df2c8bf6 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14164 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783441670.600087:0:14164:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91a85f83c800 already unused, calling callback (ffffffffc1f9b4f0) 00010000:00010000:2.0:1783441670.600090:0:14164:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91a85f83c800/0xa2426164df2c8bf6 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14164 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783441670.600104:0:14164:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91a85f83c800/0xa2426164df2c8bf6 lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14164 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783441670.600112:0:14164:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x8d45d6bc (ffff91a8429bd600) 00010000:00010000:2.0:1783441670.600114:0:14164:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1783441670.600117:0:14164:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff91a85f83c800/0xa2426164df2c8bf6 lrc: 2/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14164 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783441670.600122:0:14164:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91a85f83c800/0xa2426164df2c8bf6 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14164 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783441670.601839:0:14164:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91a85eb3dc00/0xa2426164df2c8be8 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.13@tcp remote: 0x633a354aa4df5205 expref: 10 pid: 14164 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783441670.601861:0:14164:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff91a85f83d400/0xa2426164df2c8bfd lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.13@tcp remote: 0x633a354aa4df5205 expref: 9 pid: 14164 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783441670.601870:0:14164:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff91a8429bd300) 00010000:00010000:2.0:1783441670.601872:0:14164:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1783441670.601875:0:14164:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91a85f83d400, rc 0) 00000100:00100000:2.0:1783441670.601958:0:14164:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a877faea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:29d872ae-bafc-4783-9a98-d2418cedf182+9:14360:x1870073673401728:12345-192.168.201.13@tcp:101:lhsmtool_posix.0 Request processed in 8805us (8975us total) trans 8589934593 rc 0/0 00000100:00100000:2.0:1783441670.601968:0:14164:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.13@tcp, seq: 16 00000100:00100000:3.0:1783441670.606407:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.13@tcp (source: 12345-192.168.201.13@tcp) 00000100:00100000:2.0:1783441670.606477:0:14162:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073673401856 00000100:00100000:2.0:1783441670.606487:0:14162:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073673401856 00000100:00100000:2.0:1783441670.606548:0:14162:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.13@tcp, seq: 17 00000100:00100000:2.0:1783441670.606560:0:14162:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a87d7c7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:29d872ae-bafc-4783-9a98-d2418cedf182+9:14360:x1870073673401856:12345-192.168.201.13@tcp:59:lhsmtool_posix.0 00000100:00100000:2.0:1783441670.606682:0:14162:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a87d7c7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:29d872ae-bafc-4783-9a98-d2418cedf182+9:14360:x1870073673401856:12345-192.168.201.13@tcp:59:lhsmtool_posix.0 Request processed in 123us (308us total) trans 0 rc 0/0 00000100:00100000:2.0:1783441670.606690:0:14162:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.13@tcp, seq: 17 00000100:00100000:0.0:1783441670.658852:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.13@tcp (source: 12345-192.168.201.13@tcp) 00000100:00100000:1.0:1783441670.658957:0:14163:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073673401984 00000100:00100000:1.0:1783441670.658967:0:14163:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073673401984 00000100:00100000:1.0:1783441670.659031:0:14163:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.13@tcp, seq: 18 00000100:00100000:1.0:1783441670.659042:0:14163:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a877faca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:29d872ae-bafc-4783-9a98-d2418cedf182+9:14366:x1870073673401984:12345-192.168.201.13@tcp:101:lfs.0 00010000:00010000:1.0:1783441670.659062:0:14163:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1783441670.659083:0:14163:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91a87da47e00/0xa2426164df2c8c0b lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x633a354aa4df520c expref: -99 pid: 14163 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783441670.659147:0:14163:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff91a87da46400/0xa2426164df2c8c12 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 14163 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783441670.659161:0:14163:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91a87da46400/0xa2426164df2c8c12 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14163 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783441670.659186:0:14163:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91a87da46400/0xa2426164df2c8c12 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14163 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783441670.659245:0:14163:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff91a87da46200/0xa2426164df2c8c19 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14163 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783441670.659252:0:14163:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91a87da46200/0xa2426164df2c8c19 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14163 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783441670.659259:0:14163:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91a87da46200/0xa2426164df2c8c19 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14163 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783441670.659588:0:14163:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff91a87da46400/0xa2426164df2c8c12 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14163 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783441670.659596:0:14163:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff91a87da46400/0xa2426164df2c8c12 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 14163 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783441670.659602:0:14163:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff91a87da46400/0xa2426164df2c8c12 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14163 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783441670.659608:0:14163:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91a87da46400 already unused, calling callback (ffffffffc1f9b4f0) 00010000:00010000:1.0:1783441670.659613:0:14163:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91a87da46400/0xa2426164df2c8c12 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14163 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783441670.659620:0:14163:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91a87da46400/0xa2426164df2c8c12 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 14163 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783441670.659632:0:14163:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff91a8439b0600) 00010000:00010000:1.0:1783441670.659635:0:14163:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1783441670.659640:0:14163:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff91a87da46400/0xa2426164df2c8c12 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14163 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783441670.659653:0:14163:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91a87da46400/0xa2426164df2c8c12 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14163 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783441670.659667:0:14163:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff91a87da46200/0xa2426164df2c8c19 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14163 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783441670.659674:0:14163:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff91a87da46200/0xa2426164df2c8c19 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14163 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783441670.659679:0:14163:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff91a87da46200/0xa2426164df2c8c19 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14163 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783441670.659685:0:14163:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91a87da46200 already unused, calling callback (ffffffffc1f9b4f0) 00010000:00010000:1.0:1783441670.659688:0:14163:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91a87da46200/0xa2426164df2c8c19 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14163 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783441670.659694:0:14163:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91a87da46200/0xa2426164df2c8c19 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14163 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783441670.659701:0:14163:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xab43d606 (ffff91a858b90d00) 00010000:00010000:1.0:1783441670.659703:0:14163:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1783441670.659705:0:14163:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff91a87da46200/0xa2426164df2c8c19 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14163 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783441670.659711:0:14163:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91a87da46200/0xa2426164df2c8c19 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14163 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783441670.659812:0:14163:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff91a87da47e00/0xa2426164df2c8c0b lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.13@tcp remote: 0x633a354aa4df520c expref: 10 pid: 14163 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783441670.659834:0:14163:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff91a8439b0600) 00010000:00010000:1.0:1783441670.659836:0:14163:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1783441670.659840:0:14163:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91a87da47e00/0xa2426164df2c8c0b lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.13@tcp remote: 0x633a354aa4df520c expref: 10 pid: 14163 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783441670.659852:0:14163:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91a87da47e00, rc 0) 00000100:00100000:1.0:1783441670.659915:0:14163:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a877faca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:29d872ae-bafc-4783-9a98-d2418cedf182+9:14366:x1870073673401984:12345-192.168.201.13@tcp:101:lfs.0 Request processed in 875us (1073us total) trans 0 rc 301/301 00000100:00100000:1.0:1783441670.659923:0:14163:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.13@tcp, seq: 18 00000100:00100000:1.0:1783441670.666026:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.13@tcp (source: 12345-192.168.201.13@tcp) 00000100:00100000:3.0:1783441670.666133:0:14171:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073673402112 00000100:00100000:3.0:1783441670.666155:0:14171:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073673402112 00000100:00100000:3.0:1783441670.666212:0:14171:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.13@tcp, seq: 0 00000100:00100000:3.0:1783441670.666220:0:14171:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a867cd4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqm_0000:29d872ae-bafc-4783-9a98-d2418cedf182+9:14366:x1870073673402112:12345-192.168.201.13@tcp:700:lfs.0 00000100:00100000:3.0:1783441670.666320:0:14171:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a867cd4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqm_0000:29d872ae-bafc-4783-9a98-d2418cedf182+9:14366:x1870073673402112:12345-192.168.201.13@tcp:700:lfs.0 Request processed in 100us (303us total) trans 0 rc 0/0 00000100:00100000:3.0:1783441670.666328:0:14171:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.13@tcp, seq: 0 00000100:00100000:0.0:1783441670.668197:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.13@tcp (source: 12345-192.168.201.13@tcp) 00000100:00100000:2.0:1783441670.668291:0:14164:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073673402368 00000100:00100000:2.0:1783441670.668299:0:14164:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073673402368 00000100:00100000:2.0:1783441670.668362:0:14164:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.13@tcp, seq: 19 00000100:00100000:2.0:1783441670.668382:0:14164:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a877fadf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:29d872ae-bafc-4783-9a98-d2418cedf182+9:14366:x1870073673402368:12345-192.168.201.13@tcp:36:lfs.0 00010000:00010000:2.0:1783441670.668436:0:14164:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1783441670.668463:0:14164:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91a85fe58c00/0xa2426164df2c8b4e lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.13@tcp remote: 0x633a354aa4df5187 expref: 9 pid: 14162 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783441670.668482:0:14164:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff91a8439b0600) 00010000:00010000:2.0:1783441670.668487:0:14164:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1783441670.669123:0:14164:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff91a85f83c800/0xa2426164df2c8c20 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14164 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783441670.669141:0:14164:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff91a87da46800/0xa2426164df2c8b86 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.13@tcp remote: 0x633a354aa4df51e9 expref: 5 pid: 14163 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783441670.669150:0:14164:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff91a85f83c800/0xa2426164df2c8c20 lrc: 4/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14164 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783441670.669185:0:14164:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff91a87da46800/0xa2426164df2c8b86 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.13@tcp remote: 0x633a354aa4df51e9 expref: 5 pid: 14163 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783441670.669199:0:14164:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff91a87da46800/0xa2426164df2c8b86 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.13@tcp remote: 0x633a354aa4df51e9 expref: 5 pid: 14163 timeout: 608 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783441670.669226:0:14164:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff91a87d793800 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:14164:1870073693319808:192.168.201.13@tcp:104: 00000100:00100000:2.0:1783441670.669330:0:14164:0:(client.c:2702:ptlrpc_set_wait()) set ffff91a87ebf60c0 going to sleep for 11 seconds 00000100:00100000:0.0:1783441670.673385:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.13@tcp (source: 12345-192.168.201.13@tcp) 00000100:00100000:2.0:1783441670.673431:0:14164:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff91a87d793800 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:14164:1870073693319808:192.168.201.13@tcp:104: 00010000:00010000:2.0:1783441670.673472:0:14164:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff91a85f83c800/0xa2426164df2c8c20 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14164 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783441670.673611:0:14148:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073673402496 00000100:00100000:3.0:1783441670.673622:0:14148:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073673402496 00000100:00080000:2.0:1783441670.673685:0:14159:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:3.0:1783441670.673695:0:14148:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff91a87da46800/0xa2426164df2c8b86 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.13@tcp remote: 0x633a354aa4df51e9 expref: 6 pid: 14163 timeout: 608 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783441670.673782:0:14148:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.13@tcp, seq: 9 00000100:00100000:3.0:1783441670.673796:0:14148:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a877fac380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:bba70d1d-69c0-42ad-a2ea-85acf70f57f0+6:2354:x1870073673402496:12345-192.168.201.13@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1783441670.673815:0:14148:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1783441670.673823:0:14148:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff91a87da46800/0xa2426164df2c8b86 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.13@tcp remote: 0x633a354aa4df51e9 expref: 6 pid: 14163 timeout: 608 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783441670.673838:0:14148:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff91a87da46800/0xa2426164df2c8b86 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.13@tcp remote: 0x633a354aa4df51e9 expref: 6 pid: 14163 timeout: 608 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783441670.673864:0:14148:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91a87da46800/0xa2426164df2c8b86 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.13@tcp remote: 0x633a354aa4df51e9 expref: 6 pid: 14163 timeout: 608 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783441670.673887:0:14148:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff91a8439b0600) 00010000:00010000:3.0:1783441670.673893:0:14148:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff91a85f83c800/0xa2426164df2c8c20 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14164 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783441670.673904:0:14148:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff91a85f83c800/0xa2426164df2c8c20 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 14164 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783441670.673926:0:14148:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91a85f83c800/0xa2426164df2c8c20 lrc: 4/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 14164 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783441670.673968:0:14148:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1783441670.673989:0:14164:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff91a85f83c800/0xa2426164df2c8c20 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14164 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783441670.674002:0:14164:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91a85f83c800/0xa2426164df2c8c20 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14164 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783441670.674035:0:14164:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff91a85f83c000/0xa2426164df2c8c27 lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14164 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783441670.674045:0:14148:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a877fac380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:bba70d1d-69c0-42ad-a2ea-85acf70f57f0+5:2354:x1870073673402496:12345-192.168.201.13@tcp:103:ldlm_bl.0 Request processed in 250us (685us total) trans 0 rc 0/0 00010000:00010000:2.0:1783441670.674050:0:14164:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91a85f83c000/0xa2426164df2c8c27 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14164 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783441670.674061:0:14148:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.13@tcp, seq: 9 00010000:00010000:2.0:1783441670.674069:0:14164:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91a85f83c000/0xa2426164df2c8c27 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14164 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1783441670.675693:0:14164:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 512 00010000:00010000:2.0:1783441670.675710:0:14164:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff91a85f83c800/0xa2426164df2c8c20 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14164 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783441670.675719:0:14164:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff91a85f83c800/0xa2426164df2c8c20 lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14164 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783441670.675738:0:14164:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff91a85f83c800/0xa2426164df2c8c20 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14164 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783441670.675777:0:14164:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91a85f83c800 already unused, calling callback (ffffffffc1f9b4f0) 00010000:00010000:2.0:1783441670.675782:0:14164:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91a85f83c800/0xa2426164df2c8c20 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14164 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783441670.675790:0:14164:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91a85f83c800/0xa2426164df2c8c20 lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14164 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783441670.675807:0:14164:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff91a8439b0600) 00010000:00010000:2.0:1783441670.675810:0:14164:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1783441670.675815:0:14164:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff91a85f83c800/0xa2426164df2c8c20 lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14164 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783441670.675822:0:14164:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91a85f83c800/0xa2426164df2c8c20 lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14164 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1783441670.675843:0:14164:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000d70ea497 reply state 000000009bd04586 transno 8589934594 ns: mdt-lustre-MDT0000_UUID lock: ffff91a85f83c000/0xa2426164df2c8c27 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14164 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783441670.675854:0:14164:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1783441670.675961:0:14164:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a877fadf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:29d872ae-bafc-4783-9a98-d2418cedf182+10:14366:x1870073673402368:12345-192.168.201.13@tcp:36:lfs.0 Request processed in 7586us (7768us total) trans 8589934594 rc 0/0 00000100:00100000:2.0:1783441670.675970:0:14164:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.13@tcp, seq: 19 00010000:00010000:2.0:1783441670.684962:0:3290:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff91a85f83c000/0xa2426164df2c8c27 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14164 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783441670.684981:0:3290:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff91a85f83c000/0xa2426164df2c8c27 lrc: 2/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14164 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783441670.685005:0:3290:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff91a85f83c000/0xa2426164df2c8c27 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14164 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783441670.685011:0:3290:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91a85f83c000 already unused, calling callback (ffffffffc1f9b4f0) 00010000:00010000:2.0:1783441670.685015:0:3290:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91a85f83c000/0xa2426164df2c8c27 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14164 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783441670.685024:0:3290:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91a85f83c000/0xa2426164df2c8c27 lrc: 4/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14164 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783441670.685042:0:3290:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xab43d606 (ffff91a8429bd600) 00010000:00010000:2.0:1783441670.685045:0:3290:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1783441670.685049:0:3290:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff91a85f83c000/0xa2426164df2c8c27 lrc: 2/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14164 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783441670.685055:0:3290:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91a85f83c000/0xa2426164df2c8c27 lrc: 0/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14164 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783441670.776572:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.13@tcp (source: 12345-192.168.201.13@tcp) 00000100:00100000:3.0:1783441670.776698:0:15981:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073673402624 00000100:00100000:3.0:1783441670.776713:0:15981:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073673402624 00000100:00100000:3.0:1783441670.776850:0:15981:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.13@tcp, seq: 20 00000100:00100000:3.0:1783441670.776863:0:15981:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a877faf100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:29d872ae-bafc-4783-9a98-d2418cedf182+9:14374:x1870073673402624:12345-192.168.201.13@tcp:101:lctl.0 00010000:00010000:3.0:1783441670.776896:0:15981:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1783441670.776925:0:15981:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91a85eb3da00/0xa2426164df2c8c2e lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x633a354aa4df5213 expref: -99 pid: 15981 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783441670.777028:0:15981:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff91a85eb3dc00/0xa2426164df2c8c35 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 15981 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783441670.777044:0:15981:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91a85eb3dc00/0xa2426164df2c8c35 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 15981 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783441670.777058:0:15981:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91a85eb3dc00/0xa2426164df2c8c35 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 15981 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1783441670.777135:0:15981:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 7680 00000004:00200000:3.0:1783441670.777140:0:15981:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 4 stripe count 1 MDT count 1 00000004:00010000:3.0:1783441670.777190:0:15981:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff91a85eb3dc00/0xa2426164df2c8c35 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 15981 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783441670.777244:0:15981:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91a85eb3da00/0xa2426164df2c8c2e lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.13@tcp remote: 0x633a354aa4df5213 expref: 11 pid: 15981 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783441670.777264:0:15981:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff91a85eb3dc00/0xa2426164df2c8c35 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.13@tcp remote: 0x633a354aa4df5213 expref: 10 pid: 15981 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783441670.777273:0:15981:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff91a84b76f700) 00010000:00010000:3.0:1783441670.777276:0:15981:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1783441670.777280:0:15981:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91a85eb3dc00, rc 0) 00000100:00100000:3.0:1783441670.777382:0:15981:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a877faf100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:29d872ae-bafc-4783-9a98-d2418cedf182+10:14374:x1870073673402624:12345-192.168.201.13@tcp:101:lctl.0 Request processed in 512us (1047us total) trans 0 rc 0/0 00000100:00100000:3.0:1783441670.778276:0:15981:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.13@tcp, seq: 20 00000100:00100000:0.0:1783441670.802645:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.13@tcp (source: 12345-192.168.201.13@tcp) 00000100:00100000:2.0:1783441670.802841:0:14821:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073673402752 00000100:00100000:2.0:1783441670.802854:0:14821:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073673402752 00000100:00100000:2.0:1783441670.802982:0:14821:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.13@tcp, seq: 21 00000100:00100000:2.0:1783441670.802995:0:14821:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a877faf480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:bba70d1d-69c0-42ad-a2ea-85acf70f57f0+5:14375:x1870073673402752:12345-192.168.201.13@tcp:101:lfs.0 00010000:00010000:2.0:1783441670.803024:0:14821:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1783441670.803050:0:14821:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91a85f83c000/0xa2426164df2c8c3c lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x633a354aa4df521a expref: -99 pid: 14821 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783441670.803139:0:14821:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff91a85f83c800/0xa2426164df2c8c43 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 14821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783441670.803180:0:14821:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91a85f83c800/0xa2426164df2c8c43 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783441670.803195:0:14821:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91a85f83c800/0xa2426164df2c8c43 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14821 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1783441670.803286:0:14821:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 7680 00000004:00200000:2.0:1783441670.803291:0:14821:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 4 stripe count 1 MDT count 1 00000004:00010000:2.0:1783441670.803340:0:14821:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff91a85f83c800/0xa2426164df2c8c43 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783441670.803379:0:14821:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91a85f83c000/0xa2426164df2c8c3c lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.13@tcp remote: 0x633a354aa4df521a expref: 7 pid: 14821 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783441670.803472:0:14821:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff91a85f83c800/0xa2426164df2c8c43 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.13@tcp remote: 0x633a354aa4df521a expref: 6 pid: 14821 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783441670.803482:0:14821:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff91a84b76f700) 00010000:00010000:2.0:1783441670.803486:0:14821:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1783441670.803490:0:14821:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91a85f83c800, rc 0) 00000100:00100000:2.0:1783441670.803610:0:14821:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a877faf480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:bba70d1d-69c0-42ad-a2ea-85acf70f57f0+6:14375:x1870073673402752:12345-192.168.201.13@tcp:101:lfs.0 Request processed in 618us (979us total) trans 0 rc 0/0 00000100:00100000:2.0:1783441670.803618:0:14821:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.13@tcp, seq: 21 00000100:00100000:0.0:1783441670.807561:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.13@tcp (source: 12345-192.168.201.13@tcp) 00000100:00100000:2.0:1783441670.807673:0:14164:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073673402880 00000100:00100000:2.0:1783441670.807687:0:14164:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073673402880 00000100:00100000:2.0:1783441670.807850:0:14164:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.13@tcp, seq: 22 00000100:00100000:2.0:1783441670.807862:0:14164:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a877fac700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:bba70d1d-69c0-42ad-a2ea-85acf70f57f0+6:14375:x1870073673402880:12345-192.168.201.13@tcp:101:lfs.0 00010000:00010000:2.0:1783441670.807889:0:14164:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1783441670.807936:0:14164:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91a85f83da00/0xa2426164df2c8c4a lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x633a354aa4df5221 expref: -99 pid: 14164 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783441670.808022:0:14164:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff91a85f83c400/0xa2426164df2c8c51 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 14164 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783441670.808037:0:14164:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91a85f83c400/0xa2426164df2c8c51 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14164 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783441670.808051:0:14164:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91a85f83c400/0xa2426164df2c8c51 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14164 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783441670.808067:0:14164:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff91a85f83d800/0xa2426164df2c8c58 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14164 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783441670.808074:0:14164:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91a85f83d800/0xa2426164df2c8c58 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14164 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783441670.808080:0:14164:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91a85f83d800/0xa2426164df2c8c58 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14164 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783441670.808211:0:14164:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff91a85f83dc00/0xa2426164df2c8c5f lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14164 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783441670.808220:0:14164:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91a85f83dc00/0xa2426164df2c8c5f lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14164 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783441670.808228:0:14164:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91a85f83dc00/0xa2426164df2c8c5f lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14164 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1783441670.808282:0:14164:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 512 00000004:00200000:2.0:1783441670.808288:0:14164:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1783441670.808517:0:14164:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff91a85f83dc00/0xa2426164df2c8c5f lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14164 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783441670.808541:0:14164:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff91a85f83c400/0xa2426164df2c8c51 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14164 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783441670.808547:0:14164:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff91a85f83c400/0xa2426164df2c8c51 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 14164 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783441670.808554:0:14164:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff91a85f83c400/0xa2426164df2c8c51 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14164 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783441670.808560:0:14164:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91a85f83c400 already unused, calling callback (ffffffffc1f9b4f0) 00010000:00010000:2.0:1783441670.808565:0:14164:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91a85f83c400/0xa2426164df2c8c51 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14164 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783441670.808574:0:14164:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91a85f83c400/0xa2426164df2c8c51 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 14164 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783441670.808588:0:14164:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff91a84b76f700) 00010000:00010000:2.0:1783441670.808591:0:14164:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1783441670.808596:0:14164:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff91a85f83c400/0xa2426164df2c8c51 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14164 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783441670.808602:0:14164:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91a85f83c400/0xa2426164df2c8c51 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14164 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783441670.808616:0:14164:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff91a85f83d800/0xa2426164df2c8c58 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14164 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783441670.808623:0:14164:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff91a85f83d800/0xa2426164df2c8c58 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14164 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783441670.808628:0:14164:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff91a85f83d800/0xa2426164df2c8c58 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14164 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783441670.808641:0:14164:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91a85f83d800 already unused, calling callback (ffffffffc1f9b4f0) 00010000:00010000:2.0:1783441670.808644:0:14164:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91a85f83d800/0xa2426164df2c8c58 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14164 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783441670.808650:0:14164:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91a85f83d800/0xa2426164df2c8c58 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14164 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783441670.808659:0:14164:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xab43d606 (ffff91a8429bd600) 00010000:00010000:2.0:1783441670.808662:0:14164:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1783441670.808665:0:14164:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff91a85f83d800/0xa2426164df2c8c58 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14164 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783441670.808671:0:14164:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91a85f83d800/0xa2426164df2c8c58 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14164 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783441670.808712:0:14164:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91a85f83da00/0xa2426164df2c8c4a lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.13@tcp remote: 0x633a354aa4df5221 expref: 8 pid: 14164 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783441670.808727:0:14164:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff91a85f83dc00/0xa2426164df2c8c5f lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.13@tcp remote: 0x633a354aa4df5221 expref: 7 pid: 14164 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783441670.808734:0:14164:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff91a8429bd900) 00010000:00010000:2.0:1783441670.808736:0:14164:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1783441670.808766:0:14164:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91a85f83dc00, rc 0) 00000100:00100000:2.0:1783441670.808860:0:14164:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a877fac700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:bba70d1d-69c0-42ad-a2ea-85acf70f57f0+7:14375:x1870073673402880:12345-192.168.201.13@tcp:101:lfs.0 Request processed in 999us (1314us total) trans 0 rc 0/0 00000100:00100000:2.0:1783441670.808869:0:14164:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.13@tcp, seq: 22 00000100:00100000:0.0:1783441670.812889:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.13@tcp (source: 12345-192.168.201.13@tcp) 00000100:00100000:3.0:1783441670.813004:0:15981:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073673403136 00000100:00100000:3.0:1783441670.813018:0:15981:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073673403136 00000100:00100000:3.0:1783441670.813124:0:15981:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.13@tcp, seq: 23 00000100:00100000:3.0:1783441670.813136:0:15981:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a877fadc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:bba70d1d-69c0-42ad-a2ea-85acf70f57f0+7:14375:x1870073673403136:12345-192.168.201.13@tcp:101:lfs.0 00010000:00010000:3.0:1783441670.813165:0:15981:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1783441670.813192:0:15981:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91a85eb3da00/0xa2426164df2c8c66 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x633a354aa4df5228 expref: -99 pid: 15981 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1783441670.813365:0:15981:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 512 00010000:00010000:3.0:1783441670.813664:0:15981:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff91a85eb3da00/0xa2426164df2c8c66 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.13@tcp remote: 0x633a354aa4df5228 expref: 9 pid: 15981 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783441670.813685:0:15981:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff91a84b76f700) 00010000:00010000:3.0:1783441670.813688:0:15981:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1783441670.813712:0:15981:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91a85eb3da00/0xa2426164df2c8c66 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.13@tcp remote: 0x633a354aa4df5228 expref: 9 pid: 15981 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783441670.813729:0:15981:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91a85eb3da00, rc 0) 00000100:00100000:3.0:1783441670.813897:0:15981:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a877fadc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:bba70d1d-69c0-42ad-a2ea-85acf70f57f0+8:14375:x1870073673403136:12345-192.168.201.13@tcp:101:lfs.0 Request processed in 763us (1023us total) trans 8589934595 rc 301/301 00000100:00100000:3.0:1783441670.813905:0:15981:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.13@tcp, seq: 23 00000100:00100000:0.0:1783441670.817903:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.13@tcp (source: 12345-192.168.201.13@tcp) 00000100:00100000:2.0:1783441670.818062:0:14821:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073673403392 00000100:00100000:2.0:1783441670.818094:0:14821:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073673403392 00000100:00100000:2.0:1783441670.818201:0:14821:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.13@tcp, seq: 24 00000100:00100000:2.0:1783441670.818213:0:14821:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a877fad180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:bba70d1d-69c0-42ad-a2ea-85acf70f57f0+8:14375:x1870073673403392:12345-192.168.201.13@tcp:36:lfs.0 00010000:00010000:2.0:1783441670.818288:0:14821:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1783441670.818509:0:14821:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91a85f83dc00/0xa2426164df2c8c5f lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.13@tcp remote: 0x633a354aa4df5221 expref: 8 pid: 14164 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783441670.818531:0:14821:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff91a8429bd900) 00010000:00010000:2.0:1783441670.818547:0:14821:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1783441670.818580:0:14821:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff91a85f83c000/0xa2426164df2c8c74 lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783441670.818595:0:14821:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91a85f83c000/0xa2426164df2c8c74 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783441670.818605:0:14821:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91a85f83c000/0xa2426164df2c8c74 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14821 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1783441670.819041:0:14821:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000993b9fed reply state 00000000a01490e4 transno 8589934596 ns: mdt-lustre-MDT0000_UUID lock: ffff91a85f83c000/0xa2426164df2c8c74 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14821 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783441670.819053:0:14821:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000004:00200000:2.0:1783441670.819068:0:14821:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 512 00000100:00100000:2.0:1783441670.819165:0:14821:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a877fad180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:bba70d1d-69c0-42ad-a2ea-85acf70f57f0+9:14375:x1870073673403392:12345-192.168.201.13@tcp:36:lfs.0 Request processed in 953us (1275us total) trans 8589934596 rc 0/0 00000100:00100000:2.0:1783441670.819173:0:14821:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.13@tcp, seq: 24 00010000:00010000:2.0:1783441670.821678:0:3289:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff91a85f83c000/0xa2426164df2c8c74 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783441670.821702:0:3289:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff91a85f83c000/0xa2426164df2c8c74 lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783441670.821729:0:3289:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff91a85f83c000/0xa2426164df2c8c74 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783441670.821736:0:3289:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91a85f83c000 already unused, calling callback (ffffffffc1f9b4f0) 00010000:00010000:2.0:1783441670.821766:0:3289:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91a85f83c000/0xa2426164df2c8c74 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783441670.821777:0:3289:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91a85f83c000/0xa2426164df2c8c74 lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783441670.821799:0:3289:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff91a8429bd500) 00010000:00010000:2.0:1783441670.821802:0:3289:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 22 00010000:00010000:2.0:1783441670.821807:0:3289:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff91a85f83c000/0xa2426164df2c8c74 lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783441670.821813:0:3289:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91a85f83c000/0xa2426164df2c8c74 lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14821 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783441670.822087:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.13@tcp (source: 12345-192.168.201.13@tcp) 00000100:00100000:3.0:1783441670.822220:0:14165:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073673403648 00000100:00100000:3.0:1783441670.822232:0:14165:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073673403648 00000100:00100000:3.0:1783441670.822285:0:14165:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.13@tcp, seq: 2 00000100:00100000:3.0:1783441670.822304:0:14165:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a877faf800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:bba70d1d-69c0-42ad-a2ea-85acf70f57f0+8:14375:x1870073673403648:12345-192.168.201.13@tcp:35:lfs.0 00000100:00100000:3.0:1783441670.822658:0:14165:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a877faf800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:bba70d1d-69c0-42ad-a2ea-85acf70f57f0+9:14375:x1870073673403648:12345-192.168.201.13@tcp:35:lfs.0 Request processed in 362us (575us total) trans 8589934597 rc 0/0 00000100:00100000:3.0:1783441670.822668:0:14165:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.13@tcp, seq: 2 00000100:00100000:0.0:1783441670.825134:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.13@tcp (source: 12345-192.168.201.13@tcp) 00000100:00100000:2.0:1783441670.825279:0:14164:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073673403904 00000100:00100000:2.0:1783441670.825299:0:14164:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073673403904 00000100:00100000:2.0:1783441670.825388:0:14164:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.13@tcp, seq: 25 00000100:00100000:2.0:1783441670.825628:0:14164:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a745a7ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:bba70d1d-69c0-42ad-a2ea-85acf70f57f0+9:14375:x1870073673403904:12345-192.168.201.13@tcp:101:lfs.0 00010000:00010000:2.0:1783441670.825657:0:14164:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1783441670.825679:0:14164:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91a85f83cc00/0xa2426164df2c8c7b lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x633a354aa4df522f expref: -99 pid: 14164 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783441670.825805:0:14164:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff91a85f83c600/0xa2426164df2c8c82 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 14164 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783441670.825822:0:14164:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91a85f83c600/0xa2426164df2c8c82 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14164 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783441670.825853:0:14164:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91a85f83c600/0xa2426164df2c8c82 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14164 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783441670.825870:0:14164:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff91a85f83d600/0xa2426164df2c8c89 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14164 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783441670.825878:0:14164:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91a85f83d600/0xa2426164df2c8c89 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14164 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783441670.825884:0:14164:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91a85f83d600/0xa2426164df2c8c89 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14164 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1783441670.826051:0:14164:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 512 00010000:00010000:2.0:1783441670.826164:0:14164:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff91a85f83c600/0xa2426164df2c8c82 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14164 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783441670.826171:0:14164:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff91a85f83c600/0xa2426164df2c8c82 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 14164 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783441670.826176:0:14164:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff91a85f83c600/0xa2426164df2c8c82 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14164 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783441670.826180:0:14164:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91a85f83c600 already unused, calling callback (ffffffffc1f9b4f0) 00010000:00010000:2.0:1783441670.826184:0:14164:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91a85f83c600/0xa2426164df2c8c82 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14164 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783441670.826190:0:14164:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91a85f83c600/0xa2426164df2c8c82 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 14164 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783441670.826201:0:14164:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff91a84b76f700) 00010000:00010000:2.0:1783441670.826203:0:14164:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1783441670.826212:0:14164:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff91a85f83c600/0xa2426164df2c8c82 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14164 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783441670.826217:0:14164:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91a85f83c600/0xa2426164df2c8c82 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14164 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783441670.826228:0:14164:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff91a85f83d600/0xa2426164df2c8c89 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14164 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783441670.826232:0:14164:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff91a85f83d600/0xa2426164df2c8c89 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14164 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783441670.826236:0:14164:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff91a85f83d600/0xa2426164df2c8c89 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14164 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783441670.826239:0:14164:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91a85f83d600 already unused, calling callback (ffffffffc1f9b4f0) 00010000:00010000:2.0:1783441670.826240:0:14164:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91a85f83d600/0xa2426164df2c8c89 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14164 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783441670.826244:0:14164:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91a85f83d600/0xa2426164df2c8c89 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14164 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783441670.826248:0:14164:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xab43d606 (ffff91a8429bd100) 00010000:00010000:2.0:1783441670.826249:0:14164:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1783441670.826250:0:14164:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff91a85f83d600/0xa2426164df2c8c89 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14164 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783441670.826253:0:14164:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91a85f83d600/0xa2426164df2c8c89 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14164 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783441670.826303:0:14164:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff91a85f83cc00/0xa2426164df2c8c7b lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.13@tcp remote: 0x633a354aa4df522f expref: 11 pid: 14164 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783441670.826325:0:14164:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff91a84b76f700) 00010000:00010000:2.0:1783441670.826327:0:14164:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1783441670.826331:0:14164:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91a85f83cc00/0xa2426164df2c8c7b lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.13@tcp remote: 0x633a354aa4df522f expref: 11 pid: 14164 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783441670.826341:0:14164:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91a85f83cc00, rc 0) 00000100:00100000:2.0:1783441670.826860:0:14164:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a745a7ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:bba70d1d-69c0-42ad-a2ea-85acf70f57f0+10:14375:x1870073673403904:12345-192.168.201.13@tcp:101:lfs.0 Request processed in 1233us (1744us total) trans 8589934598 rc 301/301 00000100:00100000:2.0:1783441670.826868:0:14164:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.13@tcp, seq: 25 00000100:00100000:0.0:1783441670.829637:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.13@tcp (source: 12345-192.168.201.13@tcp) 00000100:00100000:3.0:1783441670.829773:0:15981:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073673404032 00000100:00100000:3.0:1783441670.829787:0:15981:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073673404032 00000100:00100000:3.0:1783441670.829864:0:15981:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.13@tcp, seq: 26 00000100:00100000:3.0:1783441670.829876:0:15981:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a745a79500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:bba70d1d-69c0-42ad-a2ea-85acf70f57f0+10:14375:x1870073673404032:12345-192.168.201.13@tcp:101:lfs.0 00010000:00010000:3.0:1783441670.829906:0:15981:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1783441670.829936:0:15981:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91a85eb3da00/0xa2426164df2c8c97 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x633a354aa4df5236 expref: -99 pid: 15981 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783441670.830051:0:15981:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff91a85eb3d800/0xa2426164df2c8c9e lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 15981 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783441670.830067:0:15981:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91a85eb3d800/0xa2426164df2c8c9e lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 15981 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783441670.830106:0:15981:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91a85eb3d800/0xa2426164df2c8c9e lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 15981 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1783441670.830172:0:15981:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 512 00000004:00200000:3.0:1783441670.830177:0:15981:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:3.0:1783441670.830206:0:15981:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff91a85eb3d800/0xa2426164df2c8c9e lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 15981 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783441670.830239:0:15981:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91a85eb3da00/0xa2426164df2c8c97 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.13@tcp remote: 0x633a354aa4df5236 expref: 12 pid: 15981 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783441670.830258:0:15981:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff91a85eb3d800/0xa2426164df2c8c9e lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.13@tcp remote: 0x633a354aa4df5236 expref: 11 pid: 15981 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783441670.830268:0:15981:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff91a84b76fc00) 00010000:00010000:3.0:1783441670.830271:0:15981:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1783441670.830275:0:15981:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91a85eb3d800, rc 0) 00000100:00100000:3.0:1783441670.830354:0:15981:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a745a79500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:bba70d1d-69c0-42ad-a2ea-85acf70f57f0+11:14375:x1870073673404032:12345-192.168.201.13@tcp:101:lfs.0 Request processed in 480us (731us total) trans 0 rc 0/0 00000100:00100000:3.0:1783441670.830362:0:15981:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.13@tcp, seq: 26 00000100:00100000:0.0:1783441670.833997:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.13@tcp (source: 12345-192.168.201.13@tcp) 00000100:00100000:1.0:1783441670.834149:0:14166:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073673404160 00000100:00100000:1.0:1783441670.834163:0:14166:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073673404160 00000100:00100000:1.0:1783441670.834257:0:14166:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.13@tcp, seq: 3 00000100:00100000:1.0:1783441670.834266:0:14166:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a745a78380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:bba70d1d-69c0-42ad-a2ea-85acf70f57f0+11:14375:x1870073673404160:12345-192.168.201.13@tcp:37:lfs.0 00000100:00100000:2.0:1783441670.843000:0:14166:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a745a78380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:bba70d1d-69c0-42ad-a2ea-85acf70f57f0+11:14375:x1870073673404160:12345-192.168.201.13@tcp:37:lfs.0 Request processed in 8718us (9002us total) trans 0 rc 0/0 00000100:00100000:2.0:1783441670.843020:0:14166:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.13@tcp, seq: 3 00000100:00100000:0.0:1783441670.846855:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.13@tcp (source: 12345-192.168.201.13@tcp) 00000100:00100000:3.0:1783441670.846953:0:14165:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073673404416 00000100:00100000:3.0:1783441670.846967:0:14165:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073673404416 00000100:00100000:3.0:1783441670.847099:0:14165:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.13@tcp, seq: 4 00000100:00100000:3.0:1783441670.847113:0:14165:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a8756c4050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:bba70d1d-69c0-42ad-a2ea-85acf70f57f0+11:14375:x1870073673404416:12345-192.168.201.13@tcp:35:lfs.0 00000100:00100000:3.0:1783441670.847905:0:14165:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a8756c4050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:bba70d1d-69c0-42ad-a2ea-85acf70f57f0+12:14375:x1870073673404416:12345-192.168.201.13@tcp:35:lfs.0 Request processed in 787us (1162us total) trans 8589934599 rc 0/0 00000100:00100000:3.0:1783441670.847916:0:14165:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.13@tcp, seq: 4 00000100:00100000:0.0:1783441670.906593:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.13@tcp (source: 12345-192.168.201.13@tcp) 00000100:00100000:2.0:1783441670.906885:0:14821:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073673404544 00000100:00100000:2.0:1783441670.906899:0:14821:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073673404544 00000100:00100000:2.0:1783441670.907324:0:14821:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.13@tcp, seq: 27 00000100:00100000:2.0:1783441670.907336:0:14821:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a745a7b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:29d872ae-bafc-4783-9a98-d2418cedf182+10:14381:x1870073673404544:12345-192.168.201.13@tcp:101:bash.0 00010000:00010000:2.0:1783441670.907363:0:14821:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1783441670.907406:0:14821:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91a85f83cc00/0xa2426164df2c8ca5 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x633a354aa4df523d expref: -99 pid: 14821 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783441670.907495:0:14821:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff91a85f83d600/0xa2426164df2c8cac lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 14821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783441670.907511:0:14821:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91a85f83d600/0xa2426164df2c8cac lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783441670.907548:0:14821:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91a85f83d600/0xa2426164df2c8cac lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783441670.907567:0:14821:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff91a85f83c600/0xa2426164df2c8cb3 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783441670.907575:0:14821:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91a85f83c600/0xa2426164df2c8cb3 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783441670.907582:0:14821:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91a85f83c600/0xa2426164df2c8cb3 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783441670.907722:0:14821:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff91a85f83c000/0xa2426164df2c8cba lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783441670.907731:0:14821:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91a85f83c000/0xa2426164df2c8cba lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783441670.907738:0:14821:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91a85f83c000/0xa2426164df2c8cba lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14821 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1783441670.907808:0:14821:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 512 00000004:00200000:2.0:1783441670.907812:0:14821:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1783441670.907864:0:14821:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff91a85f83c000/0xa2426164df2c8cba lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783441670.907877:0:14821:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff91a85f83d600/0xa2426164df2c8cac lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783441670.907884:0:14821:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff91a85f83d600/0xa2426164df2c8cac lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 14821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783441670.907901:0:14821:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff91a85f83d600/0xa2426164df2c8cac lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783441670.907908:0:14821:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91a85f83d600 already unused, calling callback (ffffffffc1f9b4f0) 00010000:00010000:2.0:1783441670.907913:0:14821:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91a85f83d600/0xa2426164df2c8cac lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783441670.907922:0:14821:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91a85f83d600/0xa2426164df2c8cac lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 14821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783441670.907938:0:14821:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff91a84b76f700) 00010000:00010000:2.0:1783441670.907941:0:14821:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1783441670.907946:0:14821:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff91a85f83d600/0xa2426164df2c8cac lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783441670.907951:0:14821:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91a85f83d600/0xa2426164df2c8cac lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783441670.907981:0:14821:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff91a85f83c600/0xa2426164df2c8cb3 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783441670.907986:0:14821:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff91a85f83c600/0xa2426164df2c8cb3 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783441670.907992:0:14821:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff91a85f83c600/0xa2426164df2c8cb3 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783441670.907996:0:14821:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91a85f83c600 already unused, calling callback (ffffffffc1f9b4f0) 00010000:00010000:2.0:1783441670.907999:0:14821:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91a85f83c600/0xa2426164df2c8cb3 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783441670.908014:0:14821:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91a85f83c600/0xa2426164df2c8cb3 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783441670.908022:0:14821:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xab43d606 (ffff91a8429bd100) 00010000:00010000:2.0:1783441670.908024:0:14821:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1783441670.908027:0:14821:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff91a85f83c600/0xa2426164df2c8cb3 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783441670.908033:0:14821:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91a85f83c600/0xa2426164df2c8cb3 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783441670.908072:0:14821:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91a85f83cc00/0xa2426164df2c8ca5 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.13@tcp remote: 0x633a354aa4df523d expref: 12 pid: 14821 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783441670.908087:0:14821:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff91a85f83c000/0xa2426164df2c8cba lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.13@tcp remote: 0x633a354aa4df523d expref: 11 pid: 14821 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783441670.908094:0:14821:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff91a84b76fc00) 00010000:00010000:2.0:1783441670.908096:0:14821:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:2.0:1783441670.908099:0:14821:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91a85f83c000, rc 0) 00000100:00100000:2.0:1783441670.908189:0:14821:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a745a7b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:29d872ae-bafc-4783-9a98-d2418cedf182+11:14381:x1870073673404544:12345-192.168.201.13@tcp:101:bash.0 Request processed in 855us (1611us total) trans 0 rc 0/0 00000100:00100000:2.0:1783441670.908197:0:14821:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.13@tcp, seq: 27 00000100:00100000:0.0:1783441670.915188:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.13@tcp (source: 12345-192.168.201.13@tcp) 00000100:00100000:1.0:1783441670.915504:0:14164:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073673404800 00000100:00100000:1.0:1783441670.915518:0:14164:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073673404800 00000100:00100000:1.0:1783441670.915596:0:14164:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.13@tcp, seq: 28 00000100:00100000:1.0:1783441670.915607:0:14164:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a745a78000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:29d872ae-bafc-4783-9a98-d2418cedf182+11:14381:x1870073673404800:12345-192.168.201.13@tcp:101:bash.0 00010000:00010000:1.0:1783441670.915633:0:14164:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1783441670.915657:0:14164:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91a87da47e00/0xa2426164df2c8cc1 lrc: 2/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x633a354aa4df5244 expref: -99 pid: 14164 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783441670.915856:0:14164:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff91a87da46200/0xa2426164df2c8cc8 lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 14164 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783441670.915873:0:14164:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff91a85eb3d800/0xa2426164df2c8c9e lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.13@tcp remote: 0x633a354aa4df5236 expref: 11 pid: 15981 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783441670.915899:0:14164:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff91a87da46200/0xa2426164df2c8cc8 lrc: 4/0,1 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14164 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783441670.916225:0:14164:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff91a85eb3d800/0xa2426164df2c8c9e lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.13@tcp remote: 0x633a354aa4df5236 expref: 11 pid: 15981 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783441670.916242:0:14164:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff91a85eb3d800/0xa2426164df2c8c9e lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.13@tcp remote: 0x633a354aa4df5236 expref: 11 pid: 15981 timeout: 608 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783441670.916259:0:14164:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff91a867cd4a80 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:14164:1870073693319936:192.168.201.13@tcp:104: 00000100:00100000:1.0:1783441670.916735:0:14164:0:(client.c:2702:ptlrpc_set_wait()) set ffff91a8428ac180 going to sleep for 11 seconds 00000100:00100000:0.0:1783441670.921248:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.13@tcp (source: 12345-192.168.201.13@tcp) 00000100:00100000:2.0:1783441670.921541:0:14150:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073673404928 00000100:00100000:2.0:1783441670.921553:0:14150:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073673404928 00010000:00010000:2.0:1783441670.921603:0:14150:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff91a85eb3d800/0xa2426164df2c8c9e lrc: 5/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.13@tcp remote: 0x633a354aa4df5236 expref: 12 pid: 15981 timeout: 608 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783441670.921669:0:14150:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.13@tcp, seq: 10 00000100:00100000:2.0:1783441670.921681:0:14150:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a745a7bb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:bba70d1d-69c0-42ad-a2ea-85acf70f57f0+12:2355:x1870073673404928:12345-192.168.201.13@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1783441670.921699:0:14150:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1783441670.921707:0:14150:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff91a85eb3d800/0xa2426164df2c8c9e lrc: 5/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.13@tcp remote: 0x633a354aa4df5236 expref: 12 pid: 15981 timeout: 608 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783441670.921723:0:14150:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff91a85eb3d800/0xa2426164df2c8c9e lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.13@tcp remote: 0x633a354aa4df5236 expref: 12 pid: 15981 timeout: 608 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783441670.921786:0:14150:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff91a84b76fc00) 00010000:00010000:2.0:1783441670.921793:0:14150:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff91a87da46200/0xa2426164df2c8cc8 lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 14164 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783441670.921805:0:14150:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff91a87da46200/0xa2426164df2c8cc8 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50290000000000 pid: 14164 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783441670.921814:0:14150:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91a87da46200/0xa2426164df2c8cc8 lrc: 4/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50290000000000 pid: 14164 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783441670.921839:0:14150:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1783441670.921903:0:14150:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a745a7bb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:bba70d1d-69c0-42ad-a2ea-85acf70f57f0+12:2355:x1870073673404928:12345-192.168.201.13@tcp:103:ldlm_bl.0 Request processed in 223us (667us total) trans 0 rc 0/0 00000100:00100000:2.0:1783441670.921911:0:14150:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.13@tcp, seq: 10 00010000:00010000:1.0:1783441670.923063:0:14164:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91a85eb3d800/0xa2426164df2c8c9e lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.13@tcp remote: 0x633a354aa4df5236 expref: 11 pid: 15981 timeout: 608 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783441670.923089:0:14164:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff91a867cd4a80 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:14164:1870073693319936:192.168.201.13@tcp:104: 00010000:00010000:1.0:1783441670.923117:0:14164:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff91a87da46200/0xa2426164df2c8cc8 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14164 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783441670.923128:0:14164:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff91a87da46200/0xa2426164df2c8cc8 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14164 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783441670.923133:0:14164:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91a87da46200/0xa2426164df2c8cc8 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14164 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783441670.923168:0:14164:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff91a87da46400/0xa2426164df2c8ccf lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14164 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783441670.923181:0:14164:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91a87da46400/0xa2426164df2c8ccf lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14164 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783441670.923206:0:14164:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91a87da46400/0xa2426164df2c8ccf lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14164 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783441670.926325:0:14164:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff91a87da46800/0xa2426164df2c8cd6 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14164 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783441670.926349:0:14164:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91a87da46800/0xa2426164df2c8cd6 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14164 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783441670.926363:0:14164:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91a87da46800/0xa2426164df2c8cd6 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14164 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1783441670.926508:0:14164:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 0 00010000:00010000:1.0:1783441670.926550:0:14164:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff91a87da46200/0xa2426164df2c8cc8 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14164 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783441670.926558:0:14164:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff91a87da46200/0xa2426164df2c8cc8 lrc: 2/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 14164 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783441670.926565:0:14164:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff91a87da46200/0xa2426164df2c8cc8 lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 14164 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783441670.926571:0:14164:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91a87da46200 already unused, calling callback (ffffffffc1f9b4f0) 00010000:00010000:1.0:1783441670.926576:0:14164:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91a87da46200/0xa2426164df2c8cc8 lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 14164 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783441670.926584:0:14164:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91a87da46200/0xa2426164df2c8cc8 lrc: 4/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 14164 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783441670.926601:0:14164:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff91a84b76fc00) 00010000:00010000:1.0:1783441670.926604:0:14164:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1783441670.926624:0:14164:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff91a87da46200/0xa2426164df2c8cc8 lrc: 2/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 14164 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783441670.926631:0:14164:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91a87da46200/0xa2426164df2c8cc8 lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 14164 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1783441670.926650:0:14164:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 000000007789be58 reply state 000000005c9fd283 transno 8589934600 ns: mdt-lustre-MDT0000_UUID lock: ffff91a87da46400/0xa2426164df2c8ccf lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14164 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783441670.926659:0:14164:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:1.0:1783441670.926707:0:14164:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91a87da47e00/0xa2426164df2c8cc1 lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.13@tcp remote: 0x633a354aa4df5244 expref: 14 pid: 14164 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783441670.926725:0:14164:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff91a87da46800/0xa2426164df2c8cd6 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.13@tcp remote: 0x633a354aa4df5244 expref: 13 pid: 14164 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783441670.926733:0:14164:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff91a858b90500) 00010000:00010000:1.0:1783441670.926736:0:14164:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 9 00010000:00010000:1.0:1783441670.926738:0:14164:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91a87da46800, rc 0) 00000100:00100000:1.0:1783441670.927025:0:14164:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a745a78000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:29d872ae-bafc-4783-9a98-d2418cedf182+14:14381:x1870073673404800:12345-192.168.201.13@tcp:101:bash.0 Request processed in 11418us (11849us total) trans 8589934600 rc 0/0 00000100:00100000:1.0:1783441670.927034:0:14164:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.13@tcp, seq: 28 00010000:00010000:2.0:1783441670.930995:0:3290:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff91a87da46400/0xa2426164df2c8ccf lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14164 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783441670.931016:0:3290:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff91a87da46400/0xa2426164df2c8ccf lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14164 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783441670.931042:0:3290:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff91a87da46400/0xa2426164df2c8ccf lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14164 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783441670.931049:0:3290:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91a87da46400 already unused, calling callback (ffffffffc1f9b4f0) 00010000:00010000:2.0:1783441670.931055:0:3290:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91a87da46400/0xa2426164df2c8ccf lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14164 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783441670.931063:0:3290:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91a87da46400/0xa2426164df2c8ccf lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14164 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783441670.931085:0:3290:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0xd7b8fa41 (ffff91a858b90d00) 00010000:00010000:2.0:1783441670.931088:0:3290:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1783441670.931092:0:3290:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff91a87da46400/0xa2426164df2c8ccf lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14164 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783441670.931099:0:3290:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91a87da46400/0xa2426164df2c8ccf lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14164 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783441670.939162:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.13@tcp (source: 12345-192.168.201.13@tcp) 00000100:00100000:3.0:1783441670.939504:0:15981:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073673405056 00000100:00100000:3.0:1783441670.939518:0:15981:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073673405056 00000100:00100000:3.0:1783441670.939597:0:15981:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.13@tcp, seq: 29 00000100:00100000:3.0:1783441670.939609:0:15981:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a745a78380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:29d872ae-bafc-4783-9a98-d2418cedf182+13:14381:x1870073673405056:12345-192.168.201.13@tcp:101:bash.0 00010000:00010000:3.0:1783441670.939642:0:15981:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1783441670.939671:0:15981:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91a85eb3da00/0xa2426164df2c8ce4 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x633a354aa4df524b expref: -99 pid: 15981 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783441670.939794:0:15981:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff91a85eb3ca00/0xa2426164df2c8ceb lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 15981 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783441670.939811:0:15981:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91a85eb3ca00/0xa2426164df2c8ceb lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 15981 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783441670.939825:0:15981:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91a85eb3ca00/0xa2426164df2c8ceb lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 15981 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1783441670.939878:0:15981:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 0 00000004:00200000:3.0:1783441670.939883:0:15981:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:3.0:1783441670.939909:0:15981:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff91a85eb3ca00/0xa2426164df2c8ceb lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 15981 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783441670.939923:0:15981:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91a85eb3ca00/0xa2426164df2c8ceb lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 15981 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783441670.939953:0:15981:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91a85eb3da00/0xa2426164df2c8ce4 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.13@tcp remote: 0x633a354aa4df524b expref: 15 pid: 15981 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783441670.939975:0:15981:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff91a85eb3ca00/0xa2426164df2c8ceb lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.13@tcp remote: 0x633a354aa4df524b expref: 14 pid: 15981 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783441670.940008:0:15981:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff91a858b90500) 00010000:00010000:3.0:1783441670.940011:0:15981:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1783441670.940016:0:15981:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91a85eb3ca00, rc 0) 00000100:00100000:3.0:1783441670.940222:0:15981:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a745a78380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:29d872ae-bafc-4783-9a98-d2418cedf182+14:14381:x1870073673405056:12345-192.168.201.13@tcp:101:bash.0 Request processed in 615us (1075us total) trans 0 rc 0/0 00000100:00100000:3.0:1783441670.940230:0:15981:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.13@tcp, seq: 29 00000100:00100000:0.0:1783441670.944287:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.13@tcp (source: 12345-192.168.201.13@tcp) 00000100:00100000:2.0:1783441670.944402:0:14166:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073673405312 00000100:00100000:2.0:1783441670.944416:0:14166:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073673405312 00000100:00100000:2.0:1783441670.944491:0:14166:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.13@tcp, seq: 5 00000100:00100000:2.0:1783441670.944504:0:14166:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a874dc5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:29d872ae-bafc-4783-9a98-d2418cedf182+14:14381:x1870073673405312:12345-192.168.201.13@tcp:35:bash.0 00000100:00100000:2.0:1783441670.944996:0:14166:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a874dc5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:29d872ae-bafc-4783-9a98-d2418cedf182+15:14381:x1870073673405312:12345-192.168.201.13@tcp:35:bash.0 Request processed in 493us (721us total) trans 8589934601 rc 0/0 00000100:00100000:2.0:1783441670.945006:0:14166:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.13@tcp, seq: 5 00000100:00100000:1.0:1783441671.012315:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.13@tcp (source: 12345-192.168.201.13@tcp) 00000100:00100000:0.0:1783441671.012444:0:14163:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073673405568 00000100:00100000:0.0:1783441671.012458:0:14163:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073673405568 00000100:00100000:0.0:1783441671.012600:0:14163:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.13@tcp, seq: 30 00000100:00100000:0.0:1783441671.012613:0:14163:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a867cd4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:29d872ae-bafc-4783-9a98-d2418cedf182+15:14391:x1870073673405568:12345-192.168.201.13@tcp:101:lfs.0 00010000:00010000:0.0:1783441671.012664:0:14163:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1783441671.012690:0:14163:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91a85fe59a00/0xa2426164df2c8cf2 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x633a354aa4df5252 expref: -99 pid: 14163 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1783441671.012870:0:14163:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 512 00010000:00010000:0.0:1783441671.013055:0:14163:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff91a85fe59a00/0xa2426164df2c8cf2 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.13@tcp remote: 0x633a354aa4df5252 expref: 17 pid: 14163 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783441671.013073:0:14163:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff91a84b76f700) 00010000:00010000:0.0:1783441671.013076:0:14163:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1783441671.013082:0:14163:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91a85fe59a00/0xa2426164df2c8cf2 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.13@tcp remote: 0x633a354aa4df5252 expref: 17 pid: 14163 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783441671.013099:0:14163:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91a85fe59a00, rc 0) 00000100:00100000:0.0:1783441671.013246:0:14163:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a867cd4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:29d872ae-bafc-4783-9a98-d2418cedf182+16:14391:x1870073673405568:12345-192.168.201.13@tcp:101:lfs.0 Request processed in 636us (946us total) trans 8589934602 rc 301/301 00000100:00100000:0.0:1783441671.013252:0:14163:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.13@tcp, seq: 30 00000100:00100000:0.0:1783441671.017878:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.13@tcp (source: 12345-192.168.201.13@tcp) 00000100:00100000:2.0:1783441671.018077:0:14166:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073673405824 00000100:00100000:2.0:1783441671.018091:0:14166:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073673405824 00000100:00100000:2.0:1783441671.018164:0:14166:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.13@tcp, seq: 6 00000100:00100000:2.0:1783441671.018189:0:14166:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a874dc7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:29d872ae-bafc-4783-9a98-d2418cedf182+16:14391:x1870073673405824:12345-192.168.201.13@tcp:35:lfs.0 00000100:00100000:2.0:1783441671.019175:0:14166:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a874dc7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:29d872ae-bafc-4783-9a98-d2418cedf182+17:14391:x1870073673405824:12345-192.168.201.13@tcp:35:lfs.0 Request processed in 980us (1305us total) trans 8589934603 rc 0/0 00000100:00100000:2.0:1783441671.019186:0:14166:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.13@tcp, seq: 6 00010000:00010000:0.0:1783441671.021812:0:14151:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1783441671.027029:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.13@tcp (source: 12345-192.168.201.13@tcp) 00000100:00100000:1.0:1783441671.027085:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.13@tcp (source: 12345-192.168.201.13@tcp) 00000100:00100000:1.0:1783441671.027117:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.13@tcp (source: 12345-192.168.201.13@tcp) 00000100:00100000:1.0:1783441671.027163:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.13@tcp (source: 12345-192.168.201.13@tcp) 00000100:00100000:1.0:1783441671.027188:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.13@tcp (source: 12345-192.168.201.13@tcp) 00000100:00100000:0.0:1783441671.027287:0:14156:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073673405952 00000100:00100000:0.0:1783441671.027312:0:14156:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073673405952 00000100:00100000:0.0:1783441671.027403:0:14156:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.13@tcp, seq: 120 00000100:00100000:0.0:1783441671.027416:0:14156:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a874bebc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6a88b831-6e01-4d2d-a809-7fdb49ecdbbb+13:2355:x1870073673405952:12345-192.168.201.13@tcp:400:kworker.0 00000100:00100000:0.0:1783441671.027514:0:14156:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a874bebc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6a88b831-6e01-4d2d-a809-7fdb49ecdbbb+13:2355:x1870073673405952:12345-192.168.201.13@tcp:400:kworker.0 Request processed in 100us (500us total) trans 0 rc 0/0 00000100:00100000:0.0:1783441671.027523:0:14156:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.13@tcp, seq: 120 00000100:00100000:3.0:1783441671.027983:0:14798:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073673406208 00000100:00100000:3.0:1783441671.027988:0:14798:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073673406208 00000100:00100000:3.0:1783441671.028041:0:14798:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073673406464 00000100:00100000:3.0:1783441671.028044:0:14798:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073673406464 00000100:00100000:3.0:1783441671.028060:0:14798:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073673406080 00000100:00100000:3.0:1783441671.028063:0:14798:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073673406080 00000100:00100000:3.0:1783441671.028076:0:14798:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073673406336 00000100:00100000:3.0:1783441671.028079:0:14798:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073673406336 00000100:00100000:3.0:1783441671.028095:0:14798:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.13@tcp, seq: 14 00000100:00100000:3.0:1783441671.028103:0:14798:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a867cd5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:29d872ae-bafc-4783-9a98-d2418cedf182+5:2355:x1870073673406208:12345-192.168.201.13@tcp:400:kworker.0 00000100:00100000:3.0:1783441671.028150:0:14798:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a867cd5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:29d872ae-bafc-4783-9a98-d2418cedf182+5:2355:x1870073673406208:12345-192.168.201.13@tcp:400:kworker.0 Request processed in 48us (1065us total) trans 0 rc 0/0 00000100:00100000:3.0:1783441671.028157:0:14798:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.13@tcp, seq: 14 00000100:00100000:3.0:1783441671.028178:0:14798:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.13@tcp, seq: 15 00000100:00100000:3.0:1783441671.028183:0:14798:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a867cd7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:bba70d1d-69c0-42ad-a2ea-85acf70f57f0+5:2355:x1870073673406464:12345-192.168.201.13@tcp:400:kworker.0 00000100:00100000:3.0:1783441671.028209:0:14798:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a867cd7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:bba70d1d-69c0-42ad-a2ea-85acf70f57f0+5:2355:x1870073673406464:12345-192.168.201.13@tcp:400:kworker.0 Request processed in 25us (1091us total) trans 0 rc 0/0 00000100:00100000:3.0:1783441671.028215:0:14798:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.13@tcp, seq: 15 00000100:00100000:3.0:1783441671.028226:0:14798:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.13@tcp, seq: 16 00000100:00100000:3.0:1783441671.028250:0:14798:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a867cd4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:29d872ae-bafc-4783-9a98-d2418cedf182+5:2355:x1870073673406080:12345-192.168.201.13@tcp:400:kworker.0 00000100:00100000:3.0:1783441671.028280:0:14798:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a867cd4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:29d872ae-bafc-4783-9a98-d2418cedf182+5:2355:x1870073673406080:12345-192.168.201.13@tcp:400:kworker.0 Request processed in 31us (1117us total) trans 0 rc 0/0 00000100:00100000:3.0:1783441671.028286:0:14798:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.13@tcp, seq: 16 00000100:00100000:3.0:1783441671.028315:0:14798:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.13@tcp, seq: 17 00000100:00100000:3.0:1783441671.028322:0:14798:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a867cd6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:bba70d1d-69c0-42ad-a2ea-85acf70f57f0+5:2355:x1870073673406336:12345-192.168.201.13@tcp:400:kworker.0 00000100:00100000:3.0:1783441671.028348:0:14798:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a867cd6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:bba70d1d-69c0-42ad-a2ea-85acf70f57f0+5:2355:x1870073673406336:12345-192.168.201.13@tcp:400:kworker.0 Request processed in 26us (1159us total) trans 0 rc 0/0 00000100:00100000:3.0:1783441671.028354:0:14798:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.13@tcp, seq: 17 00000100:00080000:0.0:1783441671.029228:0:14159:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1783441671.029247:0:14159:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1783441671.055547:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.13@tcp (source: 12345-192.168.201.13@tcp) 00000100:00100000:2.0:1783441671.056093:0:14164:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073673406720 00000100:00100000:2.0:1783441671.056107:0:14164:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073673406720 00000100:00100000:2.0:1783441671.056220:0:14164:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.13@tcp, seq: 31 00000100:00100000:2.0:1783441671.056229:0:14164:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a867cd7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:29d872ae-bafc-4783-9a98-d2418cedf182+17:14395:x1870073673406720:12345-192.168.201.13@tcp:101:lfs.0 00010000:00010000:2.0:1783441671.056260:0:14164:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1783441671.056284:0:14164:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91a85f83cc00/0xa2426164df2c8d00 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x633a354aa4df5259 expref: -99 pid: 14164 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783441671.056521:0:14164:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff91a85f83c600/0xa2426164df2c8d07 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 14164 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783441671.056536:0:14164:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91a85f83c600/0xa2426164df2c8d07 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14164 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783441671.056547:0:14164:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91a85f83c600/0xa2426164df2c8d07 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14164 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1783441671.056558:0:14164:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 0 00010000:00010000:2.0:1783441671.056698:0:14164:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91a85f83cc00/0xa2426164df2c8d00 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.13@tcp remote: 0x633a354aa4df5259 expref: 20 pid: 14164 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783441671.056715:0:14164:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff91a85f83c600/0xa2426164df2c8d07 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.13@tcp remote: 0x633a354aa4df5259 expref: 19 pid: 14164 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783441671.056798:0:14164:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff91a858b90500) 00010000:00010000:2.0:1783441671.056802:0:14164:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1783441671.056807:0:14164:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91a85f83c600, rc 0) 00000100:00100000:2.0:1783441671.056882:0:14164:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a867cd7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:29d872ae-bafc-4783-9a98-d2418cedf182+19:14395:x1870073673406720:12345-192.168.201.13@tcp:101:lfs.0 Request processed in 654us (1351us total) trans 8589934604 rc 0/0 00000100:00100000:2.0:1783441671.056889:0:14164:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.13@tcp, seq: 31 00000100:00100000:1.0:1783441671.060169:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.13@tcp (source: 12345-192.168.201.13@tcp) 00000100:00100000:3.0:1783441671.060275:0:15981:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073673406848 00000100:00100000:3.0:1783441671.060289:0:15981:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073673406848 00000100:00100000:3.0:1783441671.060431:0:15981:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.13@tcp, seq: 32 00000100:00100000:3.0:1783441671.060443:0:15981:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a867cd5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:29d872ae-bafc-4783-9a98-d2418cedf182+19:14395:x1870073673406848:12345-192.168.201.13@tcp:54:lfs.0 00010000:00010000:3.0:1783441671.060540:0:15981:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff91a85eb3da00/0xa2426164df2c8d15 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 15981 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783441671.060561:0:15981:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91a85eb3da00/0xa2426164df2c8d15 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 15981 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783441671.060574:0:15981:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91a85eb3da00/0xa2426164df2c8d15 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 15981 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783441671.060611:0:15981:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff91a85eb3da00/0xa2426164df2c8d15 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 15981 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783441671.060618:0:15981:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff91a85eb3da00/0xa2426164df2c8d15 lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 15981 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783441671.060638:0:15981:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff91a85eb3da00/0xa2426164df2c8d15 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 15981 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783441671.060644:0:15981:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91a85eb3da00 already unused, calling callback (ffffffffc1f9b4f0) 00010000:00010000:3.0:1783441671.060650:0:15981:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91a85eb3da00/0xa2426164df2c8d15 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 15981 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783441671.060659:0:15981:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91a85eb3da00/0xa2426164df2c8d15 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 15981 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783441671.060674:0:15981:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff91a858b90500) 00010000:00010000:3.0:1783441671.060678:0:15981:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1783441671.060683:0:15981:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff91a85eb3da00/0xa2426164df2c8d15 lrc: 2/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 15981 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783441671.060690:0:15981:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91a85eb3da00/0xa2426164df2c8d15 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 15981 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783441671.060826:0:15981:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a867cd5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:29d872ae-bafc-4783-9a98-d2418cedf182+19:14395:x1870073673406848:12345-192.168.201.13@tcp:54:lfs.0 Request processed in 383us (670us total) trans 0 rc 0/0 00000100:00100000:3.0:1783441671.060837:0:15981:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.13@tcp, seq: 32 00000100:00100000:0.0:1783441671.063827:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.13@tcp (source: 12345-192.168.201.13@tcp) 00000100:00100000:2.0:1783441671.064324:0:14166:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073673407104 00000100:00100000:2.0:1783441671.064340:0:14166:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073673407104 00000100:00100000:2.0:1783441671.064454:0:14166:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.13@tcp, seq: 7 00000100:00100000:2.0:1783441671.064467:0:14166:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a874dc5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:29d872ae-bafc-4783-9a98-d2418cedf182+19:14395:x1870073673407104:12345-192.168.201.13@tcp:35:lfs.0 00000100:00100000:1.0:1783441671.064499:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.13@tcp (source: 12345-192.168.201.13@tcp) 00000100:00100000:0.0:1783441671.064690:0:14148:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073673407232 00000100:00100000:0.0:1783441671.064695:0:14148:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073673407232 00000100:00100000:0.0:1783441671.064737:0:14148:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.13@tcp, seq: 0 00000100:00100000:0.0:1783441671.064777:0:14148:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a867cd6a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:29d872ae-bafc-4783-9a98-d2418cedf182+21:2353:x1870073673407232:12345-192.168.201.13@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1783441671.064789:0:14148:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:2.0:1783441671.064816:0:14166:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a874dc5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:29d872ae-bafc-4783-9a98-d2418cedf182+21:14395:x1870073673407104:12345-192.168.201.13@tcp:35:lfs.0 Request processed in 352us (1008us total) trans 8589934605 rc 0/0 00010000:00010000:0.0:1783441671.064819:0:14148:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91a85f83c600/0xa2426164df2c8d07 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.13@tcp remote: 0x633a354aa4df5259 expref: 21 pid: 14164 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783441671.064825:0:14166:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.13@tcp, seq: 7 00010000:00010000:0.0:1783441671.064840:0:14148:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff91a858b90500) 00010000:00010000:0.0:1783441671.064845:0:14148:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1783441671.064865:0:14148:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a867cd6a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:29d872ae-bafc-4783-9a98-d2418cedf182+19:2353:x1870073673407232:12345-192.168.201.13@tcp:103:ldlm_bl.0 Request processed in 90us (366us total) trans 0 rc 0/0 00000100:00100000:0.0:1783441671.064873:0:14148:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.13@tcp, seq: 0 00000100:00100000:0.0:1783441671.295675:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.13@tcp (source: 12345-192.168.201.13@tcp) 00000100:00100000:1.0:1783441671.305712:0:14163:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073673407488 00000100:00100000:1.0:1783441671.305732:0:14163:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073673407488 00000100:00100000:1.0:1783441671.305845:0:14163:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.13@tcp, seq: 33 00000100:00100000:1.0:1783441671.305858:0:14163:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a874dc4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:29d872ae-bafc-4783-9a98-d2418cedf182+19:14426:x1870073673407488:12345-192.168.201.13@tcp:101:cat.0 00010000:00010000:1.0:1783441671.305895:0:14163:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1783441671.305922:0:14163:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91a87da46600/0xa2426164df2c8d1c lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x633a354aa4df5260 expref: -99 pid: 14163 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783441671.306056:0:14163:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff91a87da47000/0xa2426164df2c8d23 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 14163 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783441671.306084:0:14163:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91a87da47000/0xa2426164df2c8d23 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14163 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783441671.306099:0:14163:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91a87da47000/0xa2426164df2c8d23 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14163 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1783441671.306112:0:14163:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 0 00010000:00010000:1.0:1783441671.306347:0:14163:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91a87da46600/0xa2426164df2c8d1c lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.13@tcp remote: 0x633a354aa4df5260 expref: 22 pid: 14163 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783441671.306504:0:14163:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff91a87da47000/0xa2426164df2c8d23 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.13@tcp remote: 0x633a354aa4df5260 expref: 21 pid: 14163 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783441671.306515:0:14163:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff91a858b90500) 00010000:00010000:1.0:1783441671.306518:0:14163:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1783441671.306522:0:14163:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91a87da47000, rc 0) 00000100:00100000:1.0:1783441671.306623:0:14163:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a874dc4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:29d872ae-bafc-4783-9a98-d2418cedf182+21:14426:x1870073673407488:12345-192.168.201.13@tcp:101:cat.0 Request processed in 766us (10964us total) trans 8589934606 rc 0/0 00000100:00100000:1.0:1783441671.306650:0:14163:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.13@tcp, seq: 33 00000100:00100000:1.0:1783441671.318397:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.13@tcp (source: 12345-192.168.201.13@tcp) 00000100:00100000:1.0:1783441671.319216:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.13@tcp (source: 12345-192.168.201.13@tcp) 00000100:00100000:3.0:1783441671.319481:0:14149:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073673407616 00000100:00100000:3.0:1783441671.319495:0:14149:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073673407616 00000100:00100000:3.0:1783441671.319576:0:14149:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.13@tcp, seq: 1 00000100:00100000:3.0:1783441671.319588:0:14149:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a867cd5c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:29d872ae-bafc-4783-9a98-d2418cedf182+21:2353:x1870073673407616:12345-192.168.201.13@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1783441671.319606:0:14149:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1783441671.319637:0:14149:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91a87da47000/0xa2426164df2c8d23 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.13@tcp remote: 0x633a354aa4df5260 expref: 21 pid: 14163 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783441671.319687:0:14149:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff91a858b90500) 00010000:00010000:3.0:1783441671.319694:0:14149:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1783441671.319807:0:14149:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a867cd5c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:29d872ae-bafc-4783-9a98-d2418cedf182+20:2353:x1870073673407616:12345-192.168.201.13@tcp:103:ldlm_bl.0 Request processed in 221us (1426us total) trans 0 rc 0/0 00000100:00100000:3.0:1783441671.319815:0:14149:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.13@tcp, seq: 1 00000100:00100000:2.0:1783441671.322127:0:14166:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073673407872 00000100:00100000:2.0:1783441671.322148:0:14166:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073673407872 00000100:00100000:2.0:1783441671.322314:0:14166:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.13@tcp, seq: 8 00000100:00100000:2.0:1783441671.322326:0:14166:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a867cd6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:29d872ae-bafc-4783-9a98-d2418cedf182+20:14426:x1870073673407872:12345-192.168.201.13@tcp:35:cat.0 00000100:00100000:2.0:1783441671.323069:0:14166:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a867cd6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:29d872ae-bafc-4783-9a98-d2418cedf182+21:14426:x1870073673407872:12345-192.168.201.13@tcp:35:cat.0 Request processed in 739us (3850us total) trans 8589934607 rc 0/0 00000100:00100000:2.0:1783441671.323089:0:14166:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.13@tcp, seq: 8 00000100:00100000:1.0:1783441671.384934:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.13@tcp (source: 12345-192.168.201.13@tcp) 00000100:00100000:2.0:1783441671.385108:0:14164:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073673408128 00000100:00100000:2.0:1783441671.385126:0:14164:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073673408128 00000100:00100000:2.0:1783441671.385208:0:14164:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.13@tcp, seq: 34 00000100:00100000:2.0:1783441671.385219:0:14164:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a867cd5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:29d872ae-bafc-4783-9a98-d2418cedf182+21:14432:x1870073673408128:12345-192.168.201.13@tcp:101:dd.0 00010000:00010000:2.0:1783441671.385271:0:14164:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1783441671.385311:0:14164:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91a85f83d600/0xa2426164df2c8d31 lrc: 2/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x633a354aa4df5267 expref: -99 pid: 14164 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783441671.385866:0:14164:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff91a85f83dc00/0xa2426164df2c8d38 lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 14164 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783441671.385886:0:14164:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff91a87da46800/0xa2426164df2c8cd6 lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.13@tcp remote: 0x633a354aa4df5244 expref: 22 pid: 14164 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783441671.385895:0:14164:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff91a85eb3ca00/0xa2426164df2c8ceb lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.13@tcp remote: 0x633a354aa4df524b expref: 22 pid: 15981 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783441671.385903:0:14164:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff91a85f83dc00/0xa2426164df2c8d38 lrc: 5/0,1 mode: --/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14164 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783441671.385945:0:14164:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff91a85eb3ca00/0xa2426164df2c8ceb lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.13@tcp remote: 0x633a354aa4df524b expref: 22 pid: 15981 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783441671.385960:0:14164:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff91a85eb3ca00/0xa2426164df2c8ceb lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.13@tcp remote: 0x633a354aa4df524b expref: 22 pid: 15981 timeout: 609 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783441671.385976:0:14164:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff91a87d793800 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:14164:1870073693320064:192.168.201.13@tcp:104: 00010000:00010000:2.0:1783441671.386153:0:14164:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff91a87da46800/0xa2426164df2c8cd6 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.13@tcp remote: 0x633a354aa4df5244 expref: 22 pid: 14164 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783441671.386163:0:14164:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff91a87da46800/0xa2426164df2c8cd6 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.13@tcp remote: 0x633a354aa4df5244 expref: 22 pid: 14164 timeout: 609 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783441671.386186:0:14164:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff91a87d791880 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:14164:1870073693320192:192.168.201.13@tcp:104: 00000100:00100000:2.0:1783441671.386211:0:14164:0:(client.c:2702:ptlrpc_set_wait()) set ffff91a8654e1900 going to sleep for 11 seconds 00000100:00100000:1.0:1783441671.390950:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.13@tcp (source: 12345-192.168.201.13@tcp) 00000100:00100000:2.0:1783441671.391978:0:14164:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff91a87d793800 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:14164:1870073693320064:192.168.201.13@tcp:104: 00000100:00100000:2.0:1783441671.392007:0:14164:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff91a87d791880 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:14164:1870073693320192:192.168.201.13@tcp:104: 00010000:00010000:2.0:1783441671.392054:0:14164:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff91a85f83dc00/0xa2426164df2c8d38 lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14164 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783441671.392943:0:14150:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073673408256 00000100:00100000:0.0:1783441671.392957:0:14150:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073673408256 00010000:00010000:0.0:1783441671.393022:0:14150:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff91a85eb3ca00/0xa2426164df2c8ceb lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.13@tcp remote: 0x633a354aa4df524b expref: 23 pid: 15981 timeout: 609 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783441671.393137:0:14150:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.13@tcp, seq: 11 00000100:00100000:0.0:1783441671.393149:0:14150:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a7448fcc50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:29d872ae-bafc-4783-9a98-d2418cedf182+23:2354:x1870073673408256:12345-192.168.201.13@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1783441671.393170:0:14150:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1783441671.393179:0:14150:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff91a85eb3ca00/0xa2426164df2c8ceb lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.13@tcp remote: 0x633a354aa4df524b expref: 23 pid: 15981 timeout: 609 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783441671.393220:0:14150:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff91a85eb3ca00/0xa2426164df2c8ceb lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.13@tcp remote: 0x633a354aa4df524b expref: 23 pid: 15981 timeout: 609 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783441671.393262:0:14150:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91a85eb3ca00/0xa2426164df2c8ceb lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.13@tcp remote: 0x633a354aa4df524b expref: 23 pid: 15981 timeout: 609 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783441671.393285:0:14150:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff91a858b90500) 00010000:00010000:0.0:1783441671.393291:0:14150:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff91a85f83dc00/0xa2426164df2c8d38 lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14164 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783441671.393301:0:14150:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 2 ns: mdt-lustre-MDT0000_UUID lock: ffff91a85f83dc00/0xa2426164df2c8d38 lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14164 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783441671.393308:0:14150:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1783441671.393404:0:14150:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a7448fcc50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:29d872ae-bafc-4783-9a98-d2418cedf182+22:2354:x1870073673408256:12345-192.168.201.13@tcp:103:ldlm_bl.0 Request processed in 256us (2470us total) trans 0 rc 0/0 00000100:00100000:0.0:1783441671.393414:0:14150:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.13@tcp, seq: 11 00000100:00100000:0.0:1783441671.397314:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.13@tcp (source: 12345-192.168.201.13@tcp) 00000100:00100000:3.0:1783441671.397485:0:14148:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073673408384 00000100:00100000:3.0:1783441671.397500:0:14148:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073673408384 00010000:00010000:3.0:1783441671.397551:0:14148:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff91a87da46800/0xa2426164df2c8cd6 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.13@tcp remote: 0x633a354aa4df5244 expref: 22 pid: 14164 timeout: 609 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783441671.397601:0:14148:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.13@tcp, seq: 12 00000100:00100000:3.0:1783441671.397614:0:14148:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a874dc6680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:29d872ae-bafc-4783-9a98-d2418cedf182+22:2355:x1870073673408384:12345-192.168.201.13@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1783441671.397638:0:14148:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1783441671.397647:0:14148:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff91a87da46800/0xa2426164df2c8cd6 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.13@tcp remote: 0x633a354aa4df5244 expref: 22 pid: 14164 timeout: 609 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783441671.397663:0:14148:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff91a87da46800/0xa2426164df2c8cd6 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.13@tcp remote: 0x633a354aa4df5244 expref: 22 pid: 14164 timeout: 609 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783441671.397690:0:14148:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91a87da46800/0xa2426164df2c8cd6 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.13@tcp remote: 0x633a354aa4df5244 expref: 22 pid: 14164 timeout: 609 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783441671.397710:0:14148:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff91a858b90500) 00010000:00010000:3.0:1783441671.397717:0:14148:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff91a85f83dc00/0xa2426164df2c8d38 lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14164 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783441671.397923:0:14148:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff91a85f83dc00/0xa2426164df2c8d38 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 14164 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783441671.397931:0:14148:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91a85f83dc00/0xa2426164df2c8d38 lrc: 4/0,1 mode: CW/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 14164 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783441671.398162:0:14164:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff91a85f83dc00/0xa2426164df2c8d38 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14164 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783441671.398163:0:14148:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1783441671.398171:0:14164:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91a85f83dc00/0xa2426164df2c8d38 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14164 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1783441671.398193:0:14164:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 0 00010000:00010000:2.0:1783441671.398699:0:14164:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91a85f83d600/0xa2426164df2c8d31 lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.13@tcp remote: 0x633a354aa4df5267 expref: 23 pid: 14164 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783441671.398718:0:14164:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff91a85f83dc00/0xa2426164df2c8d38 lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.13@tcp remote: 0x633a354aa4df5267 expref: 22 pid: 14164 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783441671.398727:0:14164:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff91a858b90500) 00010000:00010000:2.0:1783441671.398730:0:14164:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:2.0:1783441671.398732:0:14164:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91a85f83dc00, rc 0) 00000100:00100000:2.0:1783441671.398792:0:14164:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a867cd5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:29d872ae-bafc-4783-9a98-d2418cedf182+22:14432:x1870073673408128:12345-192.168.201.13@tcp:101:dd.0 Request processed in 13575us (13872us total) trans 8589934608 rc 0/0 00000100:00100000:2.0:1783441671.398802:0:14164:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.13@tcp, seq: 34 00000100:00100000:3.0:1783441671.399056:0:14148:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a874dc6680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:29d872ae-bafc-4783-9a98-d2418cedf182+21:2355:x1870073673408384:12345-192.168.201.13@tcp:103:ldlm_bl.0 Request processed in 620us (932us total) trans 0 rc 0/0 00000100:00100000:3.0:1783441671.399070:0:14148:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.13@tcp, seq: 12 00000100:00100000:1.0:1783441671.402945:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.13@tcp (source: 12345-192.168.201.13@tcp) 00000100:00100000:2.0:1783441671.403031:0:14821:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073673408640 00000100:00100000:2.0:1783441671.403045:0:14821:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073673408640 00000100:00100000:2.0:1783441671.403120:0:14821:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.13@tcp, seq: 35 00000100:00100000:2.0:1783441671.403130:0:14821:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a867cd7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:29d872ae-bafc-4783-9a98-d2418cedf182+21:14432:x1870073673408640:12345-192.168.201.13@tcp:36:dd.0 00010000:00010000:2.0:1783441671.403589:0:14821:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff91a85f83da00/0xa2426164df2c8d46 lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783441671.403609:0:14821:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91a85f83da00/0xa2426164df2c8d46 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783441671.403622:0:14821:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91a85f83da00/0xa2426164df2c8d46 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14821 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1783441671.403683:0:14821:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8589934609 00000004:00010000:2.0:1783441671.403728:0:14821:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 000000006ef18779 reply state 0000000087f26360 transno 8589934610 ns: mdt-lustre-MDT0000_UUID lock: ffff91a85f83da00/0xa2426164df2c8d46 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14821 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783441671.403738:0:14821:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1783441671.403886:0:14821:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a867cd7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:29d872ae-bafc-4783-9a98-d2418cedf182+24:14432:x1870073673408640:12345-192.168.201.13@tcp:36:dd.0 Request processed in 754us (950us total) trans 8589934610 rc 0/0 00000100:00100000:2.0:1783441671.403895:0:14821:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.13@tcp, seq: 35 00000020:00080000:2.0:1783441671.403903:0:14821:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:2.0:1783441671.408911:0:3289:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff91a85f83da00/0xa2426164df2c8d46 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783441671.408933:0:3289:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff91a85f83da00/0xa2426164df2c8d46 lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 14821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783441671.408941:0:3289:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff91a85f83da00/0xa2426164df2c8d46 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 14821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783441671.408949:0:3289:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91a85f83da00 already unused, calling callback (ffffffffc1f9b4f0) 00010000:00010000:2.0:1783441671.408977:0:3289:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91a85f83da00/0xa2426164df2c8d46 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 14821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783441671.408986:0:3289:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91a85f83da00/0xa2426164df2c8d46 lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 14821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783441671.409009:0:3289:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff91a858b90500) 00010000:00010000:2.0:1783441671.409013:0:3289:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1783441671.409019:0:3289:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff91a85f83da00/0xa2426164df2c8d46 lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 14821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783441671.409025:0:3289:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91a85f83da00/0xa2426164df2c8d46 lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 14821 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783441671.409873:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.13@tcp (source: 12345-192.168.201.13@tcp) 00000100:00100000:3.0:1783441671.410338:0:14162:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073673408768 00000100:00100000:3.0:1783441671.410352:0:14162:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073673408768 00000100:00100000:0.0:1783441671.411021:0:15981:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.13@tcp, seq: 36 00000100:00100000:0.0:1783441671.411047:0:15981:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a867cd6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:29d872ae-bafc-4783-9a98-d2418cedf182+23:14432:x1870073673408768:12345-192.168.201.13@tcp:101:dd.0 00010000:00010000:0.0:1783441671.411086:0:15981:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1783441671.411115:0:15981:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91a85fe58c00/0xa2426164df2c8d4d lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x633a354aa4df526e expref: -99 pid: 15981 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783441671.411199:0:15981:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91a85fe58c00/0xa2426164df2c8d4d lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.201.13@tcp remote: 0x633a354aa4df526e expref: 24 pid: 15981 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783441671.411242:0:15981:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff91a85fe58c00/0xa2426164df2c8d4d lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.13@tcp remote: 0x633a354aa4df526e expref: 24 pid: 15981 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783441671.411267:0:15981:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff91a858b90500) 00010000:00010000:0.0:1783441671.411271:0:15981:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1783441671.411275:0:15981:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91a85fe58c00, rc 0) 00000100:00100000:0.0:1783441671.411370:0:15981:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a867cd6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:29d872ae-bafc-4783-9a98-d2418cedf182+24:14432:x1870073673408768:12345-192.168.201.13@tcp:101:dd.0 Request processed in 323us (1497us total) trans 0 rc 0/0 00000100:00100000:0.0:1783441671.411379:0:15981:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.13@tcp, seq: 36 00000100:00100000:1.0:1783441671.427735:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.13@tcp (source: 12345-192.168.201.13@tcp) 00000100:00100000:0.0:1783441671.427904:0:14150:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073673409024 00000100:00100000:0.0:1783441671.427916:0:14150:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073673409024 00000100:00100000:0.0:1783441671.427993:0:14150:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.13@tcp, seq: 2 00000100:00100000:0.0:1783441671.428003:0:14150:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a867cd6a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:29d872ae-bafc-4783-9a98-d2418cedf182+24:14432:x1870073673409024:12345-192.168.201.13@tcp:103:dd.0 00010000:00010000:0.0:1783441671.428022:0:14150:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1783441671.428054:0:14150:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91a85fe58c00/0xa2426164df2c8d4d lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.13@tcp remote: 0x633a354aa4df526e expref: 24 pid: 15981 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783441671.428074:0:14150:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff91a858b90500) 00010000:00010000:0.0:1783441671.428079:0:14150:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1783441671.428139:0:14150:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a867cd6a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:29d872ae-bafc-4783-9a98-d2418cedf182+23:14432:x1870073673409024:12345-192.168.201.13@tcp:103:dd.0 Request processed in 138us (424us total) trans 0 rc 0/0 00000100:00100000:0.0:1783441671.428146:0:14150:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.13@tcp, seq: 2 00000100:00100000:2.0:1783441671.431033:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.13@tcp (source: 12345-192.168.201.13@tcp) 00000100:00100000:1.0:1783441671.431122:0:14164:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073673409152 00000100:00100000:1.0:1783441671.431134:0:14164:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073673409152 00000100:00100000:1.0:1783441671.431208:0:14164:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.13@tcp, seq: 37 00000100:00100000:1.0:1783441671.431219:0:14164:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a87d791880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:29d872ae-bafc-4783-9a98-d2418cedf182+23:14432:x1870073673409152:12345-192.168.201.13@tcp:58:dd.0 00010000:00010000:1.0:1783441671.431690:0:14164:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff91a87da47e00/0xa2426164df2c8d54 lrc: 3/0,1 mode: --/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14164 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783441671.431714:0:14164:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91a87da47e00/0xa2426164df2c8d54 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14164 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783441671.431729:0:14164:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91a87da47e00/0xa2426164df2c8d54 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14164 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:1.0:1783441671.433521:0:14164:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1783441671.434105:0:14164:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].2, 64 off8320 00000040:00080000:1.0:1783441671.434203:0:14164:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xe:0x0].1, 136 off8328 00000100:00100000:1.0:1783441671.434718:0:14164:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a87d791880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:29d872ae-bafc-4783-9a98-d2418cedf182+23:14432:x1870073673409152:12345-192.168.201.13@tcp:58:dd.0 Request processed in 3491us (3691us total) trans 0 rc 0/0 00000100:00100000:1.0:1783441671.434732:0:14164:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.13@tcp, seq: 37 00000100:00100000:1.0:1783441671.439899:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.13@tcp (source: 12345-192.168.201.13@tcp) 00000100:00100000:2.0:1783441671.441090:0:14821:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073673409280 00000100:00100000:2.0:1783441671.441105:0:14821:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073673409280 00000100:00100000:2.0:1783441671.441180:0:14821:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.13@tcp, seq: 38 00000100:00100000:2.0:1783441671.441189:0:14821:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a867cd5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:29d872ae-bafc-4783-9a98-d2418cedf182+23:14432:x1870073673409280:12345-192.168.201.13@tcp:101:dd.0 00010000:00010000:2.0:1783441671.441212:0:14821:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1783441671.441236:0:14821:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91a85f83d800/0xa2426164df2c8d5b lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x633a354aa4df5275 expref: -99 pid: 14821 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783441671.441371:0:14821:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff91a87da47e00/0xa2426164df2c8d54 lrc: 2/0,1 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14164 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783441671.441385:0:14821:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff91a85f83d800/0xa2426164df2c8d5b lrc: 4/0,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.201.13@tcp remote: 0x633a354aa4df5275 expref: 24 pid: 14821 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783441671.441410:0:14821:0:(ldlm_request.c:385:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: mdt-lustre-MDT0000_UUID lock: ffff91a87da47e00/0xa2426164df2c8d54 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000020 pid: 14164 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783441671.441440:0:14821:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff91a85f83d800/0xa2426164df2c8d5b lrc: 3/0,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.13@tcp remote: 0x633a354aa4df5275 expref: 24 pid: 14821 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783441671.441467:0:14821:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff91a858b90500) 00010000:00010000:2.0:1783441671.441471:0:14821:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1783441671.441475:0:14821:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff91a85f83d800/0xa2426164df2c8d5b lrc: 3/0,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.13@tcp remote: 0x633a354aa4df5275 expref: 24 pid: 14821 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783441671.441483:0:14821:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91a85f83d800, rc 0) 00000100:00100000:2.0:1783441671.441630:0:14821:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a867cd5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:29d872ae-bafc-4783-9a98-d2418cedf182+24:14432:x1870073673409280:12345-192.168.201.13@tcp:101:dd.0 Request processed in 441us (1747us total) trans 0 rc 0/0 00000100:00100000:2.0:1783441671.441639:0:14821:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.13@tcp, seq: 38 00000040:00080000:2.0:1783441671.533870:0:14197:0:(llog.c:805:llog_process_thread()) index: 2, lh_last_idx: 2 synced_idx: 2 lgh_last_idx: 2 00000040:00080000:2.0:1783441671.533881:0:14197:0:(llog_cat.c:841:llog_cat_process_common()) processing log [0x1:0xe:0x0] at index 2 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1783441671.533915:0:14197:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0xe:0x0] index 2 count 2 00000040:00080000:2.0:1783441671.533920:0:14197:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 3 count 2 00000100:00100000:2.0:1783441671.534082:0:14197:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff91a87d793800 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:14197:1870073693320320:192.168.201.13@tcp:107:hsm_cdtr.0 00000100:00100000:2.0:1783441671.534309:0:14197:0:(client.c:2702:ptlrpc_set_wait()) set ffff91a8654e1d80 going to sleep for 11 seconds 00000100:00100000:2.0:1783441671.543335:0:14197:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff91a87d793800 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:14197:1870073693320320:192.168.201.13@tcp:107:hsm_cdtr.0 00000100:00100000:0.0:1783441671.545940:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.13@tcp (source: 12345-192.168.201.13@tcp) 00000100:00100000:3.0:1783441671.546219:0:14173:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073673409408 00000100:00100000:3.0:1783441671.546233:0:14173:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073673409408 00000100:00100000:3.0:1783441671.546310:0:14173:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.13@tcp, seq: 0 00000100:00100000:3.0:1783441671.546321:0:14173:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a874dc7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:29d872ae-bafc-4783-9a98-d2418cedf182+24:14434:x1870073673409408:12345-192.168.201.13@tcp:900:lhsmtool_posix.0 00000100:00100000:3.0:1783441671.546446:0:14173:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a874dc7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:29d872ae-bafc-4783-9a98-d2418cedf182+24:14434:x1870073673409408:12345-192.168.201.13@tcp:900:lhsmtool_posix.0 Request processed in 127us (520us total) trans 0 rc 0/0 00000100:00100000:3.0:1783441671.546456:0:14173:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.13@tcp, seq: 0 00000100:00100000:1.0:1783441671.549871:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.13@tcp (source: 12345-192.168.201.13@tcp) 00000100:00100000:0.0:1783441671.549977:0:15981:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073673409536 00000100:00100000:0.0:1783441671.549990:0:15981:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073673409536 00000100:00100000:0.0:1783441671.550084:0:15981:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.13@tcp, seq: 39 00000100:00100000:0.0:1783441671.550095:0:15981:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a745552680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:29d872ae-bafc-4783-9a98-d2418cedf182+24:14434:x1870073673409536:12345-192.168.201.13@tcp:53:lhsmtool_posix.0 00000004:00000080:0.0:1783441671.550136:0:15981:0:(mdt_handler.c:7960:mdt_fid2path()) path get [0x200000bd1:0x2:0x0] from 18446744073709551615 #0 00000100:00100000:0.0:1783441671.550279:0:15981:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a745552680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:29d872ae-bafc-4783-9a98-d2418cedf182+24:14434:x1870073673409536:12345-192.168.201.13@tcp:53:lhsmtool_posix.0 Request processed in 185us (422us total) trans 0 rc 0/0 00000100:00100000:0.0:1783441671.550296:0:15981:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.13@tcp, seq: 39 00000100:00100000:1.0:1783441671.555199:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.13@tcp (source: 12345-192.168.201.13@tcp) 00000100:00100000:2.0:1783441671.555873:0:14164:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073673409664 00000100:00100000:2.0:1783441671.555887:0:14164:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073673409664 00000100:00100000:2.0:1783441671.556031:0:14164:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.13@tcp, seq: 40 00000100:00100000:2.0:1783441671.556044:0:14164:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a745550700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:29d872ae-bafc-4783-9a98-d2418cedf182+24:14434:x1870073673409664:12345-192.168.201.13@tcp:34:lhsmtool_posix.0 00010000:00010000:2.0:1783441671.556143:0:14164:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff91a85f83d200/0xa2426164df2c8d62 lrc: 3/1,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14164 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783441671.556189:0:14164:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91a85f83d200/0xa2426164df2c8d62 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14164 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783441671.556204:0:14164:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91a85f83d200/0xa2426164df2c8d62 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14164 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783441671.556350:0:14164:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff91a85f83c400/0xa2426164df2c8d69 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14164 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783441671.556386:0:14164:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91a85f83c400/0xa2426164df2c8d69 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14164 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783441671.556401:0:14164:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91a85f83c400/0xa2426164df2c8d69 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14164 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783441671.556437:0:14164:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff91a85f83da00/0xa2426164df2c8d70 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 14164 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783441671.556446:0:14164:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91a85f83da00/0xa2426164df2c8d70 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14164 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783441671.556453:0:14164:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91a85f83da00/0xa2426164df2c8d70 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14164 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1783441671.556508:0:14164:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 0 00000004:00200000:2.0:1783441671.556513:0:14164:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1783441671.556527:0:14164:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff91a85f83da00/0xa2426164df2c8d70 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14164 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783441671.556547:0:14164:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff91a85f83d200/0xa2426164df2c8d62 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14164 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783441671.556572:0:14164:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff91a85f83d200/0xa2426164df2c8d62 lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 14164 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783441671.556579:0:14164:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff91a85f83d200/0xa2426164df2c8d62 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 14164 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783441671.556585:0:14164:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91a85f83d200 already unused, calling callback (ffffffffc1f9b4f0) 00010000:00010000:2.0:1783441671.556590:0:14164:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91a85f83d200/0xa2426164df2c8d62 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 14164 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783441671.556598:0:14164:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91a85f83d200/0xa2426164df2c8d62 lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 14164 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783441671.556612:0:14164:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff91a8429bd300) 00010000:00010000:2.0:1783441671.556615:0:14164:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1783441671.556620:0:14164:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff91a85f83d200/0xa2426164df2c8d62 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 14164 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783441671.556626:0:14164:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91a85f83d200/0xa2426164df2c8d62 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 14164 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783441671.556644:0:14164:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff91a85f83c400/0xa2426164df2c8d69 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14164 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783441671.556651:0:14164:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff91a85f83c400/0xa2426164df2c8d69 lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14164 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783441671.556657:0:14164:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff91a85f83c400/0xa2426164df2c8d69 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14164 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783441671.556663:0:14164:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91a85f83c400 already unused, calling callback (ffffffffc1f9b4f0) 00010000:00010000:2.0:1783441671.556673:0:14164:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91a85f83c400/0xa2426164df2c8d69 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14164 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783441671.556679:0:14164:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91a85f83c400/0xa2426164df2c8d69 lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14164 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783441671.556688:0:14164:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x4549062c (ffff91a8429bd100) 00010000:00010000:2.0:1783441671.556691:0:14164:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1783441671.556695:0:14164:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff91a85f83c400/0xa2426164df2c8d69 lrc: 2/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14164 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783441671.556700:0:14164:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91a85f83c400/0xa2426164df2c8d69 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14164 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783441671.556718:0:14164:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff91a85f83da00/0xa2426164df2c8d70 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14164 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783441671.556725:0:14164:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff91a85f83da00/0xa2426164df2c8d70 lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 14164 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783441671.556732:0:14164:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff91a85f83da00/0xa2426164df2c8d70 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14164 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783441671.556738:0:14164:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91a85f83da00 already unused, calling callback (ffffffffc1f9b4f0) 00010000:00010000:2.0:1783441671.556806:0:14164:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91a85f83da00/0xa2426164df2c8d70 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14164 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783441671.556812:0:14164:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91a85f83da00/0xa2426164df2c8d70 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 14164 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783441671.556820:0:14164:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff91a858b90500) 00010000:00010000:2.0:1783441671.556823:0:14164:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1783441671.556832:0:14164:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff91a85f83da00/0xa2426164df2c8d70 lrc: 2/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14164 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783441671.556838:0:14164:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91a85f83da00/0xa2426164df2c8d70 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14164 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783441671.556936:0:14164:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a745550700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:29d872ae-bafc-4783-9a98-d2418cedf182+24:14434:x1870073673409664:12345-192.168.201.13@tcp:34:lhsmtool_posix.0 Request processed in 890us (1750us total) trans 0 rc 0/0 00000100:00100000:2.0:1783441671.556947:0:14164:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.13@tcp, seq: 40 00000100:00100000:2.0:1783441671.560228:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.13@tcp (source: 12345-192.168.201.13@tcp) 00000100:00100000:3.0:1783441671.560551:0:14821:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073673409920 00000100:00100000:3.0:1783441671.560637:0:14821:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073673409920 00000100:00100000:3.0:1783441671.560844:0:14821:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.13@tcp, seq: 41 00000100:00100000:3.0:1783441671.560858:0:14821:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a87d793800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:29d872ae-bafc-4783-9a98-d2418cedf182+24:14434:x1870073673409920:12345-192.168.201.13@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1783441671.560887:0:14821:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1783441671.560912:0:14821:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91a85eb3da00/0xa2426164df2c8d77 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x633a354aa4df527c expref: -99 pid: 14821 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783441671.561086:0:14821:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff91a85eb3d600/0xa2426164df2c8d7e lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 14821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783441671.561103:0:14821:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91a85eb3d600/0xa2426164df2c8d7e lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783441671.561118:0:14821:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91a85eb3d600/0xa2426164df2c8d7e lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14821 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1783441671.561131:0:14821:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 0 00010000:00010000:3.0:1783441671.561255:0:14821:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff91a85eb3d600/0xa2426164df2c8d7e lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783441671.561265:0:14821:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff91a85eb3d600/0xa2426164df2c8d7e lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 14821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783441671.561272:0:14821:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff91a85eb3d600/0xa2426164df2c8d7e lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783441671.561295:0:14821:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91a85eb3d600 already unused, calling callback (ffffffffc1f9b4f0) 00010000:00010000:3.0:1783441671.561300:0:14821:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91a85eb3d600/0xa2426164df2c8d7e lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783441671.561309:0:14821:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91a85eb3d600/0xa2426164df2c8d7e lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 14821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783441671.561325:0:14821:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff91a858b90500) 00010000:00010000:3.0:1783441671.561329:0:14821:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:3.0:1783441671.561333:0:14821:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff91a85eb3d600/0xa2426164df2c8d7e lrc: 2/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783441671.561351:0:14821:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91a85eb3d600/0xa2426164df2c8d7e lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783441671.561424:0:14821:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff91a85eb3da00/0xa2426164df2c8d77 lrc: 1/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.13@tcp remote: 0x633a354aa4df527c expref: 26 pid: 14821 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783441671.561446:0:14821:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff91a8429bd300) 00010000:00010000:3.0:1783441671.561448:0:14821:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1783441671.561453:0:14821:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91a85eb3da00/0xa2426164df2c8d77 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.13@tcp remote: 0x633a354aa4df527c expref: 26 pid: 14821 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783441671.561463:0:14821:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91a85eb3da00, rc 0) 00000100:00100000:3.0:1783441671.561555:0:14821:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a87d793800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:29d872ae-bafc-4783-9a98-d2418cedf182+25:14434:x1870073673409920:12345-192.168.201.13@tcp:101:lhsmtool_posix.0 Request processed in 693us (1332us total) trans 8589934611 rc 301/301 00000100:00100000:3.0:1783441671.561563:0:14821:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.13@tcp, seq: 41 00000100:00100000:1.0:1783441671.566120:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.13@tcp (source: 12345-192.168.201.13@tcp) 00000100:00100000:0.0:1783441671.566238:0:14163:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073673410048 00000100:00100000:0.0:1783441671.566251:0:14163:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073673410048 00000100:00100000:0.0:1783441671.566901:0:14163:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.13@tcp, seq: 42 00000100:00100000:0.0:1783441671.566917:0:14163:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a745552300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:29d872ae-bafc-4783-9a98-d2418cedf182+25:14434:x1870073673410048:12345-192.168.201.13@tcp:53:lhsmtool_posix.0 00000004:00000080:0.0:1783441671.566988:0:14163:0:(mdt_handler.c:7960:mdt_fid2path()) path get [0x200000bd1:0x2:0x0] from 18446744073709551615 #0 00000100:00100000:0.0:1783441671.567177:0:14163:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a745552300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:29d872ae-bafc-4783-9a98-d2418cedf182+25:14434:x1870073673410048:12345-192.168.201.13@tcp:53:lhsmtool_posix.0 Request processed in 264us (1070us total) trans 0 rc 0/0 00000100:00100000:0.0:1783441671.567185:0:14163:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.13@tcp, seq: 42 00000100:00100000:1.0:1783441671.573020:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.13@tcp (source: 12345-192.168.201.13@tcp) 00000100:00100000:2.0:1783441671.573162:0:14164:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073673410304 00000100:00100000:2.0:1783441671.573175:0:14164:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073673410304 00000100:00100000:2.0:1783441671.573305:0:14164:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.13@tcp, seq: 43 00000100:00100000:2.0:1783441671.573318:0:14164:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a745553100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:29d872ae-bafc-4783-9a98-d2418cedf182+25:14434:x1870073673410304:12345-192.168.201.13@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1783441671.573346:0:14164:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1783441671.573389:0:14164:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91a85f83c400/0xa2426164df2c8d8c lrc: 2/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x633a354aa4df5283 expref: -99 pid: 14164 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:2.0:1783441671.575045:0:14164:0:(osp_internal.h:570:osp_update_last_fid()) Gap in objids: start=[0x280000400:0x6:0x0], count =28 00000004:00080000:2.0:1783441671.575059:0:14164:0:(osp_object.c:1645:osp_create()) Writing gap [0x280000400:0x6:0x0]+28 in llog 00000004:00080000:2.0:1783441671.575122:0:14164:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x22:0x0], index 1: 0 00010000:00010000:2.0:1783441671.575959:0:14164:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff91a85f83da00/0xa2426164df2c8d93 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14164 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783441671.575980:0:14164:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91a85f83da00/0xa2426164df2c8d93 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14164 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783441671.575996:0:14164:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91a85f83da00/0xa2426164df2c8d93 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14164 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783441671.576085:0:14164:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91a85f83c400/0xa2426164df2c8d8c lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.13@tcp remote: 0x633a354aa4df5283 expref: 28 pid: 14164 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783441671.576118:0:14164:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff91a85f83da00/0xa2426164df2c8d93 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.13@tcp remote: 0x633a354aa4df5283 expref: 27 pid: 14164 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783441671.576127:0:14164:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff91a8429bd100) 00010000:00010000:2.0:1783441671.576131:0:14164:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1783441671.576135:0:14164:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91a85f83da00, rc 0) 00000100:00100000:2.0:1783441671.576340:0:14164:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a745553100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:29d872ae-bafc-4783-9a98-d2418cedf182+27:14434:x1870073673410304:12345-192.168.201.13@tcp:101:lhsmtool_posix.0 Request processed in 3024us (3334us total) trans 8589934612 rc 0/0 00000100:00100000:2.0:1783441671.576351:0:14164:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.13@tcp, seq: 43 00000100:00100000:2.0:1783441671.580864:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.13@tcp (source: 12345-192.168.201.13@tcp) 00000100:00100000:3.0:1783441671.581015:0:14821:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073673410560 00000100:00100000:3.0:1783441671.581028:0:14821:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073673410560 00000100:00100000:3.0:1783441671.581135:0:14821:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.13@tcp, seq: 44 00000100:00100000:3.0:1783441671.581151:0:14821:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a87d792680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:29d872ae-bafc-4783-9a98-d2418cedf182+27:14434:x1870073673410560:12345-192.168.201.13@tcp:36:lhsmtool_posix.0 00010000:00010000:3.0:1783441671.581237:0:14821:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1783441671.581272:0:14821:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91a85f83da00/0xa2426164df2c8d93 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.13@tcp remote: 0x633a354aa4df5283 expref: 27 pid: 14164 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783441671.581311:0:14821:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff91a8429bd100) 00010000:00010000:3.0:1783441671.581326:0:14821:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1783441671.581365:0:14821:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff91a85eb3da00/0xa2426164df2c8da1 lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783441671.581407:0:14821:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91a85eb3da00/0xa2426164df2c8da1 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783441671.581417:0:14821:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91a85eb3da00/0xa2426164df2c8da1 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783441671.581596:0:14821:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff91a85eb3d600/0xa2426164df2c8da8 lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x1:0x0].0xa78ea48c bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783441671.581622:0:14821:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91a85eb3d600/0xa2426164df2c8da8 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xa78ea48c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783441671.581635:0:14821:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91a85eb3d600/0xa2426164df2c8da8 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xa78ea48c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783441671.581727:0:14821:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff91a85eb3da00/0xa2426164df2c8da1 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783441671.581734:0:14821:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff91a85eb3da00/0xa2426164df2c8da1 lrc: 2/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 14821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783441671.581994:0:14821:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff91a85eb3da00/0xa2426164df2c8da1 lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 14821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783441671.582004:0:14821:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91a85eb3da00 already unused, calling callback (ffffffffc1f9b4f0) 00010000:00010000:3.0:1783441671.582009:0:14821:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91a85eb3da00/0xa2426164df2c8da1 lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 14821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783441671.582017:0:14821:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91a85eb3da00/0xa2426164df2c8da1 lrc: 4/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 14821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783441671.582031:0:14821:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff91a84b76fc00) 00010000:00010000:3.0:1783441671.582047:0:14821:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1783441671.582053:0:14821:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff91a85eb3da00/0xa2426164df2c8da1 lrc: 2/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 14821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783441671.582060:0:14821:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91a85eb3da00/0xa2426164df2c8da1 lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 14821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783441671.582074:0:14821:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff91a85eb3d600/0xa2426164df2c8da8 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xa78ea48c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783441671.582079:0:14821:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff91a85eb3d600/0xa2426164df2c8da8 lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xa78ea48c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783441671.582085:0:14821:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff91a85eb3d600/0xa2426164df2c8da8 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xa78ea48c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783441671.582090:0:14821:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91a85eb3d600 already unused, calling callback (ffffffffc1f9b4f0) 00010000:00010000:3.0:1783441671.582095:0:14821:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91a85eb3d600/0xa2426164df2c8da8 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xa78ea48c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783441671.582101:0:14821:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91a85eb3d600/0xa2426164df2c8da8 lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xa78ea48c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783441671.582110:0:14821:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0xa78ea48c (ffff91a84b76f400) 00010000:00010000:3.0:1783441671.582115:0:14821:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1783441671.582120:0:14821:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff91a85eb3d600/0xa2426164df2c8da8 lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0x1:0x0].0xa78ea48c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783441671.582126:0:14821:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91a85eb3d600/0xa2426164df2c8da8 lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x1:0x0].0xa78ea48c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14821 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783441671.582244:0:14821:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a87d792680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:29d872ae-bafc-4783-9a98-d2418cedf182+26:14434:x1870073673410560:12345-192.168.201.13@tcp:36:lhsmtool_posix.0 Request processed in 1092us (1391us total) trans 0 rc -2/-2 00000100:00100000:3.0:1783441671.582259:0:14821:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.13@tcp, seq: 44 00000100:00100000:1.0:1783441671.598126:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.13@tcp (source: 12345-192.168.201.13@tcp) 00000100:00100000:0.0:1783441671.598634:0:14163:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073673410688 00000100:00100000:0.0:1783441671.598649:0:14163:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073673410688 00000100:00100000:0.0:1783441671.600872:0:14163:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.13@tcp, seq: 45 00000100:00100000:0.0:1783441671.600901:0:14163:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a745550e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:29d872ae-bafc-4783-9a98-d2418cedf182+26:14434:x1870073673410688:12345-192.168.201.13@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1783441671.600930:0:14163:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1783441671.600962:0:14163:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91a85fe59400/0xa2426164df2c8daf lrc: 2/0,0 mode: --/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x633a354aa4df528a expref: -99 pid: 14163 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783441671.601011:0:14163:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff91a85fe58c00/0xa2426164df2c8db6 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14163 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783441671.601027:0:14163:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91a85fe58c00/0xa2426164df2c8db6 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14163 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783441671.601062:0:14163:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91a85fe58c00/0xa2426164df2c8db6 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14163 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783441671.601190:0:14163:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91a85fe59400/0xa2426164df2c8daf lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.13@tcp remote: 0x633a354aa4df528a expref: 28 pid: 14163 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783441671.601212:0:14163:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff91a85fe58c00/0xa2426164df2c8db6 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.13@tcp remote: 0x633a354aa4df528a expref: 27 pid: 14163 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783441671.601222:0:14163:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff91a8439b0900) 00010000:00010000:0.0:1783441671.601225:0:14163:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:0.0:1783441671.601230:0:14163:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91a85fe58c00, rc 0) 00000100:00100000:0.0:1783441671.601615:0:14163:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a745550e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:29d872ae-bafc-4783-9a98-d2418cedf182+27:14434:x1870073673410688:12345-192.168.201.13@tcp:101:lhsmtool_posix.0 Request processed in 660us (3435us total) trans 0 rc 0/0 00000100:00100000:0.0:1783441671.601624:0:14163:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.13@tcp, seq: 45 00000100:00100000:1.0:1783441671.607175:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.13@tcp (source: 12345-192.168.201.13@tcp) 00000100:00100000:2.0:1783441671.607531:0:14164:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073673410944 00000100:00100000:2.0:1783441671.607613:0:14164:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073673410944 00000100:00100000:2.0:1783441671.607806:0:14164:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.13@tcp, seq: 46 00000100:00100000:2.0:1783441671.607820:0:14164:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a875366d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:29d872ae-bafc-4783-9a98-d2418cedf182+27:14434:x1870073673410944:12345-192.168.201.13@tcp:36:lhsmtool_posix.0 00010000:00010000:2.0:1783441671.607936:0:14164:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff91a85f83d200/0xa2426164df2c8dbd lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14164 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783441671.607957:0:14164:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91a85f83d200/0xa2426164df2c8dbd lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14164 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783441671.607971:0:14164:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91a85f83d200/0xa2426164df2c8dbd lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14164 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1783441671.608938:0:14164:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xc:0x0].2, 88 off8344 00000004:00080000:2.0:1783441671.608953:0:14164:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 509483210646ns, next at 510483207369ns, rc = 0 00000004:00010000:2.0:1783441671.609079:0:14164:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 0000000063f4d4cd reply state 0000000055aa606b transno 8589934613 ns: mdt-lustre-MDT0000_UUID lock: ffff91a85f83d200/0xa2426164df2c8dbd lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14164 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783441671.609111:0:14164:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1783441671.609299:0:14164:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a875366d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:29d872ae-bafc-4783-9a98-d2418cedf182+29:14434:x1870073673410944:12345-192.168.201.13@tcp:36:lhsmtool_posix.0 Request processed in 1480us (2135us total) trans 8589934613 rc 0/0 00000100:00100000:2.0:1783441671.609309:0:14164:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.13@tcp, seq: 46 00000100:00100000:2.0:1783441671.613853:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.13@tcp (source: 12345-192.168.201.13@tcp) 00010000:00010000:0.0:1783441671.613968:0:3290:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff91a85f83d200/0xa2426164df2c8dbd lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14164 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783441671.613984:0:3290:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff91a85f83d200/0xa2426164df2c8dbd lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 14164 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783441671.613993:0:3290:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff91a85f83d200/0xa2426164df2c8dbd lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 14164 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783441671.614000:0:3290:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91a85f83d200 already unused, calling callback (ffffffffc1f9b4f0) 00010000:00010000:0.0:1783441671.614007:0:3290:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91a85f83d200/0xa2426164df2c8dbd lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 14164 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783441671.614015:0:3290:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91a85f83d200/0xa2426164df2c8dbd lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 14164 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783441671.614056:0:3290:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff91a8439b0900) 00010000:00010000:0.0:1783441671.614059:0:3290:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:0.0:1783441671.614065:0:3290:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff91a85f83d200/0xa2426164df2c8dbd lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 14164 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783441671.614072:0:3290:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91a85f83d200/0xa2426164df2c8dbd lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 14164 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783441671.614164:0:14821:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073673411072 00000100:00100000:3.0:1783441671.614177:0:14821:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073673411072 00000100:00100000:3.0:1783441671.614273:0:14821:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.13@tcp, seq: 47 00000100:00100000:3.0:1783441671.614484:0:14821:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a87d791c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:29d872ae-bafc-4783-9a98-d2418cedf182+28:14434:x1870073673411072:12345-192.168.201.13@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1783441671.614516:0:14821:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1783441671.614538:0:14821:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91a85eb3d600/0xa2426164df2c8dc4 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x633a354aa4df5291 expref: -99 pid: 14821 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783441671.614674:0:14821:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91a85eb3d600/0xa2426164df2c8dc4 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.201.13@tcp remote: 0x633a354aa4df5291 expref: 29 pid: 14821 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783441671.614689:0:14821:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff91a85eb3d600/0xa2426164df2c8dc4 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.13@tcp remote: 0x633a354aa4df5291 expref: 29 pid: 14821 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783441671.614712:0:14821:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff91a8439b0900) 00010000:00010000:3.0:1783441671.614715:0:14821:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1783441671.614718:0:14821:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91a85eb3d600, rc 0) 00000100:00100000:3.0:1783441671.614882:0:14821:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a87d791c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:29d872ae-bafc-4783-9a98-d2418cedf182+29:14434:x1870073673411072:12345-192.168.201.13@tcp:101:lhsmtool_posix.0 Request processed in 599us (1051us total) trans 0 rc 0/0 00000100:00100000:3.0:1783441671.614890:0:14821:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.13@tcp, seq: 47 00000100:00100000:1.0:1783441671.619861:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.13@tcp (source: 12345-192.168.201.13@tcp) 00000100:00100000:3.0:1783441671.619993:0:14798:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073673411200 00000100:00100000:3.0:1783441671.620006:0:14798:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073673411200 00000100:00100000:3.0:1783441671.620088:0:14798:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.13@tcp, seq: 12 00000100:00100000:3.0:1783441671.620101:0:14798:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a875364a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:29d872ae-bafc-4783-9a98-d2418cedf182+5:2354:x1870073673411200:12345-192.168.201.13@tcp:2:lhsmtool_posix.0 00000100:00100000:3.0:1783441671.620938:0:14798:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a875364a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:29d872ae-bafc-4783-9a98-d2418cedf182+6:2354:x1870073673411200:12345-192.168.201.13@tcp:2:lhsmtool_posix.0 Request processed in 834us (1087us total) trans 8589934594 rc 0/0 00000100:00100000:3.0:1783441671.620965:0:14798:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.13@tcp, seq: 12 00000100:00100000:1.0:1783441671.624233:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.13@tcp (source: 12345-192.168.201.13@tcp) 00000100:00100000:3.0:1783441671.624532:0:14165:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073673411456 00000100:00100000:3.0:1783441671.624611:0:14165:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073673411456 00000100:00100000:3.0:1783441671.624734:0:14165:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.13@tcp, seq: 9 00000100:00100000:3.0:1783441671.624778:0:14165:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a875364700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:29d872ae-bafc-4783-9a98-d2418cedf182+29:14434:x1870073673411456:12345-192.168.201.13@tcp:35:lhsmtool_posix.0 00000100:00100000:3.0:1783441671.625111:0:14165:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a875364700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:29d872ae-bafc-4783-9a98-d2418cedf182+30:14434:x1870073673411456:12345-192.168.201.13@tcp:35:lhsmtool_posix.0 Request processed in 335us (890us total) trans 8589934614 rc 0/0 00000100:00100000:3.0:1783441671.625120:0:14165:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.13@tcp, seq: 9 00000100:00100000:2.0:1783441671.627702:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.13@tcp (source: 12345-192.168.201.13@tcp) 00000100:00100000:0.0:1783441671.627896:0:14163:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073673411712 00000100:00100000:0.0:1783441671.627910:0:14163:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073673411712 00000100:00100000:0.0:1783441671.628047:0:14163:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.13@tcp, seq: 48 00000100:00100000:0.0:1783441671.628057:0:14163:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a87d793b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:29d872ae-bafc-4783-9a98-d2418cedf182+30:14434:x1870073673411712:12345-192.168.201.13@tcp:57:lhsmtool_posix.0 00000100:00100000:0.0:1783441671.628179:0:14163:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a87d793b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:29d872ae-bafc-4783-9a98-d2418cedf182+30:14434:x1870073673411712:12345-192.168.201.13@tcp:57:lhsmtool_posix.0 Request processed in 123us (492us total) trans 0 rc 0/0 00000100:00100000:0.0:1783441671.628185:0:14163:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.13@tcp, seq: 48 00000100:00100000:1.0:1783441671.631273:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.13@tcp (source: 12345-192.168.201.13@tcp) 00000100:00100000:2.0:1783441671.631711:0:14164:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073673411840 00000100:00100000:2.0:1783441671.631724:0:14164:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073673411840 00000100:00100000:2.0:1783441671.631867:0:14164:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.13@tcp, seq: 49 00000100:00100000:2.0:1783441671.631880:0:14164:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a875367100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:29d872ae-bafc-4783-9a98-d2418cedf182+30:14434:x1870073673411840:12345-192.168.201.13@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1783441671.631910:0:14164:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1783441671.631940:0:14164:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91a85f83c600/0xa2426164df2c8dcb lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x633a354aa4df5298 expref: -99 pid: 14164 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783441671.632048:0:14164:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff91a85f83cc00/0xa2426164df2c8dd2 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 14164 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783441671.632065:0:14164:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91a85f83cc00/0xa2426164df2c8dd2 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14164 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783441671.632079:0:14164:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91a85f83cc00/0xa2426164df2c8dd2 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14164 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1783441671.632130:0:14164:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1783441671.632153:0:14164:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff91a85f83cc00/0xa2426164df2c8dd2 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14164 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783441671.632185:0:14164:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91a85f83c600/0xa2426164df2c8dcb lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.13@tcp remote: 0x633a354aa4df5298 expref: 32 pid: 14164 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783441671.632226:0:14164:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff91a85f83cc00/0xa2426164df2c8dd2 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.13@tcp remote: 0x633a354aa4df5298 expref: 31 pid: 14164 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783441671.632237:0:14164:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff91a8439b0900) 00010000:00010000:2.0:1783441671.632241:0:14164:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:2.0:1783441671.632245:0:14164:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91a85f83cc00, rc 0) 00000100:00100000:2.0:1783441671.632341:0:14164:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a875367100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:29d872ae-bafc-4783-9a98-d2418cedf182+31:14434:x1870073673411840:12345-192.168.201.13@tcp:101:lhsmtool_posix.0 Request processed in 462us (1080us total) trans 0 rc 0/0 00000100:00100000:2.0:1783441671.632349:0:14164:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.13@tcp, seq: 49 00000100:00100000:1.0:1783441671.636153:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.13@tcp (source: 12345-192.168.201.13@tcp) 00000100:00100000:2.0:1783441671.636308:0:14800:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073673411968 00000100:00100000:2.0:1783441671.636321:0:14800:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073673411968 00000100:00100000:2.0:1783441671.636411:0:14800:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.13@tcp, seq: 13 00000100:00100000:2.0:1783441671.636432:0:14800:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a875366300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:29d872ae-bafc-4783-9a98-d2418cedf182+6:2355:x1870073673411968:12345-192.168.201.13@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1783441671.636462:0:14800:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1783441671.636497:0:14800:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000099e6bc1a/0xa2426164df2c8dd9 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x633a354aa4df529f expref: -99 pid: 14800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1783441671.636536:0:14800:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x22:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x6a4d2908, blocks: 0x1 00010000:00010000:2.0:1783441671.636726:0:14800:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x22:0x0].0x0 since=509s v=(0 0) 00010000:00010000:2.0:1783441671.636732:0:14800:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1783441671.636788:0:14800:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000099e6bc1a/0xa2426164df2c8dd9 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.13@tcp remote: 0x633a354aa4df529f expref: 7 pid: 14800 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783441671.636814:0:14800:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 0000000099e6bc1a/0xa2426164df2c8dd9 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.13@tcp remote: 0x633a354aa4df529f expref: 7 pid: 14800 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783441671.636860:0:14800:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91a85f83d200, rc 0) 00000100:00100000:2.0:1783441671.636941:0:14800:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a875366300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:29d872ae-bafc-4783-9a98-d2418cedf182+7:2355:x1870073673411968:12345-192.168.201.13@tcp:101:lhsmtool_posix.0 Request processed in 518us (801us total) trans 0 rc 0/0 00000100:00100000:2.0:1783441671.636950:0:14800:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.13@tcp, seq: 13 00000100:00100000:3.0:1783441671.640365:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.13@tcp (source: 12345-192.168.201.13@tcp) 00000100:00100000:2.0:1783441671.640511:0:14821:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073673412224 00000100:00100000:2.0:1783441671.640524:0:14821:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073673412224 00000100:00100000:2.0:1783441671.640657:0:14821:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.13@tcp, seq: 50 00000100:00100000:2.0:1783441671.640669:0:14821:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a87d7c6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:29d872ae-bafc-4783-9a98-d2418cedf182+31:14434:x1870073673412224:12345-192.168.201.13@tcp:57:lhsmtool_posix.0 00000100:00100000:2.0:1783441671.640904:0:14821:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a87d7c6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:29d872ae-bafc-4783-9a98-d2418cedf182+31:14434:x1870073673412224:12345-192.168.201.13@tcp:57:lhsmtool_posix.0 Request processed in 236us (559us total) trans 0 rc 0/0 00000100:00100000:2.0:1783441671.640912:0:14821:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.13@tcp, seq: 50 00000100:00100000:1.0:1783441671.644512:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.13@tcp (source: 12345-192.168.201.13@tcp) 00000100:00100000:0.0:1783441671.644687:0:14163:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073673412352 00000100:00100000:0.0:1783441671.644701:0:14163:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073673412352 00000100:00100000:0.0:1783441671.644851:0:14163:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.13@tcp, seq: 51 00000100:00100000:0.0:1783441671.644864:0:14163:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a875367800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:29d872ae-bafc-4783-9a98-d2418cedf182+31:14434:x1870073673412352:12345-192.168.201.13@tcp:44:lhsmtool_posix.0 00000100:00100000:0.0:1783441671.704222:0:14163:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a875367800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:29d872ae-bafc-4783-9a98-d2418cedf182+31:14434:x1870073673412352:12345-192.168.201.13@tcp:44:lhsmtool_posix.0 Request processed in 59346us (59712us total) trans 0 rc 0/0 00000100:00100000:0.0:1783441671.704238:0:14163:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.13@tcp, seq: 51 00000001:00080000:3.0:1783441671.704337:0:5807:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 8589934602 is committed 00000001:00080000:3.0:1783441671.704363:0:5807:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 8589934606 is committed 00000001:00080000:3.0:1783441671.704382:0:5807:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 8589934613 is committed 00000004:00080000:3.0:1783441671.704387:0:5807:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2 committed 00000001:00080000:3.0:1783441671.704814:0:5807:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 8589934598 is committed 00000001:00080000:3.0:1783441671.704832:0:5807:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 8589934614 is committed 00000001:00080000:3.0:1783441671.704843:0:5807:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 8589934599 is committed 00000100:00100000:3.0:1783441671.704870:0:3303:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff91a874dc6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3303:1870073693320448:0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1783441671.704941:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783441671.705068:0:14799:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073693320448 00000100:00100000:0.0:1783441671.705077:0:14799:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073693320448 00000100:00100000:0.0:1783441671.705140:0:14799:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:0.0:1783441671.705148:0:14799:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a87d7c6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3303:x1870073693320448:12345-0@lo:2:osp-syn-1-0.0 00002000:00010000:0.0:1783441671.705345:0:14799:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0x22:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:0.0:1783441671.705349:0:14799:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000400:0x22:0x0] updating lvb mtime from disk: 0 -> 0 00002000:00010000:0.0:1783441671.705352:0:14799:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000400:0x22:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:0.0:1783441671.705365:0:14799:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000400:0x22:0x0] updating lvb ctime from disk: 1783441672 -> 1783441672 00002000:00010000:0.0:1783441671.705374:0:14799:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000400:0x22:0x0] updating lvb blocks from disk: 1 -> 1 00000100:00100000:0.0:1783441671.705414:0:14799:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a87d7c6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:3303:x1870073693320448:12345-0@lo:2:osp-syn-1-0.0 Request processed in 265us (471us total) trans 8589934595 rc 0/0 00000100:00100000:0.0:1783441671.705421:0:14799:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00080000:3.0:1783441671.705653:0:14159:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000004:00080000:3.0:1783441671.705699:0:3303:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff91a874dc6d80/2, rc 0, transno 8589934595 00000100:00100000:3.0:1783441671.705707:0:3303:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff91a874dc6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3303:1870073693320448:0@lo:2:osp-syn-1-0.0 00000100:00100000:2.0:1783441671.708265:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.13@tcp (source: 12345-192.168.201.13@tcp) 00000100:00100000:3.0:1783441671.708385:0:14798:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073673412480 00000100:00100000:3.0:1783441671.708397:0:14798:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073673412480 00000100:00100000:3.0:1783441671.708472:0:14798:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.13@tcp, seq: 15 00000100:00100000:3.0:1783441671.708484:0:14798:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a87d790380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:29d872ae-bafc-4783-9a98-d2418cedf182+7:2355:x1870073673412480:12345-192.168.201.13@tcp:16:lhsmtool_posix.0 00000100:00100000:3.0:1783441671.708814:0:14798:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a87d790380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:29d872ae-bafc-4783-9a98-d2418cedf182+7:2355:x1870073673412480:12345-192.168.201.13@tcp:16:lhsmtool_posix.0 Request processed in 331us (563us total) trans 0 rc 0/0 00000100:00100000:3.0:1783441671.708821:0:14798:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.13@tcp, seq: 15 00000100:00100000:2.0:1783441671.711897:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.13@tcp (source: 12345-192.168.201.13@tcp) 00000100:00100000:3.0:1783441671.712056:0:14164:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073673412736 00000100:00100000:3.0:1783441671.712069:0:14164:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073673412736 00000100:00100000:3.0:1783441671.712147:0:14164:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.13@tcp, seq: 52 00000100:00100000:3.0:1783441671.712159:0:14164:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a87d792300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:29d872ae-bafc-4783-9a98-d2418cedf182+14:14434:x1870073673412736:12345-192.168.201.13@tcp:36:lhsmtool_posix.0 00010000:00010000:3.0:1783441671.712231:0:14164:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1783441671.712265:0:14164:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91a85f83cc00/0xa2426164df2c8dd2 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.13@tcp remote: 0x633a354aa4df5298 expref: 14 pid: 14164 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783441671.712512:0:14164:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff91a8439b0900) 00010000:00010000:3.0:1783441671.712518:0:14164:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1783441671.712628:0:14164:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff91a85eb3da00/0xa2426164df2c8de0 lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 14164 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783441671.712645:0:14164:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91a85eb3da00/0xa2426164df2c8de0 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14164 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783441671.712657:0:14164:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91a85eb3da00/0xa2426164df2c8de0 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14164 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1783441671.712954:0:14164:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 000000001d75bc04 reply state 000000000d183a0a transno 8589934615 ns: mdt-lustre-MDT0000_UUID lock: ffff91a85eb3da00/0xa2426164df2c8de0 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14164 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783441671.712966:0:14164:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1783441671.713091:0:14164:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a87d792300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:29d872ae-bafc-4783-9a98-d2418cedf182+15:14434:x1870073673412736:12345-192.168.201.13@tcp:36:lhsmtool_posix.0 Request processed in 932us (1206us total) trans 8589934615 rc 0/0 00000100:00100000:3.0:1783441671.713122:0:14164:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.13@tcp, seq: 52 00000100:00100000:2.0:1783441671.716781:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.13@tcp (source: 12345-192.168.201.13@tcp) 00000100:00100000:0.0:1783441671.717273:0:14800:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073673412864 00000100:00100000:0.0:1783441671.717297:0:14800:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073673412864 00000100:00100000:0.0:1783441671.717387:0:14800:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.13@tcp, seq: 16 00000100:00100000:0.0:1783441671.717401:0:14800:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a87d792d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:29d872ae-bafc-4783-9a98-d2418cedf182+7:14434:x1870073673412864:12345-192.168.201.13@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1783441671.717529:0:14800:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1783441671.717566:0:14800:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000004620269b/0xa2426164df2c8de7 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x633a354aa4df52a6 expref: -99 pid: 14800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783441671.717611:0:14800:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 0000000099e6bc1a/0xa2426164df2c8dd9 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.13@tcp remote: 0x633a354aa4df529f expref: 8 pid: 14800 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783441671.717622:0:14800:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1783441671.717628:0:14800:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1783441671.717633:0:14800:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000004620269b/0xa2426164df2c8de7 lrc: 4/0,0 mode: --/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000000 nid: 192.168.201.13@tcp remote: 0x633a354aa4df52a6 expref: 8 pid: 14800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783441671.717678:0:14800:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 0000000099e6bc1a/0xa2426164df2c8dd9 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.201.13@tcp remote: 0x633a354aa4df529f expref: 8 pid: 14800 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783441671.717720:0:14800:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 0000000099e6bc1a/0xa2426164df2c8dd9 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.201.13@tcp remote: 0x633a354aa4df529f expref: 8 pid: 14800 timeout: 609 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783441671.717738:0:14800:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff91a874dc4a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:14800:1870073693320576:192.168.201.13@tcp:104: 00000100:00100000:0.0:1783441671.717860:0:14800:0:(client.c:2702:ptlrpc_set_wait()) set ffff91a874cd70c0 going to sleep for 11 seconds 00010000:00010000:3.0:1783441671.719003:0:3289:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff91a85eb3da00/0xa2426164df2c8de0 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14164 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783441671.719019:0:3289:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff91a85eb3da00/0xa2426164df2c8de0 lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 14164 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783441671.719027:0:3289:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff91a85eb3da00/0xa2426164df2c8de0 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 14164 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783441671.719034:0:3289:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91a85eb3da00 already unused, calling callback (ffffffffc1f9b4f0) 00010000:00010000:3.0:1783441671.719040:0:3289:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91a85eb3da00/0xa2426164df2c8de0 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 14164 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783441671.719049:0:3289:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91a85eb3da00/0xa2426164df2c8de0 lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 14164 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783441671.719071:0:3289:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff91a8439b0900) 00010000:00010000:3.0:1783441671.719074:0:3289:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1783441671.719080:0:3289:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff91a85eb3da00/0xa2426164df2c8de0 lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 14164 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783441671.719088:0:3289:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91a85eb3da00/0xa2426164df2c8de0 lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 14164 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783441671.721245:0:14800:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff91a874dc4a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:14800:1870073693320576:192.168.201.13@tcp:104: 00010000:00010000:0.0:1783441671.721284:0:14800:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 000000004620269b/0xa2426164df2c8de7 lrc: 3/0,0 mode: --/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000020000 nid: 192.168.201.13@tcp remote: 0x633a354aa4df52a6 expref: 8 pid: 14800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783441671.721306:0:14800:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91a85fe59400, rc 0) 00000100:00100000:0.0:1783441671.721413:0:14800:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a87d792d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:29d872ae-bafc-4783-9a98-d2418cedf182+8:14434:x1870073673412864:12345-192.168.201.13@tcp:101:lhsmtool_posix.0 Request processed in 4013us (4675us total) trans 0 rc 0/0 00000100:00100000:0.0:1783441671.721423:0:14800:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.13@tcp, seq: 16 00000100:00100000:2.0:1783441671.728720:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.13@tcp (source: 12345-192.168.201.13@tcp) 00000100:00100000:0.0:1783441671.732900:0:14148:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073673412992 00000100:00100000:0.0:1783441671.732921:0:14148:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073673412992 00010000:00010000:0.0:1783441671.733523:0:14148:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 0000000099e6bc1a/0xa2426164df2c8dd9 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.201.13@tcp remote: 0x633a354aa4df529f expref: 8 pid: 14800 timeout: 609 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783441671.733726:0:14148:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.13@tcp, seq: 13 00000100:00100000:0.0:1783441671.733769:0:14148:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a87d790a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:29d872ae-bafc-4783-9a98-d2418cedf182+8:2355:x1870073673412992:12345-192.168.201.13@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1783441671.733789:0:14148:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1783441671.733819:0:14148:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 0000000099e6bc1a/0xa2426164df2c8dd9 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x22:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.201.13@tcp remote: 0x633a354aa4df529f expref: 8 pid: 14800 timeout: 609 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783441671.733862:0:14148:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 0000000099e6bc1a/0xa2426164df2c8dd9 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x22:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.201.13@tcp remote: 0x633a354aa4df529f expref: 8 pid: 14800 timeout: 609 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783441671.733893:0:14148:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000099e6bc1a/0xa2426164df2c8dd9 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x22:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.201.13@tcp remote: 0x633a354aa4df529f expref: 8 pid: 14800 timeout: 609 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783441671.733914:0:14148:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1783441671.733919:0:14148:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1783441671.733927:0:14148:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 000000004620269b/0xa2426164df2c8de7 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40080000020000 nid: 192.168.201.13@tcp remote: 0x633a354aa4df52a6 expref: 7 pid: 14800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783441671.733939:0:14148:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000004620269b/0xa2426164df2c8de7 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40080000020000 nid: 192.168.201.13@tcp remote: 0x633a354aa4df52a6 expref: 7 pid: 14800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783441671.734518:0:14148:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 000000004620269b/0xa2426164df2c8de7 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000020000 nid: 192.168.201.13@tcp remote: 0x633a354aa4df52a6 expref: 7 pid: 14800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783441671.734540:0:14148:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff91a874dc4a80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:14148:1870073693320704:192.168.201.13@tcp:105: 00000100:00100000:0.0:1783441671.734844:0:14148:0:(client.c:2702:ptlrpc_set_wait()) set ffff91a874cd70c0 going to sleep for 11 seconds 00000100:00100000:2.0:1783441671.743660:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.13@tcp (source: 12345-192.168.201.13@tcp) 00000100:00100000:3.0:1783441671.743838:0:14799:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073673413120 00000100:00100000:3.0:1783441671.743852:0:14799:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073673413120 00000100:00100000:3.0:1783441671.743930:0:14799:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.13@tcp, seq: 17 00000100:00100000:3.0:1783441671.743942:0:14799:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a87d793480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:29d872ae-bafc-4783-9a98-d2418cedf182+8:2355:x1870073673413120:12345-192.168.201.13@tcp:2:lhsmtool_posix.0 00002000:00010000:3.0:1783441671.744204:0:14799:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0x22:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:3.0:1783441671.744220:0:14799:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000400:0x22:0x0] updating lvb mtime from disk: 0 -> 1783441672 00002000:00010000:3.0:1783441671.744223:0:14799:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000400:0x22:0x0] updating lvb atime from disk: 0 -> 1783441671 00002000:00010000:3.0:1783441671.744226:0:14799:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000400:0x22:0x0] updating lvb ctime from disk: 1783441672 -> 1783441672 00002000:00010000:3.0:1783441671.744228:0:14799:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000400:0x22:0x0] updating lvb blocks from disk: 1 -> 1 00000100:00100000:3.0:1783441671.744312:0:14799:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a87d793480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:29d872ae-bafc-4783-9a98-d2418cedf182+9:2355:x1870073673413120:12345-192.168.201.13@tcp:2:lhsmtool_posix.0 Request processed in 372us (668us total) trans 8589934596 rc 0/0 00000100:00100000:3.0:1783441671.744321:0:14799:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.13@tcp, seq: 17 00000100:00100000:0.0:1783441671.749772:0:14148:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff91a874dc4a80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:14148:1870073693320704:192.168.201.13@tcp:105: 00010000:00010000:0.0:1783441671.749808:0:14148:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1783441671.749897:0:14148:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a87d790a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:29d872ae-bafc-4783-9a98-d2418cedf182+8:2355:x1870073673412992:12345-192.168.201.13@tcp:103:ldlm_bl.0 Request processed in 16159us (21189us total) trans 0 rc 0/0 00000100:00100000:0.0:1783441671.749933:0:14148:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.13@tcp, seq: 13 00000100:00100000:1.0:1783441671.750112:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.13@tcp (source: 12345-192.168.201.13@tcp) 00000100:00100000:0.0:1783441671.750411:0:14800:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073673413248 00000100:00100000:0.0:1783441671.750420:0:14800:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073673413248 00000100:00100000:0.0:1783441671.750481:0:14800:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.13@tcp, seq: 18 00000100:00100000:0.0:1783441671.750491:0:14800:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a875365500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:29d872ae-bafc-4783-9a98-d2418cedf182+8:2353:x1870073673413248:12345-192.168.201.13@tcp:1:lhsmtool_posix.0 00010000:00010000:0.0:1783441671.750706:0:14800:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: 0000000061c51987/0xa2426164df2c8dee lrc: 3/1,0 mode: --/PR res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783441671.750732:0:14800:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 000000004620269b/0xa2426164df2c8de7 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000020000 nid: 192.168.201.13@tcp remote: 0x633a354aa4df52a6 expref: 8 pid: 14800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783441671.750777:0:14800:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1783441671.750783:0:14800:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x22:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1783441671.750789:0:14800:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000061c51987/0xa2426164df2c8dee lrc: 4/1,0 mode: --/PR res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 14800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783441671.750833:0:14800:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 000000004620269b/0xa2426164df2c8de7 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000020020 nid: 192.168.201.13@tcp remote: 0x633a354aa4df52a6 expref: 8 pid: 14800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783441671.750850:0:14800:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 000000004620269b/0xa2426164df2c8de7 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400020020 nid: 192.168.201.13@tcp remote: 0x633a354aa4df52a6 expref: 8 pid: 14800 timeout: 609 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783441671.750869:0:14800:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff91a874dc4a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:14800:1870073693320832:192.168.201.13@tcp:104: 00000100:00100000:0.0:1783441671.750947:0:14800:0:(client.c:2702:ptlrpc_set_wait()) set ffff91a874cd70c0 going to sleep for 11 seconds 00000100:00100000:1.0:1783441671.754320:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.13@tcp (source: 12345-192.168.201.13@tcp) 00000100:00100000:2.0:1783441671.754809:0:14149:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073673413376 00000100:00100000:2.0:1783441671.754822:0:14149:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073673413376 00010000:00010000:2.0:1783441671.754875:0:14149:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 000000004620269b/0xa2426164df2c8de7 lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400020020 nid: 192.168.201.13@tcp remote: 0x633a354aa4df52a6 expref: 9 pid: 14800 timeout: 609 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783441671.754924:0:14149:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.13@tcp, seq: 14 00000100:00100000:2.0:1783441671.754934:0:14149:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a875364000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:29d872ae-bafc-4783-9a98-d2418cedf182+9:2354:x1870073673413376:12345-192.168.201.13@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1783441671.754952:0:14149:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1783441671.755006:0:14149:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 000000004620269b/0xa2426164df2c8de7 lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400020020 nid: 192.168.201.13@tcp remote: 0x633a354aa4df52a6 expref: 9 pid: 14800 timeout: 609 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783441671.755022:0:14149:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 000000004620269b/0xa2426164df2c8de7 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400020020 nid: 192.168.201.13@tcp remote: 0x633a354aa4df52a6 expref: 9 pid: 14800 timeout: 609 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783441671.755053:0:14149:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x22:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1783441671.755058:0:14149:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x22:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1783441671.755065:0:14149:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 0000000061c51987/0xa2426164df2c8dee lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x22:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090000000000 nid: local remote: 0x0 expref: -99 pid: 14800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783441671.755076:0:14149:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000061c51987/0xa2426164df2c8dee lrc: 4/1,0 mode: PR/PR res: [0x280000400:0x22:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090000000000 nid: local remote: 0x0 expref: -99 pid: 14800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783441671.755100:0:14149:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1783441671.755168:0:14149:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a875364000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:29d872ae-bafc-4783-9a98-d2418cedf182+9:2354:x1870073673413376:12345-192.168.201.13@tcp:103:ldlm_bl.0 Request processed in 234us (860us total) trans 0 rc 0/0 00000100:00100000:2.0:1783441671.755175:0:14149:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.13@tcp, seq: 14 00010000:00010000:0.0:1783441671.755534:0:14800:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000004620269b/0xa2426164df2c8de7 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400020020 nid: 192.168.201.13@tcp remote: 0x633a354aa4df52a6 expref: 8 pid: 14800 timeout: 609 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783441671.755626:0:14800:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff91a874dc4a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:14800:1870073693320832:192.168.201.13@tcp:104: 00010000:00010000:0.0:1783441671.755652:0:14800:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 0000000061c51987/0xa2426164df2c8dee lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 14800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783441671.755664:0:14800:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 0000000061c51987/0xa2426164df2c8dee lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 14800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783441671.755673:0:14800:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000061c51987/0xa2426164df2c8dee lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 14800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783441671.755704:0:14800:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: 0000000061c51987/0xa2426164df2c8dee lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 14800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783441671.755714:0:14800:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000061c51987/0xa2426164df2c8dee lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 14800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783441671.755722:0:14800:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000061c51987/0xa2426164df2c8dee lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 14800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783441671.755729:0:14800:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91a85fe58a00 already unused, calling callback (ffffffffc155ff90) 00010000:00010000:0.0:1783441671.755734:0:14800:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000061c51987/0xa2426164df2c8dee lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 14800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783441671.755847:0:14800:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000061c51987/0xa2426164df2c8dee lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 14800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783441671.755870:0:14800:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000061c51987/0xa2426164df2c8dee lrc: 2/0,0 mode: --/PR res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 14800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783441671.755879:0:14800:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000061c51987/0xa2426164df2c8dee lrc: 0/0,0 mode: --/PR res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 14800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783441671.755950:0:14800:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a875365500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:29d872ae-bafc-4783-9a98-d2418cedf182+7:2353:x1870073673413248:12345-192.168.201.13@tcp:1:lhsmtool_posix.0 Request processed in 5460us (5839us total) trans 0 rc 0/0 00000100:00100000:0.0:1783441671.755971:0:14800:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.13@tcp, seq: 18 00000100:00100000:1.0:1783441671.758322:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.13@tcp (source: 12345-192.168.201.13@tcp) 00000100:00100000:3.0:1783441671.758711:0:14162:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073673413632 00000100:00100000:3.0:1783441671.758722:0:14162:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073673413632 00000100:00100000:3.0:1783441671.758811:0:14162:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.13@tcp, seq: 53 00000100:00100000:3.0:1783441671.758821:0:14162:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a875364380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:29d872ae-bafc-4783-9a98-d2418cedf182+14:14434:x1870073673413632:12345-192.168.201.13@tcp:57:lhsmtool_posix.0 00010000:00010000:3.0:1783441671.758918:0:14162:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff91a85eb3da00/0xa2426164df2c8df5 lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 14162 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783441671.758939:0:14162:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91a85eb3da00/0xa2426164df2c8df5 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14162 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783441671.758951:0:14162:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91a85eb3da00/0xa2426164df2c8df5 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14162 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783441671.759260:0:14162:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff91a85eb3ce00/0xa2426164df2c8dfc lrc: 3/0,1 mode: --/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 14162 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783441671.759272:0:14162:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff91a85eb3d600/0xa2426164df2c8dc4 lrc: 2/0,0 mode: CR/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.13@tcp remote: 0x633a354aa4df5291 expref: 15 pid: 14821 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783441671.759282:0:14162:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff91a85eb3ce00/0xa2426164df2c8dfc lrc: 4/0,1 mode: --/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14162 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783441671.759319:0:14162:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff91a85eb3d600/0xa2426164df2c8dc4 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.201.13@tcp remote: 0x633a354aa4df5291 expref: 15 pid: 14821 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783441671.759342:0:14162:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff91a85eb3d600/0xa2426164df2c8dc4 lrc: 4/0,0 mode: CR/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.201.13@tcp remote: 0x633a354aa4df5291 expref: 15 pid: 14821 timeout: 609 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783441671.759938:0:14162:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff91a87d7c7b80 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:14162:1870073693320960:192.168.201.13@tcp:104: 00000100:00100000:3.0:1783441671.760041:0:14162:0:(client.c:2702:ptlrpc_set_wait()) set ffff91a85872b540 going to sleep for 11 seconds 00000100:00100000:1.0:1783441671.767687:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.13@tcp (source: 12345-192.168.201.13@tcp) 00000100:00100000:3.0:1783441671.767789:0:14162:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff91a87d7c7b80 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:14162:1870073693320960:192.168.201.13@tcp:104: 00010000:00010000:3.0:1783441671.767832:0:14162:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff91a85eb3ce00/0xa2426164df2c8dfc lrc: 3/0,1 mode: --/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14162 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783441671.768980:0:14148:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073673413760 00000100:00100000:0.0:1783441671.768996:0:14148:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073673413760 00010000:00010000:0.0:1783441671.769055:0:14148:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff91a85eb3d600/0xa2426164df2c8dc4 lrc: 4/0,0 mode: CR/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.201.13@tcp remote: 0x633a354aa4df5291 expref: 16 pid: 14821 timeout: 609 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783441671.769106:0:14148:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.13@tcp, seq: 15 00000100:00100000:0.0:1783441671.769116:0:14148:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a875365880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:29d872ae-bafc-4783-9a98-d2418cedf182+16:2354:x1870073673413760:12345-192.168.201.13@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1783441671.769138:0:14148:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1783441671.769147:0:14148:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff91a85eb3d600/0xa2426164df2c8dc4 lrc: 4/0,0 mode: CR/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.201.13@tcp remote: 0x633a354aa4df5291 expref: 16 pid: 14821 timeout: 609 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783441671.769161:0:14148:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff91a85eb3d600/0xa2426164df2c8dc4 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.201.13@tcp remote: 0x633a354aa4df5291 expref: 16 pid: 14821 timeout: 609 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783441671.769190:0:14148:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91a85eb3d600/0xa2426164df2c8dc4 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.201.13@tcp remote: 0x633a354aa4df5291 expref: 16 pid: 14821 timeout: 609 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783441671.769235:0:14148:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff91a8439b0900) 00010000:00010000:0.0:1783441671.769241:0:14148:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff91a85eb3ce00/0xa2426164df2c8dfc lrc: 3/0,1 mode: --/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14162 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783441671.769253:0:14148:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff91a85eb3ce00/0xa2426164df2c8dfc lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 14162 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783441671.769263:0:14148:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91a85eb3ce00/0xa2426164df2c8dfc lrc: 4/0,1 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 14162 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783441671.769600:0:14148:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1783441671.769692:0:14148:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a875365880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:29d872ae-bafc-4783-9a98-d2418cedf182+15:2354:x1870073673413760:12345-192.168.201.13@tcp:103:ldlm_bl.0 Request processed in 574us (2016us total) trans 0 rc 0/0 00000100:00100000:0.0:1783441671.769701:0:14148:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.13@tcp, seq: 15 00010000:00010000:3.0:1783441671.773972:0:14162:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff91a85eb3ce00/0xa2426164df2c8dfc lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14162 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783441671.773997:0:14162:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91a85eb3ce00/0xa2426164df2c8dfc lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14162 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1783441671.775013:0:14162:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8589934616 00000001:00080000:1.0:1783441671.775719:0:14162:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8589934617 00000001:00080000:1.0:1783441671.775937:0:14162:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8589934618 00000100:00100000:1.0:1783441671.776058:0:14162:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff91a875367480 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-mdtlov_UUID:14162:1870073693321088:0@lo:1000:mdt00_000.0 00000100:00100000:1.0:1783441671.778125:0:14162:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783441671.778187:0:14162:0:(client.c:2702:ptlrpc_set_wait()) set ffff91a8429c4480 going to sleep for 11 seconds 00000100:00100000:2.0:1783441671.778244:0:14167:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073693321088 00000100:00100000:2.0:1783441671.778260:0:14167:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073693321088 00000100:00100000:2.0:1783441671.778515:0:14167:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1783441671.778528:0:14167:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a875366a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:14162:x1870073693321088:12345-0@lo:1000:mdt00_000.0 00000100:00100000:2.0:1783441671.778939:0:14167:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a875366a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:14162:x1870073693321088:12345-0@lo:1000:mdt00_000.0 Request processed in 413us (823us total) trans 0 rc 0/0 00000100:00100000:2.0:1783441671.778950:0:14167:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1783441671.778997:0:14162:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff91a875367480 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-mdtlov_UUID:14162:1870073693321088:0@lo:1000:mdt00_000.0 00000001:00080000:1.0:1783441671.780506:0:14162:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8589934619 00000100:00100000:1.0:1783441671.781000:0:14162:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff91a875367480 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-mdtlov_UUID:14162:1870073693321216:0@lo:1000:mdt00_000.0 00000100:00100000:1.0:1783441671.781185:0:14162:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783441671.781247:0:14162:0:(client.c:2702:ptlrpc_set_wait()) set ffff91a842e8a540 going to sleep for 11 seconds 00000100:00100000:0.0:1783441671.781302:0:14168:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073693321216 00000100:00100000:0.0:1783441671.781317:0:14168:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073693321216 00000100:00100000:0.0:1783441671.781688:0:14168:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1783441671.781702:0:14168:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a875364e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:14162:x1870073693321216:12345-0@lo:1000:mdt00_000.0 00000100:00100000:0.0:1783441671.782042:0:14168:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a875364e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+7:14162:x1870073693321216:12345-0@lo:1000:mdt00_000.0 Request processed in 342us (948us total) trans 8589934597 rc 0/0 00000100:00100000:0.0:1783441671.782052:0:14168:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1783441671.782182:0:14162:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff91a875367480 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-mdtlov_UUID:14162:1870073693321216:0@lo:1000:mdt00_000.0 00010000:00010000:1.0:1783441671.782242:0:14162:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff91a85eb3ce00/0xa2426164df2c8dfc lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14162 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783441671.782254:0:14162:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff91a85eb3ce00/0xa2426164df2c8dfc lrc: 2/0,0 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 14162 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783441671.782263:0:14162:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff91a85eb3ce00/0xa2426164df2c8dfc lrc: 3/0,0 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 14162 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783441671.782270:0:14162:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91a85eb3ce00 already unused, calling callback (ffffffffc1f9b4f0) 00010000:00010000:1.0:1783441671.782343:0:14162:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91a85eb3ce00/0xa2426164df2c8dfc lrc: 3/0,0 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 14162 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783441671.782365:0:14162:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91a85eb3ce00/0xa2426164df2c8dfc lrc: 4/0,0 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 14162 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783441671.782383:0:14162:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff91a8439b0900) 00010000:00010000:1.0:1783441671.782387:0:14162:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1783441671.782392:0:14162:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff91a85eb3ce00/0xa2426164df2c8dfc lrc: 2/0,0 mode: --/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 14162 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783441671.782399:0:14162:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91a85eb3ce00/0xa2426164df2c8dfc lrc: 0/0,0 mode: --/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 14162 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783441671.783677:0:14162:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff91a87da47e00/0xa2426164df2c8d54 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210400000020 pid: 14164 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783441671.783693:0:14162:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff91a87da47e00/0xa2426164df2c8d54 lrc: 2/0,0 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210400000020 pid: 14164 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783441671.783699:0:14162:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff91a87da47e00/0xa2426164df2c8d54 lrc: 3/0,0 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210400000020 pid: 14164 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783441671.783721:0:14162:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91a87da47e00 already unused, calling callback (ffffffffc1f9b4f0) 00010000:00010000:1.0:1783441671.783726:0:14162:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91a87da47e00/0xa2426164df2c8d54 lrc: 3/0,0 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210400000020 pid: 14164 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783441671.783734:0:14162:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91a87da47e00/0xa2426164df2c8d54 lrc: 4/0,0 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40218400000020 pid: 14164 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783441671.783775:0:14162:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff91a858b90500) 00010000:00010000:1.0:1783441671.783778:0:14162:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1783441671.783788:0:14162:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff91a85f83d800/0xa2426164df2c8d5b lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.13@tcp remote: 0x633a354aa4df5275 expref: 18 pid: 14821 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783441671.783800:0:14162:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff91a85f83d800/0xa2426164df2c8d5b lrc: 2/0,0 mode: CR/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.201.13@tcp remote: 0x633a354aa4df5275 expref: 18 pid: 14821 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783441671.783810:0:14162:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91a85f83d800/0xa2426164df2c8d5b lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.201.13@tcp remote: 0x633a354aa4df5275 expref: 18 pid: 14821 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783441671.784021:0:14162:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: mdt-lustre-MDT0000_UUID lock: ffff91a85f83d800/0xa2426164df2c8d5b lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.13@tcp remote: 0x633a354aa4df5275 expref: 18 pid: 14821 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783441671.784056:0:14162:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff91a87d792a00 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:14162:1870073693321344:192.168.201.13@tcp:105: 00000100:00100000:2.0:1783441671.784159:0:14162:0:(client.c:2702:ptlrpc_set_wait()) set ffff91a844dbef00 going to sleep for 11 seconds 00000100:00100000:2.0:1783441671.787625:0:14162:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff91a87d792a00 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:14162:1870073693321344:192.168.201.13@tcp:105: 00010000:00010000:2.0:1783441671.787671:0:14162:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff91a87da47e00/0xa2426164df2c8d54 lrc: 2/0,0 mode: --/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x44a19400000020 pid: 14164 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783441671.787682:0:14162:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91a87da47e00/0xa2426164df2c8d54 lrc: 0/0,0 mode: --/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x44a19400000020 pid: 14164 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783441671.787725:0:14162:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff91a85f83da00/0xa2426164df2c8e03 lrc: 3/0,1 mode: --/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 14162 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783441671.787789:0:14162:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91a85f83da00/0xa2426164df2c8e03 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14162 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783441671.787804:0:14162:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91a85f83da00/0xa2426164df2c8e03 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14162 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783441671.787817:0:14162:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff91a85f83da00/0xa2426164df2c8e03 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14162 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783441671.787824:0:14162:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff91a85f83da00/0xa2426164df2c8e03 lrc: 2/0,0 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 14162 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783441671.787831:0:14162:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff91a85f83da00/0xa2426164df2c8e03 lrc: 3/0,0 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14162 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783441671.787837:0:14162:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91a85f83da00 already unused, calling callback (ffffffffc1f9b4f0) 00010000:00010000:2.0:1783441671.787841:0:14162:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91a85f83da00/0xa2426164df2c8e03 lrc: 3/0,0 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14162 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783441671.787869:0:14162:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91a85f83da00/0xa2426164df2c8e03 lrc: 4/0,0 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 14162 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783441671.787885:0:14162:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff91a858b90500) 00010000:00010000:2.0:1783441671.787888:0:14162:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1783441671.787892:0:14162:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff91a85f83da00/0xa2426164df2c8e03 lrc: 2/0,0 mode: --/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14162 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783441671.787897:0:14162:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91a85f83da00/0xa2426164df2c8e03 lrc: 0/0,0 mode: --/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14162 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783441671.787908:0:14162:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff91a85eb3da00/0xa2426164df2c8df5 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14162 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783441671.787914:0:14162:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff91a85eb3da00/0xa2426164df2c8df5 lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 14162 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783441671.787921:0:14162:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff91a85eb3da00/0xa2426164df2c8df5 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 14162 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783441671.787926:0:14162:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91a85eb3da00 already unused, calling callback (ffffffffc1f9b4f0) 00010000:00010000:2.0:1783441671.787929:0:14162:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91a85eb3da00/0xa2426164df2c8df5 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 14162 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783441671.787934:0:14162:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91a85eb3da00/0xa2426164df2c8df5 lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 14162 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783441671.787942:0:14162:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff91a858b90500) 00010000:00010000:2.0:1783441671.787944:0:14162:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:2.0:1783441671.787947:0:14162:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff91a85eb3da00/0xa2426164df2c8df5 lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 14162 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783441671.787964:0:14162:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91a85eb3da00/0xa2426164df2c8df5 lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 14162 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783441671.788254:0:14162:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a875364380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:29d872ae-bafc-4783-9a98-d2418cedf182+18:14434:x1870073673413632:12345-192.168.201.13@tcp:57:lhsmtool_posix.0 Request processed in 29430us (29939us total) trans 8589934620 rc 0/0 00000100:00100000:2.0:1783441671.788266:0:14162:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.13@tcp, seq: 53 00000020:00080000:2.0:1783441671.788273:0:14162:0:(tgt_main.c:784:tgt_ses_key_exit()) total 5 transactions per RPC 00000040:00080000:0.0:1783441671.790964:0:14197:0:(llog.c:805:llog_process_thread()) index: 2, lh_last_idx: 2 synced_idx: 2 lgh_last_idx: 2 00000040:00080000:0.0:1783441671.790975:0:14197:0:(llog_cat.c:841:llog_cat_process_common()) processing log [0x1:0xe:0x0] at index 2 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1783441671.791026:0:14197:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0xe:0x0] index 2 count 2 00000040:00080000:0.0:1783441671.791036:0:14197:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 3 count 2 00000100:00100000:1.0:1783441671.791577:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.13@tcp (source: 12345-192.168.201.13@tcp) 00000100:00100000:2.0:1783441671.791975:0:14166:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073673414016 00000100:00100000:2.0:1783441671.792082:0:14166:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073673414016 00000100:00100000:2.0:1783441671.792177:0:14166:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.13@tcp, seq: 10 00000100:00100000:2.0:1783441671.792187:0:14166:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a8756c5450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:29d872ae-bafc-4783-9a98-d2418cedf182+18:14434:x1870073673414016:12345-192.168.201.13@tcp:35:lhsmtool_posix.0 00000004:00080000:2.0:1783441671.793056:0:14166:0:(mdd_object.c:4010:mdd_close()) Object [0x200000bd1:0x3:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000001:00080000:2.0:1783441671.793184:0:14166:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8589934621 00010000:00010000:2.0:1783441671.793239:0:14166:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff91a85f83c400/0xa2426164df2c8e0a lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14166 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783441671.793260:0:14166:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91a85f83c400/0xa2426164df2c8e0a lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 14166 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783441671.793272:0:14166:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91a85f83c400/0xa2426164df2c8e0a lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 14166 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783441671.793282:0:14166:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff91a85f83c400/0xa2426164df2c8e0a lrc: 4/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 14166 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783441671.793289:0:14166:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff91a85f83c400/0xa2426164df2c8e0a lrc: 4/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 14166 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783441671.793297:0:14166:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff91a85f83c400/0xa2426164df2c8e0a lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 14166 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783441671.793331:0:14166:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:2.0:1783441671.793481:0:14166:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a8756c5450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:29d872ae-bafc-4783-9a98-d2418cedf182+20:14434:x1870073673414016:12345-192.168.201.13@tcp:35:lhsmtool_posix.0 Request processed in 1291us (1907us total) trans 8589934622 rc 0/0 00000100:00100000:2.0:1783441671.793492:0:14166:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.13@tcp, seq: 10 00000020:00080000:2.0:1783441671.793497:0:14166:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:1.0:1783441671.793765:0:14152:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1783441671.793775:0:14152:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff91a85f83c400/0xa2426164df2c8e0a lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 14166 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783441671.793784:0:14152:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91a85f83c400 already unused, calling callback (ffffffffc155ff90) 00010000:00010000:1.0:1783441671.793790:0:14152:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91a85f83c400/0xa2426164df2c8e0a lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 14166 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783441671.793800:0:14152:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91a85f83c400/0xa2426164df2c8e0a lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40018480000000 pid: 14166 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783441671.793829:0:14152:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff91a8439b0900) 00010000:00010000:1.0:1783441671.793833:0:14152:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:1.0:1783441671.793839:0:14152:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff91a85f83c400/0xa2426164df2c8e0a lrc: 1/0,0 mode: --/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 14166 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783441671.793845:0:14152:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91a85f83c400/0xa2426164df2c8e0a lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 14166 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783441671.793859:0:14152:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783441671.793860:0:14152:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783441671.793862:0:14152:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1783441671.794791:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.13@tcp (source: 12345-192.168.201.13@tcp) 00000100:00100000:3.0:1783441671.794881:0:14165:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073673414144 00000100:00100000:3.0:1783441671.794901:0:14165:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073673414144 00000100:00100000:3.0:1783441671.794962:0:14165:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.13@tcp, seq: 11 00000100:00100000:3.0:1783441671.794974:0:14165:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a875366680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:29d872ae-bafc-4783-9a98-d2418cedf182+20:14432:x1870073673414144:12345-192.168.201.13@tcp:49:dd.0 00000100:00100000:3.0:1783441671.795911:0:14165:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a875366680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:29d872ae-bafc-4783-9a98-d2418cedf182+20:14432:x1870073673414144:12345-192.168.201.13@tcp:49:dd.0 Request processed in 931us (1122us total) trans 0 rc 0/0 00000100:00100000:3.0:1783441671.795923:0:14165:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.13@tcp, seq: 11 00000100:00100000:0.0:1783441671.954529:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.13@tcp (source: 12345-192.168.201.13@tcp) 00000100:00100000:0.0:1783441671.954594:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.13@tcp (source: 12345-192.168.201.13@tcp) 00000100:00100000:2.0:1783441671.954788:0:14804:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073673414400 00000100:00100000:2.0:1783441671.954801:0:14804:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073673414400 00000100:00100000:2.0:1783441671.954883:0:14804:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073673414272 00000100:00100000:2.0:1783441671.954887:0:14804:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073673414272 00000100:00100000:2.0:1783441671.954912:0:14804:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.13@tcp, seq: 0 00000100:00100000:2.0:1783441671.954923:0:14804:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a874dc4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:29d872ae-bafc-4783-9a98-d2418cedf182+8:2353:x1870073673414400:12345-192.168.201.13@tcp:4:dd.0 00002000:00010000:2.0:1783441671.954991:0:14804:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x22:0x0] initial LVB size: 0, mtime: 0x6a4d2908, atime: 0x6a4d2907, ctime: 0x6a4d2908, blocks: 0x1 00010000:00010000:2.0:1783441671.955002:0:14804:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000006656bc4f/0xa2426164df2c8e11 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783441671.955024:0:14804:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x22:0x0].0x0 since=509s v=(0 0) 00010000:00010000:2.0:1783441671.955030:0:14804:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1783441671.955038:0:14804:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000006656bc4f/0xa2426164df2c8e11 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 14804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783441671.955056:0:14804:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000006656bc4f/0xa2426164df2c8e11 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 14804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783441671.956290:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.13@tcp (source: 12345-192.168.201.13@tcp) 00000100:00100000:0.0:1783441671.956461:0:14805:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 3 min 3 max 116 00000100:00100000:3.0:1783441671.956470:0:14803:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 3 min 3 max 116 00000100:00100000:0.0:1783441671.956474:0:14805:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_io00_003' 00000100:00100000:3.0:1783441671.956489:0:14803:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073673414528 00000100:00100000:3.0:1783441671.956497:0:14803:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073673414528 00000100:00100000:0.0:1783441671.957653:0:16290:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.13@tcp, seq: 1 00000100:00100000:0.0:1783441671.957837:0:16290:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a874dc4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:29d872ae-bafc-4783-9a98-d2418cedf182+10:2353:x1870073673414272:12345-192.168.201.13@tcp:4:dd.0 00010000:00010000:0.0:1783441671.957945:0:16290:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000025372a6/0xa2426164df2c8e18 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 16290 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783441671.957968:0:16290:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1783441671.957973:0:16290:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1783441671.957981:0:16290:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000025372a6/0xa2426164df2c8e18 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 16290 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783441671.957999:0:16290:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000025372a6/0xa2426164df2c8e18 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 16290 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783441671.963336:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.13@tcp (source: 12345-192.168.201.13@tcp) 00000100:00100000:2.0:1783441671.963776:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.13@tcp (source: 12345-192.168.201.13@tcp) 00000100:00100000:3.0:1783441671.968793:0:14805:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 4 min 3 max 116 00000100:00100000:1.0:1783441671.969019:0:14803:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 4 min 3 max 116 00000100:00100000:3.0:1783441671.969048:0:14805:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_io00_004' 00000100:00100000:1.0:1783441671.969205:0:14803:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073673414656 00000100:00100000:1.0:1783441671.969220:0:14803:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073673414656 00000100:00100000:0.0:1783441671.970256:0:14805:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073673414784 00000100:00100000:0.0:1783441671.970266:0:14805:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073673414784 00000100:00100000:0.0:1783441671.970543:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.13@tcp (source: 12345-192.168.201.13@tcp) 00000100:00100000:0.0:1783441671.970604:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.13@tcp (source: 12345-192.168.201.13@tcp) 00000100:00100000:0.0:1783441671.970637:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.13@tcp (source: 12345-192.168.201.13@tcp) 00000100:00100000:0.0:1783441671.970654:0:14805:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 4 min 3 max 116 00000100:00100000:0.0:1783441671.970663:0:14805:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073673414912 00000100:00100000:3.0:1783441671.972309:0:16291:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073673415040 00000100:00100000:3.0:1783441671.972328:0:16291:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073673415040 00000100:00100000:0.0:1783441671.975367:0:14805:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073673414912 00000100:00100000:0.0:1783441671.975481:0:14805:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073673415168 00000100:00100000:0.0:1783441671.975485:0:14805:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073673415168 00000100:00100000:0.0:1783441671.975513:0:14805:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.13@tcp, seq: 2 00000100:00100000:0.0:1783441671.975525:0:14805:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a875365f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:29d872ae-bafc-4783-9a98-d2418cedf182+16:2352:x1870073673414528:12345-192.168.201.13@tcp:4:dd.0 00010000:00010000:0.0:1783441671.975572:0:14805:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000034d76276/0xa2426164df2c8e1f lrc: 3/0,1 mode: --/PW res: [0x280000400:0x22:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14805 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783441671.975614:0:14805:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1783441671.975620:0:14805:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1783441671.975627:0:14805:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000034d76276/0xa2426164df2c8e1f lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 14805 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783441671.975645:0:14805:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000034d76276/0xa2426164df2c8e1f lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 14805 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783441672.047318:0:14151:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:0.0:1783441672.084178:0:7492:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 8589934598 is committed 00000001:00080000:0.0:1783441672.084192:0:7492:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 8589934597 is committed 00002000:00010000:3.0:1783441672.084569:0:14804:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0x22:0x0] updating lvb size from disk: 0 -> 3145728 00002000:00010000:3.0:1783441672.084578:0:14804:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000400:0x22:0x0] updating lvb blocks from disk: 1 -> 2055 00010000:00010000:3.0:1783441672.084599:0:14804:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000006656bc4f/0xa2426164df2c8e11 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 4 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 14804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783441672.084618:0:14804:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000006656bc4f/0xa2426164df2c8e11 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 4 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 14804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783441672.084628:0:14804:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000006656bc4f/0xa2426164df2c8e11 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 4 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 14804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783441672.084637:0:14804:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91a85f83da00 already unused, calling callback (ffffffffc155ff90) 00010000:00010000:3.0:1783441672.084644:0:14804:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000006656bc4f/0xa2426164df2c8e11 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 4 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 14804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783441672.084655:0:14804:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000006656bc4f/0xa2426164df2c8e11 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 4 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 14804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783441672.084683:0:14804:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000006656bc4f/0xa2426164df2c8e11 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x22:0x0].0x0 rrc: 4 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 14804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783441672.084692:0:14804:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000006656bc4f/0xa2426164df2c8e11 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x22:0x0].0x0 rrc: 4 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 14804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783441672.085068:0:14804:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a874dc4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:29d872ae-bafc-4783-9a98-d2418cedf182+18:2353:x1870073673414400:12345-192.168.201.13@tcp:4:dd.0 Request processed in 130139us (130547us total) trans 8589934598 rc 0/0 00000100:00100000:3.0:1783441672.085096:0:14804:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.13@tcp, seq: 0 00000100:00100000:3.0:1783441672.085138:0:14804:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.13@tcp, seq: 3 00000100:00100000:3.0:1783441672.085154:0:14804:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a87d790000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:29d872ae-bafc-4783-9a98-d2418cedf182+17:2352:x1870073673414784:12345-192.168.201.13@tcp:4:dd.0 00010000:00010000:3.0:1783441672.085201:0:14804:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000000689d3d2/0xa2426164df2c8e26 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x22:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783441672.085217:0:14804:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1783441672.085222:0:14804:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1783441672.085230:0:14804:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000000689d3d2/0xa2426164df2c8e26 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 4 type: EXT [4194304->5242879] (req 4194304->5242879) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 14804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783441672.085245:0:14804:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000000689d3d2/0xa2426164df2c8e26 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 4 type: EXT [4194304->5242879] (req 4194304->5242879) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 14804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1783441672.135707:0:16290:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0x22:0x0] updating lvb size from disk: 3145728 -> 5242880 00002000:00010000:2.0:1783441672.135766:0:16290:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000400:0x22:0x0] updating lvb blocks from disk: 2055 -> 6151 00010000:00010000:2.0:1783441672.135786:0:16290:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000025372a6/0xa2426164df2c8e18 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 4 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 16290 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783441672.135804:0:16290:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000025372a6/0xa2426164df2c8e18 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 4 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 16290 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783441672.135814:0:16290:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000025372a6/0xa2426164df2c8e18 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 4 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 16290 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783441672.135822:0:16290:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91a85fe59a00 already unused, calling callback (ffffffffc155ff90) 00010000:00010000:2.0:1783441672.135829:0:16290:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000025372a6/0xa2426164df2c8e18 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 4 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 16290 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783441672.135839:0:16290:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000025372a6/0xa2426164df2c8e18 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 4 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 16290 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783441672.136068:0:16290:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000025372a6/0xa2426164df2c8e18 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x22:0x0].0x0 rrc: 4 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 16290 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783441672.136078:0:16290:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000025372a6/0xa2426164df2c8e18 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x22:0x0].0x0 rrc: 5 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 16290 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783441672.136088:0:14805:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000034d76276/0xa2426164df2c8e1f lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 14805 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783441672.136097:0:14805:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000034d76276/0xa2426164df2c8e1f lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 14805 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783441672.136104:0:14805:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000034d76276/0xa2426164df2c8e1f lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 14805 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783441672.136109:0:14805:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91a85fe59000 already unused, calling callback (ffffffffc155ff90) 00010000:00010000:0.0:1783441672.136112:0:14805:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000034d76276/0xa2426164df2c8e1f lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 14805 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783441672.136119:0:14805:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000034d76276/0xa2426164df2c8e1f lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 14805 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783441672.136142:0:14805:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000034d76276/0xa2426164df2c8e1f lrc: 2/0,0 mode: --/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 14805 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783441672.136149:0:14805:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000034d76276/0xa2426164df2c8e1f lrc: 0/0,0 mode: --/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 14805 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783441672.136246:0:16290:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a874dc4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:29d872ae-bafc-4783-9a98-d2418cedf182+18:2353:x1870073673414272:12345-192.168.201.13@tcp:4:dd.0 Request processed in 178572us (181643us total) trans 8589934599 rc 0/0 00000100:00100000:2.0:1783441672.136259:0:16290:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.13@tcp, seq: 1 00000100:00100000:0.0:1783441672.136272:0:14805:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a875365f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:29d872ae-bafc-4783-9a98-d2418cedf182+18:2352:x1870073673414528:12345-192.168.201.13@tcp:4:dd.0 Request processed in 160749us (179992us total) trans 8589934600 rc 0/0 00000100:00100000:0.0:1783441672.136280:0:14805:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.13@tcp, seq: 2 00000100:00100000:2.0:1783441672.136313:0:16290:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.13@tcp, seq: 4 00000100:00100000:0.0:1783441672.136318:0:14805:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.13@tcp, seq: 5 00000100:00100000:2.0:1783441672.136326:0:16290:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a874dc4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:29d872ae-bafc-4783-9a98-d2418cedf182+16:2352:x1870073673414912:12345-192.168.201.13@tcp:4:dd.0 00000100:00100000:0.0:1783441672.136326:0:14805:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a874dc6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:29d872ae-bafc-4783-9a98-d2418cedf182+16:2352:x1870073673415168:12345-192.168.201.13@tcp:4:dd.0 00010000:00010000:2.0:1783441672.136377:0:16290:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000006656bc4f/0xa2426164df2c8e34 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x22:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 16290 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783441672.136377:0:14805:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000004620269b/0xa2426164df2c8e2d lrc: 3/0,1 mode: --/PW res: [0x280000400:0x22:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14805 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783441672.136391:0:16290:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x22:0x0].0x0 since=1s v=(0 0) 00010000:00010000:2.0:1783441672.136400:0:16290:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1783441672.136407:0:16290:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000006656bc4f/0xa2426164df2c8e34 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 4 type: EXT [5242880->6291455] (req 5242880->6291455) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 16290 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783441672.136419:0:16290:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000006656bc4f/0xa2426164df2c8e34 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 4 type: EXT [5242880->6291455] (req 5242880->6291455) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 16290 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783441672.136453:0:14805:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1783441672.136457:0:14805:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1783441672.136462:0:14805:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000004620269b/0xa2426164df2c8e2d lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 4 type: EXT [7340032->7655423] (req 7340032->7655423) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 14805 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783441672.136471:0:14805:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000004620269b/0xa2426164df2c8e2d lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 4 type: EXT [7340032->7655423] (req 7340032->7655423) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 14805 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1783441672.137171:0:7492:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 8589934600 is committed 00000001:00080000:2.0:1783441672.219604:0:7492:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 8589934601 is committed 00002000:00010000:1.0:1783441672.230669:0:14804:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0x22:0x0] updating lvb size from disk: 5242880 -> 7654321 00002000:00010000:1.0:1783441672.230675:0:14804:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000400:0x22:0x0] updating lvb blocks from disk: 6151 -> 12295 00010000:00010000:1.0:1783441672.230690:0:14804:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000000689d3d2/0xa2426164df2c8e26 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 4 type: EXT [4194304->5242879] (req 4194304->5242879) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 14804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783441672.230700:0:14804:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000000689d3d2/0xa2426164df2c8e26 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 4 type: EXT [4194304->5242879] (req 4194304->5242879) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 14804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783441672.230706:0:14804:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000000689d3d2/0xa2426164df2c8e26 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 4 type: EXT [4194304->5242879] (req 4194304->5242879) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 14804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783441672.230710:0:14804:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91a85eb3d000 already unused, calling callback (ffffffffc155ff90) 00010000:00010000:1.0:1783441672.230723:0:14804:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000000689d3d2/0xa2426164df2c8e26 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 4 type: EXT [4194304->5242879] (req 4194304->5242879) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 14804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783441672.230730:0:14804:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000000689d3d2/0xa2426164df2c8e26 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 4 type: EXT [4194304->5242879] (req 4194304->5242879) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 14804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783441672.230757:0:14804:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000000689d3d2/0xa2426164df2c8e26 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x22:0x0].0x0 rrc: 4 type: EXT [4194304->5242879] (req 4194304->5242879) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 14804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783441672.230763:0:14804:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000000689d3d2/0xa2426164df2c8e26 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x22:0x0].0x0 rrc: 4 type: EXT [4194304->5242879] (req 4194304->5242879) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 14804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783441672.230846:0:14804:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a87d790000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:29d872ae-bafc-4783-9a98-d2418cedf182+15:2352:x1870073673414784:12345-192.168.201.13@tcp:4:dd.0 Request processed in 145693us (267098us total) trans 8589934601 rc 0/0 00000100:00100000:1.0:1783441672.230857:0:14804:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.13@tcp, seq: 3 00000100:00100000:1.0:1783441672.230893:0:14804:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.13@tcp, seq: 6 00000100:00100000:1.0:1783441672.230902:0:14804:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a874dc6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:29d872ae-bafc-4783-9a98-d2418cedf182+14:2352:x1870073673415040:12345-192.168.201.13@tcp:4:dd.0 00010000:00010000:1.0:1783441672.230945:0:14804:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000000615ae02/0xa2426164df2c8e3b lrc: 3/0,1 mode: --/PW res: [0x280000400:0x22:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783441672.230958:0:14804:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1783441672.230962:0:14804:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1783441672.230968:0:14804:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000000615ae02/0xa2426164df2c8e3b lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 4 type: EXT [6291456->7340031] (req 6291456->7340031) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 14804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783441672.230980:0:14804:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000000615ae02/0xa2426164df2c8e3b lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 4 type: EXT [6291456->7340031] (req 6291456->7340031) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 14804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1783441672.268007:0:7492:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 8589934602 is committed 00000001:00080000:0.0:1783441672.268027:0:7492:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 8589934603 is committed 00010000:00010000:2.0:1783441672.268258:0:16290:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000006656bc4f/0xa2426164df2c8e34 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 4 type: EXT [5242880->6291455] (req 5242880->6291455) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 16290 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783441672.268282:0:16290:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000006656bc4f/0xa2426164df2c8e34 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 4 type: EXT [5242880->6291455] (req 5242880->6291455) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 16290 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783441672.268292:0:16290:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000006656bc4f/0xa2426164df2c8e34 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 4 type: EXT [5242880->6291455] (req 5242880->6291455) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 16290 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783441672.268299:0:16290:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91a85f83da00 already unused, calling callback (ffffffffc155ff90) 00010000:00010000:2.0:1783441672.268304:0:16290:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000006656bc4f/0xa2426164df2c8e34 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 4 type: EXT [5242880->6291455] (req 5242880->6291455) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 16290 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783441672.268314:0:16290:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000006656bc4f/0xa2426164df2c8e34 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 4 type: EXT [5242880->6291455] (req 5242880->6291455) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 16290 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783441672.268354:0:16290:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000006656bc4f/0xa2426164df2c8e34 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x22:0x0].0x0 rrc: 4 type: EXT [5242880->6291455] (req 5242880->6291455) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 16290 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783441672.268371:0:16290:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000006656bc4f/0xa2426164df2c8e34 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x22:0x0].0x0 rrc: 4 type: EXT [5242880->6291455] (req 5242880->6291455) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 16290 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783441672.268458:0:16290:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a874dc4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:29d872ae-bafc-4783-9a98-d2418cedf182+12:2352:x1870073673414912:12345-192.168.201.13@tcp:4:dd.0 Request processed in 132133us (297917us total) trans 8589934602 rc 0/0 00000100:00100000:2.0:1783441672.268469:0:16290:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.13@tcp, seq: 4 00000100:00100000:2.0:1783441672.268499:0:16290:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.13@tcp, seq: 7 00000100:00100000:2.0:1783441672.268509:0:16290:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a87d792a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:29d872ae-bafc-4783-9a98-d2418cedf182+11:2352:x1870073673414656:12345-192.168.201.13@tcp:4:dd.0 00010000:00010000:2.0:1783441672.268539:0:16290:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000099e6bc1a/0xa2426164df2c8e42 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x22:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 16290 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783441672.268550:0:16290:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1783441672.268555:0:16290:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1783441672.268561:0:16290:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000099e6bc1a/0xa2426164df2c8e42 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 4 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 16290 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783441672.268571:0:16290:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000099e6bc1a/0xa2426164df2c8e42 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 4 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 16290 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1783441672.270475:0:14805:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000400:0x22:0x0] updating lvb blocks from disk: 12295 -> 14343 00010000:00010000:1.0:1783441672.270496:0:14805:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000004620269b/0xa2426164df2c8e2d lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 4 type: EXT [7340032->7655423] (req 7340032->7655423) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 14805 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783441672.270508:0:14805:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000004620269b/0xa2426164df2c8e2d lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 4 type: EXT [7340032->7655423] (req 7340032->7655423) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 14805 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783441672.270516:0:14805:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000004620269b/0xa2426164df2c8e2d lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 4 type: EXT [7340032->7655423] (req 7340032->7655423) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 14805 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783441672.270523:0:14805:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91a85fe59400 already unused, calling callback (ffffffffc155ff90) 00010000:00010000:1.0:1783441672.270528:0:14805:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000004620269b/0xa2426164df2c8e2d lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 4 type: EXT [7340032->7655423] (req 7340032->7655423) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 14805 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783441672.270537:0:14805:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000004620269b/0xa2426164df2c8e2d lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 4 type: EXT [7340032->7655423] (req 7340032->7655423) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 14805 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783441672.270555:0:14805:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000004620269b/0xa2426164df2c8e2d lrc: 2/0,0 mode: --/PW res: [0x280000400:0x22:0x0].0x0 rrc: 4 type: EXT [7340032->7655423] (req 7340032->7655423) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 14805 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783441672.270561:0:14805:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000004620269b/0xa2426164df2c8e2d lrc: 0/0,0 mode: --/PW res: [0x280000400:0x22:0x0].0x0 rrc: 4 type: EXT [7340032->7655423] (req 7340032->7655423) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 14805 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783441672.270637:0:14805:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a874dc6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:29d872ae-bafc-4783-9a98-d2418cedf182+11:2352:x1870073673415168:12345-192.168.201.13@tcp:4:dd.0 Request processed in 134308us (299995us total) trans 8589934603 rc 0/0 00000100:00100000:1.0:1783441672.270659:0:14805:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.13@tcp, seq: 5 00010000:00010000:2.0:1783441672.327787:0:14804:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000000615ae02/0xa2426164df2c8e3b lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [6291456->7340031] (req 6291456->7340031) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 14804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783441672.327892:0:14804:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000000615ae02/0xa2426164df2c8e3b lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [6291456->7340031] (req 6291456->7340031) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 14804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1783441672.327900:0:7492:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 8589934604 is committed 00010000:00010000:2.0:1783441672.327901:0:14804:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000000615ae02/0xa2426164df2c8e3b lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [6291456->7340031] (req 6291456->7340031) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 14804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783441672.327908:0:14804:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91a87da47000 already unused, calling callback (ffffffffc155ff90) 00010000:00010000:2.0:1783441672.327912:0:14804:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000000615ae02/0xa2426164df2c8e3b lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [6291456->7340031] (req 6291456->7340031) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 14804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783441672.328146:0:14804:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000000615ae02/0xa2426164df2c8e3b lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [6291456->7340031] (req 6291456->7340031) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 14804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783441672.328169:0:14804:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000000615ae02/0xa2426164df2c8e3b lrc: 2/0,0 mode: --/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [6291456->7340031] (req 6291456->7340031) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 14804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783441672.328176:0:14804:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000000615ae02/0xa2426164df2c8e3b lrc: 0/0,0 mode: --/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [6291456->7340031] (req 6291456->7340031) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 14804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783441672.328356:0:14804:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a874dc6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:29d872ae-bafc-4783-9a98-d2418cedf182+9:2352:x1870073673415040:12345-192.168.201.13@tcp:4:dd.0 Request processed in 97441us (357738us total) trans 8589934604 rc 0/0 00000100:00100000:2.0:1783441672.328373:0:14804:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.13@tcp, seq: 6 00000001:00080000:3.0:1783441672.374480:0:7492:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 8589934605 is committed 00002000:00010000:2.0:1783441672.374593:0:16290:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000400:0x22:0x0] updating lvb blocks from disk: 14343 -> 16391 00010000:00010000:2.0:1783441672.374609:0:16290:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000099e6bc1a/0xa2426164df2c8e42 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 16290 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783441672.374641:0:16290:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000099e6bc1a/0xa2426164df2c8e42 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 16290 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783441672.374650:0:16290:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000099e6bc1a/0xa2426164df2c8e42 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 16290 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783441672.374657:0:16290:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91a85f83d200 already unused, calling callback (ffffffffc155ff90) 00010000:00010000:2.0:1783441672.374662:0:16290:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000099e6bc1a/0xa2426164df2c8e42 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 16290 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783441672.374670:0:16290:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000099e6bc1a/0xa2426164df2c8e42 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 16290 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783441672.374690:0:16290:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000099e6bc1a/0xa2426164df2c8e42 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 16290 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783441672.374699:0:16290:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000099e6bc1a/0xa2426164df2c8e42 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 16290 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783441672.374856:0:16290:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a87d792a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:29d872ae-bafc-4783-9a98-d2418cedf182+5:2352:x1870073673414656:12345-192.168.201.13@tcp:4:dd.0 Request processed in 106345us (411533us total) trans 8589934605 rc 0/0 00000100:00100000:2.0:1783441672.374866:0:16290:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.13@tcp, seq: 7 00000100:00100000:3.0:1783441672.557058:0:3304:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff91a87d7c7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:94394728-4014-4ef0-b525-989290f008aa:3304:1870073693321472:0@lo:400:kworker.0 00000100:00100000:3.0:1783441672.557143:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783441672.557192:0:3304:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff91a87d7c5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3304:1870073693321984:0@lo:400:kworker.0 00000100:00100000:3.0:1783441672.557218:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783441672.557240:0:3304:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1783441672.557245:0:3304:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff91a87d7c6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3304:1870073693321856:0@lo:400:kworker.0 00000100:00100000:3.0:1783441672.557261:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783441672.557298:0:14157:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073693321472 00000100:00100000:3.0:1783441672.557306:0:14157:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073693321472 00000100:00100000:3.0:1783441672.557362:0:14157:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 121 00000100:00100000:3.0:1783441672.557385:0:14157:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a874be8850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:94394728-4014-4ef0-b525-989290f008aa+19:3304:x1870073693321472:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1783441672.557431:0:14157:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a874be8850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:94394728-4014-4ef0-b525-989290f008aa+19:3304:x1870073693321472:12345-0@lo:400:kworker.0 Request processed in 47us (288us total) trans 0 rc 0/0 00000100:00100000:3.0:1783441672.557438:0:14157:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 121 00000100:00100000:3.0:1783441672.557496:0:3304:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff91a87d7c7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:94394728-4014-4ef0-b525-989290f008aa:3304:1870073693321472:0@lo:400:kworker.0 00000100:00100000:2.0:1783441672.557591:0:3305:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff91a87d7c4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3305:1870073693321600:0@lo:400:kworker.0 00000100:00100000:2.0:1783441672.557624:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783441672.557652:0:3305:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff91a87d7c4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3305:1870073693322112:0@lo:400:kworker.0 00000100:00100000:2.0:1783441672.557687:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783441672.557703:0:3305:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1783441672.557708:0:3305:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff91a87d7c5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3305:1870073693321728:0@lo:400:kworker.0 00000100:00100000:2.0:1783441672.557726:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783441672.557777:0:14821:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073693321984 00000100:00100000:2.0:1783441672.557782:0:14821:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073693321984 00000100:00100000:2.0:1783441672.557819:0:14821:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073693321856 00000100:00100000:2.0:1783441672.557822:0:14821:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073693321856 00000100:00100000:2.0:1783441672.557839:0:14821:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073693322112 00000100:00100000:2.0:1783441672.557842:0:14821:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073693322112 00000100:00100000:2.0:1783441672.557858:0:14821:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:2.0:1783441672.557865:0:14821:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a87d7c7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3304:x1870073693321984:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1783441672.557903:0:14821:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a87d7c7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3304:x1870073693321984:12345-0@lo:400:kworker.0 Request processed in 38us (682us total) trans 0 rc 0/0 00000100:00100000:2.0:1783441672.557909:0:14821:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:2.0:1783441672.557922:0:14821:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:2.0:1783441672.557928:0:14821:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a87d7c4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3304:x1870073693321856:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1783441672.557955:0:14821:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a87d7c4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3304:x1870073693321856:12345-0@lo:400:kworker.0 Request processed in 27us (692us total) trans 0 rc 0/0 00000100:00100000:2.0:1783441672.557961:0:14821:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:2.0:1783441672.557972:0:14821:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:2.0:1783441672.557978:0:14821:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a87d791f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3305:x1870073693322112:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1783441672.558007:0:14821:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a87d791f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3305:x1870073693322112:12345-0@lo:400:kworker.0 Request processed in 29us (320us total) trans 0 rc 0/0 00000100:00100000:2.0:1783441672.558013:0:14821:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:2.0:1783441672.558029:0:14799:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073693321600 00000100:00100000:2.0:1783441672.558033:0:14799:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073693321600 00000100:00100000:2.0:1783441672.558065:0:14799:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073693321728 00000100:00100000:2.0:1783441672.558068:0:14799:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073693321728 00000100:00100000:2.0:1783441672.558082:0:14799:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:2.0:1783441672.558088:0:14799:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a87d790e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3305:x1870073693321600:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1783441672.558117:0:14799:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a87d790e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3305:x1870073693321600:12345-0@lo:400:kworker.0 Request processed in 29us (492us total) trans 0 rc 0/0 00000100:00100000:2.0:1783441672.558123:0:14799:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:2.0:1783441672.558134:0:14799:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:2.0:1783441672.558140:0:14799:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a87d791180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3305:x1870073693321728:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1783441672.558165:0:14799:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a87d791180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3305:x1870073693321728:12345-0@lo:400:kworker.0 Request processed in 25us (438us total) trans 0 rc 0/0 00000100:00100000:2.0:1783441672.558170:0:14799:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00080000:2.0:1783441672.558185:0:14159:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1783441672.558189:0:14159:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1783441672.558217:0:3305:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 8589934597 gen 2 00000004:00080000:2.0:1783441672.558223:0:3305:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff91a874dc6d80, transno 8589934595 00000004:00080000:2.0:1783441672.558234:0:3305:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 8589934597 committed transno 8589934597 00000100:00100000:2.0:1783441672.558252:0:3305:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff91a87d7c5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3305:1870073693321728:0@lo:400:kworker.0 00000100:00100000:2.0:1783441672.558265:0:3305:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff91a87d7c4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3305:1870073693321600:0@lo:400:kworker.0 00000100:00100000:2.0:1783441672.558274:0:3305:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff91a87d7c4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3305:1870073693322112:0@lo:400:kworker.0 00000100:00100000:2.0:1783441672.558824:0:3304:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff91a87d7c6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3304:1870073693321856:0@lo:400:kworker.0 00000100:00100000:2.0:1783441672.558837:0:3304:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff91a87d7c5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3304:1870073693321984:0@lo:400:kworker.0 00000100:00100000:1.0:1783441672.559799:0:3306:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff91a874dc5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3306:1870073693322240:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1783441672.559852:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783441672.559944:0:14802:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073693322240 00000100:00100000:0.0:1783441672.559950:0:14802:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073693322240 00000100:00100000:0.0:1783441672.560005:0:14802:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:0.0:1783441672.560013:0:14802:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a875365c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3306:x1870073693322240:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1783441672.560033:0:14802:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 3407872 granted 71499776 pending 0 free 3859808256 avail 3849322496 00000100:00100000:0.0:1783441672.560097:0:14802:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a875365c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3306:x1870073693322240:12345-0@lo:13:osp-pre-1-0.0 Request processed in 85us (246us total) trans 0 rc 0/0 00000100:00100000:0.0:1783441672.560104:0:14802:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:1.0:1783441672.560666:0:3306:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff91a874dc5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3306:1870073693322240:0@lo:13:osp-pre-1-0.0 00010000:00010000:1.0:1783441673.069243:0:14152:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:0.0:1783441673.819011:0:16331:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: sanity-pcc test_1c: @@@@@@ FAIL: expected /mnt/pcc.d1c.sanity-pcc/d1c.sanity-pcc/0bd3/0x200000bd1:0x2:0x0 size: 7654321 got: 0 00010000:00010000:1.0:1783441674.092979:0:14151:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783441675.123051:0:14152:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) Debug log: 29866 lines, 29866 kept, 0 dropped, 0 bad.